Apr 22 17:44:26 devstack cinder-volume[72091]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 22 17:44:26 devstack cinder-volume[72091]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 22 17:44:26 devstack cinder-volume[72091]: we strongly recommend against using it for new projects. Apr 22 17:44:26 devstack cinder-volume[72091]: If you are already using Eventlet, we recommend migrating to a different Apr 22 17:44:26 devstack cinder-volume[72091]: framework. For more detail see Apr 22 17:44:26 devstack cinder-volume[72091]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 22 17:44:26 devstack cinder-volume[72091]: import eventlet # noqa Apr 22 17:44:27 devstack cinder-volume[72091]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=72091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 22 17:44:27 devstack cinder-volume[72091]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=72091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 22 17:44:27 devstack cinder-volume[72091]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=72091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 22 17:44:28 devstack cinder-volume[72091]: INFO dbcounter [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] Registered counter for database cinder Apr 22 17:44:28 devstack cinder-volume[72091]: DEBUG oslo_db.sqlalchemy.engines [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72091) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 22 17:44:28 devstack cinder-volume[72091]: DEBUG dbcounter [-] [72091] Writer thread running {{(pid=72091) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 22 17:44:28 devstack cinder-volume[72091]: INFO cinder.rpc [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 22 17:44:28 devstack cinder-volume[72091]: INFO cinder.rpc [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 22 17:44:28 devstack cinder-volume[72091]: DEBUG oslo_db.sqlalchemy.engines [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72091) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 22 17:44:28 devstack cinder-volume[72091]: INFO cinder.volume.manager [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] Determined volume DB was empty at startup. Apr 22 17:44:28 devstack cinder-volume[72091]: DEBUG cinder.volume.manager [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] Cinder Volume DB check: vol_db_empty=True {{(pid=72091) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 22 17:44:28 devstack cinder-volume[72091]: INFO cinder.volume.manager [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 22 17:44:28 devstack cinder-volume[72091]: WARNING stevedore.named [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 22 17:44:28 devstack cinder-volume[72091]: WARNING castellan.key_manager [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 22 17:44:28 devstack cinder-volume[72091]: WARNING cinder.keymgr.conf_key_mgr [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 22 17:44:28 devstack cinder-volume[72091]: DEBUG cinder.volume.drivers.lvm [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=72091) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Apr 22 17:44:28 devstack cinder-volume[72091]: DEBUG oslo_concurrency.processutils [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=72091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_concurrency.processutils [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] CMD "cinder-rtstool verify" returned: 0 in 0.266s {{(pid=72091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_db.sqlalchemy.engines [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72091) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 22 17:44:29 devstack cinder-volume[72091]: INFO cinder.rpc [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Apr 22 17:44:29 devstack cinder-volume[72091]: INFO cinder.rpc [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Apr 22 17:44:29 devstack cinder-volume[72091]: WARNING stevedore.named [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 22 17:44:29 devstack cinder-volume[72091]: WARNING castellan.key_manager [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 22 17:44:29 devstack cinder-volume[72091]: INFO cinder.volume.manager [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] Image-volume cache enabled for host devstack@lvmdriver-1. Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_db.sqlalchemy.engines [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72091) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 22 17:44:29 devstack cinder-volume[72091]: INFO oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] Starting 1 workers Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] Started child 72202 {{(pid=72091) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] Full set of CONF: {{(pid=72091) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] ******************************************************************************** {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] Configuration options gathered from: {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] ================================================================================ {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] allow_availability_zone_fallback = False {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] allow_compression_on_image_upload = False {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] allowed_direct_url_schemes = [] {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] api_rate_limit = True {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] auth_strategy = keystone {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] az_cache_duration = 3600 {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] backend_availability_zone = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] backend_host = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] backend_name = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] backend_stats_polling_interval = 60 {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] backup_api_class = cinder.backup.api.API {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] backup_name_template = backup-%s {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] backup_use_same_host = False {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] backup_use_temp_snapshot = False {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] chap_password = **** {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] chap_username = {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] cinder_internal_tenant_project_id = f7d29c702ca4460ab6791879d3e5428d {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] cinder_internal_tenant_user_id = 0cc6b5cb6dbd43749b11e89aeacbca73 {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] cloned_volume_same_az = True {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] cluster = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] compression_format = gzip {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] compute_api_class = cinder.compute.nova.API {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] config_dir = [] {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] config_source = [] {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] control_exchange = openstack {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] debug = True {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] default_availability_zone = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] default_group_type = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] default_volume_type = lvmdriver-1 {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] disk_geometry = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] driver_client_cert = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] driver_client_cert_key = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] driver_data_namespace = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] driver_ssl_cert_path = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] driver_ssl_cert_verify = False {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] driver_use_ssl = False {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] enable_force_upload = False {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] enable_new_services = True {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] enable_unsupported_driver = False {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] enabled_backends = ['lvmdriver-1'] {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] enforce_multipath_for_image_xfer = False {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] filter_function = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] glance_api_insecure = False {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] glance_api_servers = ['http://192.168.122.31/image'] {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] glance_api_ssl_compression = False {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] glance_ca_certificates_file = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] glance_catalog_info = image:glance:publicURL {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] glance_certfile = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] glance_keyfile = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] glance_num_retries = 3 {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] glance_request_timeout = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] goodness_function = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] graceful_shutdown_timeout = 5 {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] group_api_class = cinder.group.api.API {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] host = devstack {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] image_compress_on_upload = True {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] image_conversion_address_space_limit = 1 {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] image_conversion_cpu_limit = 60 {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] image_conversion_disable = False {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] image_upload_use_cinder_backend = False {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72202]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] image_upload_use_internal_tenant = False {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] image_volume_cache_enabled = False {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] image_volume_cache_max_count = 0 {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] image_volume_cache_max_size_gb = 0 {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] init_host_max_objects_retrieval = 0 {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] instance_format = [instance: %(uuid)s] {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] iscsi_target_flags = {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] iscsi_write_cache = on {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] iser_helper = tgtadm {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] iser_ip_address = 192.168.122.31 {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] iser_port = 3260 {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] log_color = False {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] log_config_append = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] log_dir = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] log_file = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] log_options = True {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] log_rotate_interval = 1 {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] log_rotate_interval_type = days {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] log_rotation_type = none {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] max_age = 0 {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] max_logfile_count = 30 {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] max_logfile_size_mb = 200 {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] max_over_subscription_ratio = 20.0 {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] message_reap_interval = 86400 {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] message_ttl = 2592000 {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] migration_create_volume_timeout_secs = 300 {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] monkey_patch = False {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] monkey_patch_modules = [] {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] my_ip = 192.168.122.31 {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] no_snapshot_gb_quota = False {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] num_iser_scan_tries = 3 {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] num_shell_tries = 3 {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] num_volume_device_scan_tries = 3 {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] nvmeof_conn_info_version = 1 {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] nvmet_ns_id = 10 {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] nvmet_port_id = 1 {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] osapi_max_limit = 1000 {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] osapi_volume_ext_list = [] {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] osapi_volume_listen = 0.0.0.0 {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] osapi_volume_listen_port = 8776 {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] osapi_volume_use_ssl = False {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] osapi_volume_workers = 2 {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] per_volume_size_limit = -1 {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] periodic_fuzzy_delay = 60 {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] periodic_interval = 60 {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] project_id_regex = [0-9a-f\-]+ {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] public_endpoint = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] publish_errors = False {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] quota_backup_gigabytes = 1000 {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] quota_backups = 10 {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] quota_gigabytes = 1000 {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] quota_groups = 10 {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] quota_snapshots = 10 {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] quota_volumes = 10 {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] rate_limit_burst = 0 {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] rate_limit_except_level = CRITICAL {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] rate_limit_interval = 0 {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] reinit_driver_count = 3 {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] replication_device = **** {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] report_discard_supported = False {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] report_interval = 120 {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] reservation_clean_interval = 86400 {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] reservation_expire = 86400 {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] reserved_image_namespaces = [] {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] reserved_percentage = 0 {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] rpc_response_timeout = 120 {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] run_external_periodic_tasks = True {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] scst_target_driver = iscsi {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] scst_target_iqn_name = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] service_down_time = 720 {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] shell_completion = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] snapshot_name_template = snapshot-%s {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] snapshot_same_host = True {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] split_loggers = False {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] state_path = /opt/stack/data/cinder {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] storage_availability_zone = nova {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] storage_protocol = iSCSI {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] syslog_log_facility = LOG_USER {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] target_helper = lioadm {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] target_ip_address = 192.168.122.31 {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] target_port = 3260 {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] target_protocol = iscsi {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] target_secondary_ip_addresses = [] {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] trace_flags = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] transfer_api_class = cinder.transfer.api.API {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] transport_url = **** {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] until_refresh = 0 {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] use_chap_auth = False {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] use_default_quota_class = True {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] use_journal = False {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] use_json = False {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] use_multipath_for_image_xfer = False {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] use_stderr = False {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] use_syslog = False {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] verify_glance_signatures = enabled {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] volume_api_class = cinder.volume.api.API {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] volume_backend_name = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] volume_clear = zero {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] volume_clear_ionice = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] volume_clear_size = 0 {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] volume_copy_bps_limit = 0 {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] volume_dd_blocksize = 1M {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] volume_name_template = volume-%s {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] volume_service_inithost_offload = False {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] volume_usage_audit_period = month {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] zoning_mode = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] os_brick.lightos_discovery_client_address = localhost {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] os_brick.wait_mpath_device_interval = 1 {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] oslo_concurrency.disable_process_locking = False {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] keystone_authtoken.admin_password = **** {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] keystone_authtoken.admin_tenant_name = admin {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] keystone_authtoken.admin_token = **** {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] keystone_authtoken.admin_user = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] keystone_authtoken.auth_admin_prefix = {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] keystone_authtoken.auth_port = 35357 {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] keystone_authtoken.auth_protocol = https {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] keystone_authtoken.auth_section = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] keystone_authtoken.auth_type = password {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] keystone_authtoken.auth_uri = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] keystone_authtoken.auth_version = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] keystone_authtoken.cache = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] keystone_authtoken.certfile = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] keystone_authtoken.delay_auth_decision = False {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] keystone_authtoken.http_connect_timeout = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] keystone_authtoken.identity_uri = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] keystone_authtoken.include_service_catalog = True {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] keystone_authtoken.insecure = False {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] keystone_authtoken.interface = public {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] keystone_authtoken.keyfile = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] keystone_authtoken.memcache_password = {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] keystone_authtoken.memcache_secret_key = **** {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] keystone_authtoken.memcache_security_strategy = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] keystone_authtoken.memcache_username = {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] keystone_authtoken.region_name = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] keystone_authtoken.service_token_roles_required = False {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] keystone_authtoken.service_type = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] keystone_authtoken.token_cache_time = 300 {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.31/identity {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] cache.backend = dogpile.cache.null {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] cache.backend_argument = **** {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] cache.backend_expiration_time = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] cache.config_prefix = cache.oslo {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] cache.debug_cache_backend = False {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] cache.enable_retry_client = False {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] cache.enable_socket_keepalive = False {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] cache.enabled = False {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] cache.enforce_fips_mode = False {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] cache.expiration_time = 600 {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] cache.hashclient_dead_timeout = 60.0 {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] cache.hashclient_retry_attempts = 2 {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] cache.hashclient_retry_timeout = 1.0 {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] cache.memcache_dead_retry = 300 {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] cache.memcache_pool_maxsize = 10 {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] cache.memcache_pool_unused_timeout = 60 {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] cache.memcache_sasl_enabled = False {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] cache.memcache_servers = ['localhost:11211'] {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] cache.password = **** {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] cache.proxies = [] {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] cache.redis_db = 0 {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] cache.redis_sentinel_service_name = mymaster {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] cache.redis_server = localhost:6379 {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] cache.retry_attempts = 2 {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] cache.retry_delay = 0.0 {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] cache.socket_keepalive_count = 1 {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] cache.socket_keepalive_idle = 1 {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] cache.socket_keepalive_interval = 1 {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] cache.socket_timeout = 1.0 {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] cache.tls_allowed_ciphers = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] cache.tls_cafile = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] cache.tls_certfile = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] cache.tls_enabled = False {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] cache.tls_keyfile = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] cache.username = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] coordination.backend_url = **** {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] database.asyncio_connection = **** {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] database.asyncio_slave_connection = **** {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] database.backend = sqlalchemy {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] database.connection = **** {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] database.connection_debug = 0 {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] database.connection_parameters = {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] database.connection_recycle_time = 3600 {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] database.connection_trace = False {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] database.db_inc_retry_interval = True {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] database.db_max_retries = 20 {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] database.db_max_retry_interval = 10 {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] database.db_retry_interval = 1 {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] database.max_overflow = 50 {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] database.max_pool_size = 5 {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] database.max_retries = 10 {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] database.mysql_sql_mode = TRADITIONAL {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] database.mysql_wsrep_sync_wait = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] database.pool_timeout = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] database.retry_interval = 10 {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] database.slave_connection = **** {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] database.sqlite_synchronous = True {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] database.synchronous_reader = True {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] database.use_db_reconnect = False {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] oslo_messaging_metrics.metrics_process_name = {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] profiler.connection_string = messaging:// {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] profiler.enabled = False {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] profiler.es_doc_type = notification {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] profiler.es_scroll_size = 10000 {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] profiler.es_scroll_time = 2m {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] profiler.filter_error_trace = False {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] profiler.hmac_keys = **** {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] profiler.sentinel_service_name = mymaster {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] profiler.socket_timeout = 0.1 {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] profiler.trace_requests = False {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] profiler.trace_sqlalchemy = False {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] profiler_jaeger.process_tags = {} {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] profiler_jaeger.service_name_prefix = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] profiler_otlp.service_name_prefix = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] oslo_policy.enforce_new_defaults = False {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: WARNING oslo_config.cfg [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] oslo_policy.enforce_scope = False {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] oslo_policy.policy_default_rule = default {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] oslo_policy.policy_file = policy.yaml {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] oslo_policy.remote_timeout = 60.0 {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] privsep_osbrick.capabilities = [21, 2] {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] privsep_osbrick.group = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] privsep_osbrick.helper_command = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] privsep_osbrick.log_daemon_traceback = False {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] privsep_osbrick.thread_pool_size = 4 {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] privsep_osbrick.user = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] cinder_sys_admin.group = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] cinder_sys_admin.helper_command = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] cinder_sys_admin.user = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] service_user.auth_section = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] service_user.auth_type = password {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] service_user.cafile = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] service_user.certfile = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] service_user.collect_timing = False {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] service_user.insecure = False {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] service_user.keyfile = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] service_user.send_service_user_token = True {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] service_user.split_loggers = False {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] service_user.timeout = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] glance.auth_section = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] glance.auth_type = password {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] glance.certfile = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] glance.collect_timing = False {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] glance.insecure = False {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] glance.keyfile = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] glance.region_name = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] glance.split_loggers = False {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] glance.timeout = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] backend_defaults.backend_availability_zone = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] backend_defaults.chap_password = **** {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] backend_defaults.chap_username = {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] backend_defaults.disk_geometry = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] backend_defaults.driver_client_cert = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] backend_defaults.driver_client_cert_key = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] backend_defaults.driver_data_namespace = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] backend_defaults.driver_ssl_cert_path = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] backend_defaults.driver_use_ssl = False {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] backend_defaults.enable_unsupported_driver = False {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] backend_defaults.extra_capabilities = {} {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] backend_defaults.filter_function = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] backend_defaults.goodness_function = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] backend_defaults.image_volume_cache_enabled = False {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] backend_defaults.iscsi_target_flags = {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] backend_defaults.iscsi_write_cache = on {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] backend_defaults.iser_helper = tgtadm {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] backend_defaults.iser_ip_address = 192.168.122.31 {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] backend_defaults.iser_port = 3260 {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] backend_defaults.lvm_mirrors = 0 {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] backend_defaults.lvm_share_target = False {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] backend_defaults.lvm_type = auto {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] backend_defaults.num_shell_tries = 3 {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] backend_defaults.nvmet_ns_id = 10 {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] backend_defaults.nvmet_port_id = 1 {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] backend_defaults.replication_device = **** {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] backend_defaults.report_discard_supported = False {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] backend_defaults.reserved_percentage = 0 {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] backend_defaults.scst_target_driver = iscsi {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] backend_defaults.scst_target_iqn_name = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] backend_defaults.storage_protocol = iSCSI {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] backend_defaults.target_helper = tgtadm {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] backend_defaults.target_ip_address = 192.168.122.31 {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] backend_defaults.target_port = 3260 {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] backend_defaults.target_protocol = iscsi {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] backend_defaults.trace_flags = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] backend_defaults.unique_fqdn_network = True {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] backend_defaults.use_chap_auth = False {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] backend_defaults.volume_backend_name = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] backend_defaults.volume_clear = zero {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] backend_defaults.volume_clear_ionice = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] backend_defaults.volume_clear_size = 0 {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] backend_defaults.volume_group = cinder-volumes {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] oslo_reports.file_event_handler = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] oslo_reports.file_event_handler_interval = 1 {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] oslo_reports.log_dir = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] lvmdriver-1.backend_availability_zone = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] lvmdriver-1.backend_host = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] lvmdriver-1.chap_password = **** {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] lvmdriver-1.chap_username = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] lvmdriver-1.chiscsi_conf = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] lvmdriver-1.disk_geometry = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] lvmdriver-1.driver_client_cert = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] lvmdriver-1.driver_client_cert_key = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] lvmdriver-1.driver_data_namespace = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] lvmdriver-1.driver_use_ssl = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] lvmdriver-1.extra_capabilities = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] lvmdriver-1.filter_function = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] lvmdriver-1.goodness_function = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] lvmdriver-1.iscsi_target_flags = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] lvmdriver-1.iscsi_write_cache = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] lvmdriver-1.iser_helper = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] lvmdriver-1.iser_ip_address = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] lvmdriver-1.iser_port = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] lvmdriver-1.iser_target_prefix = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] lvmdriver-1.lvm_conf_file = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] lvmdriver-1.lvm_mirrors = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] lvmdriver-1.lvm_share_target = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] lvmdriver-1.lvm_type = auto {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] lvmdriver-1.num_shell_tries = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] lvmdriver-1.nvmet_ns_id = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] lvmdriver-1.nvmet_port_id = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] lvmdriver-1.replication_device = **** {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] lvmdriver-1.report_discard_supported = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] lvmdriver-1.reserved_percentage = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] lvmdriver-1.scst_target_driver = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] lvmdriver-1.storage_protocol = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] lvmdriver-1.target_helper = lioadm {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] lvmdriver-1.target_ip_address = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] lvmdriver-1.target_port = 3260 {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] lvmdriver-1.target_protocol = iscsi {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] lvmdriver-1.trace_flags = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] lvmdriver-1.unique_fqdn_network = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] lvmdriver-1.use_chap_auth = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] lvmdriver-1.volume_clear = zero {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] lvmdriver-1.volume_clear_ionice = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] lvmdriver-1.volume_clear_size = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] lvmdriver-1.volumes_dir = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] oslo_messaging_rabbit.hostname = devstack {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72202]: INFO cinder.volume.manager [None req-1de722fa-2432-4e5f-82b2-bae1e6f3b32b None None] Starting volume driver LVMVolumeDriver (3.0.0) Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] oslo_messaging_rabbit.ssl = False {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] oslo_messaging_rabbit.ssl_version = {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] oslo_messaging_notifications.driver = [] {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] oslo_messaging_notifications.retry = -1 {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] oslo_messaging_notifications.transport_url = **** {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] key_manager.fixed_key = **** {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] barbican.barbican_api_version = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] barbican.barbican_endpoint = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] barbican.barbican_endpoint_type = public {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] barbican.barbican_region_name = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] barbican.cafile = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] barbican.certfile = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] barbican.collect_timing = False {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] barbican.insecure = False {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] barbican.keyfile = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] barbican.number_of_retries = 60 {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] barbican.retry_delay = 1 {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] barbican.send_service_user_token = False {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] barbican.split_loggers = False {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] barbican.timeout = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] barbican.verify_ssl = True {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] barbican.verify_ssl_path = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] barbican_service_user.auth_section = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] barbican_service_user.auth_type = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] barbican_service_user.cafile = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] barbican_service_user.certfile = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] barbican_service_user.collect_timing = False {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] barbican_service_user.insecure = False {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] barbican_service_user.keyfile = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] barbican_service_user.split_loggers = False {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] barbican_service_user.timeout = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] vault.approle_role_id = **** {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] vault.approle_secret_id = **** {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] vault.kv_mountpoint = secret {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] vault.kv_path = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] vault.kv_version = 2 {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72202]: DEBUG oslo_concurrency.processutils [None req-1de722fa-2432-4e5f-82b2-bae1e6f3b32b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72202) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] vault.namespace = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] vault.root_token_id = **** {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] vault.ssl_ca_crt_file = None {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] vault.timeout = 60.0 {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] vault.use_ssl = False {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:44:29 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] ******************************************************************************** {{(pid=72091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 22 17:44:29 devstack cinder-volume[72202]: DEBUG oslo_concurrency.processutils [None req-1de722fa-2432-4e5f-82b2-bae1e6f3b32b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.031s {{(pid=72202) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:44:29 devstack cinder-volume[72202]: DEBUG oslo_concurrency.processutils [None req-1de722fa-2432-4e5f-82b2-bae1e6f3b32b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72202) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:44:29 devstack cinder-volume[72202]: DEBUG oslo_concurrency.processutils [None req-1de722fa-2432-4e5f-82b2-bae1e6f3b32b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.029s {{(pid=72202) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:44:29 devstack cinder-volume[72202]: DEBUG oslo_concurrency.processutils [None req-1de722fa-2432-4e5f-82b2-bae1e6f3b32b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72202) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:44:29 devstack cinder-volume[72202]: DEBUG oslo_concurrency.processutils [None req-1de722fa-2432-4e5f-82b2-bae1e6f3b32b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=72202) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:44:29 devstack cinder-volume[72202]: DEBUG oslo_concurrency.processutils [None req-1de722fa-2432-4e5f-82b2-bae1e6f3b32b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=72202) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:44:29 devstack sudo[72207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Apr 22 17:44:29 devstack sudo[72207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:44:30 devstack sudo[72207]: pam_unix(sudo:session): session closed for user root Apr 22 17:44:30 devstack cinder-volume[72202]: DEBUG oslo_concurrency.processutils [None req-1de722fa-2432-4e5f-82b2-bae1e6f3b32b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.511s {{(pid=72202) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:44:30 devstack cinder-volume[72202]: DEBUG oslo_concurrency.processutils [None req-1de722fa-2432-4e5f-82b2-bae1e6f3b32b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72202) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:44:30 devstack sudo[72263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 22 17:44:30 devstack sudo[72263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:44:30 devstack sudo[72263]: pam_unix(sudo:session): session closed for user root Apr 22 17:44:30 devstack cinder-volume[72202]: DEBUG oslo_concurrency.processutils [None req-1de722fa-2432-4e5f-82b2-bae1e6f3b32b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.534s {{(pid=72202) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:44:30 devstack cinder-volume[72202]: DEBUG oslo_concurrency.processutils [None req-1de722fa-2432-4e5f-82b2-bae1e6f3b32b None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=72202) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 22 17:44:30 devstack cinder-volume[72202]: INFO cinder.brick.local_dev.lvm [None req-1de722fa-2432-4e5f-82b2-bae1e6f3b32b None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Apr 22 17:44:30 devstack cinder-volume[72202]: DEBUG oslo_concurrency.processutils [None req-1de722fa-2432-4e5f-82b2-bae1e6f3b32b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72202) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:44:30 devstack cinder-volume[72202]: DEBUG oslo_concurrency.processutils [None req-1de722fa-2432-4e5f-82b2-bae1e6f3b32b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.030s {{(pid=72202) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:44:30 devstack cinder-volume[72202]: DEBUG oslo_concurrency.processutils [None req-1de722fa-2432-4e5f-82b2-bae1e6f3b32b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72202) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:44:30 devstack sudo[72531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 22 17:44:30 devstack sudo[72531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:44:31 devstack sudo[72531]: pam_unix(sudo:session): session closed for user root Apr 22 17:44:31 devstack cinder-volume[72202]: DEBUG oslo_concurrency.processutils [None req-1de722fa-2432-4e5f-82b2-bae1e6f3b32b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.559s {{(pid=72202) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:44:31 devstack cinder-volume[72202]: DEBUG cinder.brick.local_dev.lvm [None req-1de722fa-2432-4e5f-82b2-bae1e6f3b32b None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=72202) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Apr 22 17:44:31 devstack cinder-volume[72202]: DEBUG oslo_concurrency.processutils [None req-1de722fa-2432-4e5f-82b2-bae1e6f3b32b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72202) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:44:31 devstack sudo[72697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 22 17:44:31 devstack sudo[72697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:44:32 devstack sudo[72697]: pam_unix(sudo:session): session closed for user root Apr 22 17:44:32 devstack cinder-volume[72202]: DEBUG oslo_concurrency.processutils [None req-1de722fa-2432-4e5f-82b2-bae1e6f3b32b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.046s {{(pid=72202) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:44:32 devstack cinder-volume[72202]: DEBUG oslo_concurrency.processutils [None req-1de722fa-2432-4e5f-82b2-bae1e6f3b32b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72202) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:44:32 devstack cinder-volume[72202]: DEBUG oslo_concurrency.processutils [None req-1de722fa-2432-4e5f-82b2-bae1e6f3b32b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.046s {{(pid=72202) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:44:32 devstack cinder-volume[72202]: DEBUG oslo_concurrency.processutils [None req-1de722fa-2432-4e5f-82b2-bae1e6f3b32b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72202) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:44:32 devstack sudo[72885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 22 17:44:32 devstack sudo[72885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:44:32 devstack sudo[72885]: pam_unix(sudo:session): session closed for user root Apr 22 17:44:32 devstack cinder-volume[72202]: DEBUG oslo_concurrency.processutils [None req-1de722fa-2432-4e5f-82b2-bae1e6f3b32b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.540s {{(pid=72202) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:44:32 devstack cinder-volume[72202]: DEBUG oslo_concurrency.processutils [None req-1de722fa-2432-4e5f-82b2-bae1e6f3b32b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72202) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:44:32 devstack cinder-volume[72202]: DEBUG oslo_concurrency.processutils [None req-1de722fa-2432-4e5f-82b2-bae1e6f3b32b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.028s {{(pid=72202) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:44:32 devstack cinder-volume[72202]: DEBUG oslo_concurrency.processutils [None req-1de722fa-2432-4e5f-82b2-bae1e6f3b32b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=72202) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:44:32 devstack sudo[72902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Apr 22 17:44:32 devstack sudo[72902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:44:33 devstack sudo[72902]: pam_unix(sudo:session): session closed for user root Apr 22 17:44:33 devstack cinder-volume[72202]: DEBUG oslo_concurrency.processutils [None req-1de722fa-2432-4e5f-82b2-bae1e6f3b32b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.478s {{(pid=72202) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:44:33 devstack cinder-volume[72202]: DEBUG oslo_concurrency.processutils [None req-1de722fa-2432-4e5f-82b2-bae1e6f3b32b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72202) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:44:33 devstack sudo[72905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 22 17:44:33 devstack sudo[72905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:44:33 devstack sudo[72905]: pam_unix(sudo:session): session closed for user root Apr 22 17:44:33 devstack cinder-volume[72202]: DEBUG oslo_concurrency.processutils [None req-1de722fa-2432-4e5f-82b2-bae1e6f3b32b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.498s {{(pid=72202) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:44:33 devstack cinder-volume[72202]: DEBUG oslo_concurrency.processutils [None req-1de722fa-2432-4e5f-82b2-bae1e6f3b32b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72202) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:44:33 devstack sudo[72910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 22 17:44:33 devstack sudo[72910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:44:34 devstack sudo[72910]: pam_unix(sudo:session): session closed for user root Apr 22 17:44:34 devstack cinder-volume[72202]: DEBUG oslo_concurrency.processutils [None req-1de722fa-2432-4e5f-82b2-bae1e6f3b32b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.514s {{(pid=72202) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:44:34 devstack cinder-volume[72202]: DEBUG oslo_concurrency.processutils [None req-1de722fa-2432-4e5f-82b2-bae1e6f3b32b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72202) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:44:34 devstack sudo[72913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 22 17:44:34 devstack sudo[72913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:44:34 devstack sudo[72913]: pam_unix(sudo:session): session closed for user root Apr 22 17:44:34 devstack cinder-volume[72202]: DEBUG oslo_concurrency.processutils [None req-1de722fa-2432-4e5f-82b2-bae1e6f3b32b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.488s {{(pid=72202) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:44:34 devstack cinder-volume[72202]: DEBUG oslo_concurrency.processutils [None req-1de722fa-2432-4e5f-82b2-bae1e6f3b32b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72202) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:44:34 devstack sudo[72921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 22 17:44:34 devstack sudo[72921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:44:35 devstack sudo[72921]: pam_unix(sudo:session): session closed for user root Apr 22 17:44:35 devstack cinder-volume[72202]: DEBUG oslo_concurrency.processutils [None req-1de722fa-2432-4e5f-82b2-bae1e6f3b32b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.495s {{(pid=72202) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:44:35 devstack cinder-volume[72202]: DEBUG oslo_concurrency.processutils [None req-1de722fa-2432-4e5f-82b2-bae1e6f3b32b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72202) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:44:35 devstack cinder-volume[72202]: DEBUG oslo_concurrency.processutils [None req-1de722fa-2432-4e5f-82b2-bae1e6f3b32b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.027s {{(pid=72202) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:44:35 devstack cinder-volume[72202]: DEBUG oslo_concurrency.processutils [None req-1de722fa-2432-4e5f-82b2-bae1e6f3b32b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72202) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:44:35 devstack sudo[72925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 22 17:44:35 devstack sudo[72925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:44:35 devstack sudo[72925]: pam_unix(sudo:session): session closed for user root Apr 22 17:44:35 devstack cinder-volume[72202]: DEBUG oslo_concurrency.processutils [None req-1de722fa-2432-4e5f-82b2-bae1e6f3b32b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.598s {{(pid=72202) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:44:35 devstack cinder-volume[72202]: INFO cinder.volume.drivers.lvm [None req-1de722fa-2432-4e5f-82b2-bae1e6f3b32b None None] Enabling LVM thin provisioning by default because a thin pool exists. Apr 22 17:44:35 devstack cinder-volume[72202]: DEBUG oslo_concurrency.processutils [None req-1de722fa-2432-4e5f-82b2-bae1e6f3b32b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72202) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:44:35 devstack cinder-volume[72202]: DEBUG oslo_concurrency.processutils [None req-1de722fa-2432-4e5f-82b2-bae1e6f3b32b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.032s {{(pid=72202) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:44:35 devstack cinder-volume[72202]: DEBUG oslo_concurrency.processutils [None req-1de722fa-2432-4e5f-82b2-bae1e6f3b32b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72202) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:44:36 devstack sudo[72943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 22 17:44:36 devstack sudo[72943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:44:36 devstack sudo[72943]: pam_unix(sudo:session): session closed for user root Apr 22 17:44:36 devstack cinder-volume[72202]: DEBUG oslo_concurrency.processutils [None req-1de722fa-2432-4e5f-82b2-bae1e6f3b32b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.554s {{(pid=72202) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:44:36 devstack cinder-volume[72202]: DEBUG cinder.volume.drivers.lvm [None req-1de722fa-2432-4e5f-82b2-bae1e6f3b32b None None] Updating volume stats {{(pid=72202) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 22 17:44:36 devstack cinder-volume[72202]: DEBUG oslo_concurrency.processutils [None req-1de722fa-2432-4e5f-82b2-bae1e6f3b32b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72202) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:44:36 devstack sudo[73047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 22 17:44:36 devstack sudo[73047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:44:36 devstack sudo[73047]: pam_unix(sudo:session): session closed for user root Apr 22 17:44:37 devstack cinder-volume[72202]: DEBUG oslo_concurrency.processutils [None req-1de722fa-2432-4e5f-82b2-bae1e6f3b32b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.458s {{(pid=72202) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:44:37 devstack cinder-volume[72202]: DEBUG oslo_concurrency.processutils [None req-1de722fa-2432-4e5f-82b2-bae1e6f3b32b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72202) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:44:37 devstack sudo[73191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 22 17:44:37 devstack sudo[73191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:44:37 devstack sudo[73191]: pam_unix(sudo:session): session closed for user root Apr 22 17:44:37 devstack cinder-volume[72202]: DEBUG oslo_concurrency.processutils [None req-1de722fa-2432-4e5f-82b2-bae1e6f3b32b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.532s {{(pid=72202) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:44:37 devstack cinder-volume[72202]: DEBUG oslo_concurrency.processutils [None req-1de722fa-2432-4e5f-82b2-bae1e6f3b32b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72202) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:44:37 devstack sudo[73196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 22 17:44:37 devstack sudo[73196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:44:38 devstack sudo[73196]: pam_unix(sudo:session): session closed for user root Apr 22 17:44:38 devstack cinder-volume[72202]: DEBUG oslo_concurrency.processutils [None req-1de722fa-2432-4e5f-82b2-bae1e6f3b32b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.480s {{(pid=72202) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:44:38 devstack cinder-volume[72202]: DEBUG oslo_concurrency.processutils [None req-1de722fa-2432-4e5f-82b2-bae1e6f3b32b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72202) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:44:38 devstack sudo[73199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 22 17:44:38 devstack sudo[73199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:44:38 devstack sudo[73199]: pam_unix(sudo:session): session closed for user root Apr 22 17:44:38 devstack cinder-volume[72202]: DEBUG oslo_concurrency.processutils [None req-1de722fa-2432-4e5f-82b2-bae1e6f3b32b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.548s {{(pid=72202) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:44:38 devstack cinder-volume[72202]: INFO cinder.volume.driver [None req-1de722fa-2432-4e5f-82b2-bae1e6f3b32b None None] Driver hasn't implemented _init_vendor_properties() Apr 22 17:44:38 devstack cinder-volume[72202]: DEBUG cinder.volume.driver [None req-1de722fa-2432-4e5f-82b2-bae1e6f3b32b None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=72202) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 22 17:44:38 devstack cinder-volume[72202]: DEBUG oslo_db.sqlalchemy.engines [None req-1de722fa-2432-4e5f-82b2-bae1e6f3b32b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72202) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 22 17:44:38 devstack cinder-volume[72202]: DEBUG dbcounter [-] [72202] Writer thread running {{(pid=72202) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 22 17:44:38 devstack cinder-volume[72202]: DEBUG cinder.db.sqlalchemy.api [None req-1de722fa-2432-4e5f-82b2-bae1e6f3b32b None None] Building query based on filter {{(pid=72202) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 22 17:44:38 devstack cinder-volume[72202]: DEBUG cinder.image.image_utils [None req-1de722fa-2432-4e5f-82b2-bae1e6f3b32b None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=72202) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 22 17:44:38 devstack cinder-volume[72202]: INFO cinder.keymgr.migration [None req-c209ab47-8055-4cef-aee8-f87d8c2120a8 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 22 17:44:38 devstack cinder-volume[72202]: DEBUG cinder.volume.drivers.lvm [None req-1de722fa-2432-4e5f-82b2-bae1e6f3b32b None None] Updating volume stats {{(pid=72202) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 22 17:44:38 devstack cinder-volume[72202]: DEBUG oslo_concurrency.processutils [None req-1de722fa-2432-4e5f-82b2-bae1e6f3b32b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72202) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:44:38 devstack sudo[73204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 22 17:44:38 devstack sudo[73204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:44:39 devstack sudo[73204]: pam_unix(sudo:session): session closed for user root Apr 22 17:44:39 devstack cinder-volume[72202]: DEBUG oslo_concurrency.processutils [None req-1de722fa-2432-4e5f-82b2-bae1e6f3b32b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.496s {{(pid=72202) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:44:39 devstack cinder-volume[72202]: DEBUG oslo_concurrency.processutils [None req-1de722fa-2432-4e5f-82b2-bae1e6f3b32b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72202) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:44:39 devstack sudo[73211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 22 17:44:39 devstack sudo[73211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:44:39 devstack cinder-volume[72091]: DEBUG dbcounter [-] [72091] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=72091) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 22 17:44:39 devstack sudo[73211]: pam_unix(sudo:session): session closed for user root Apr 22 17:44:39 devstack cinder-volume[72202]: DEBUG oslo_concurrency.processutils [None req-1de722fa-2432-4e5f-82b2-bae1e6f3b32b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.534s {{(pid=72202) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:44:39 devstack cinder-volume[72202]: DEBUG oslo_concurrency.processutils [None req-1de722fa-2432-4e5f-82b2-bae1e6f3b32b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72202) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:44:39 devstack sudo[73216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 22 17:44:39 devstack sudo[73216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:44:40 devstack sudo[73216]: pam_unix(sudo:session): session closed for user root Apr 22 17:44:40 devstack cinder-volume[72202]: DEBUG oslo_concurrency.processutils [None req-1de722fa-2432-4e5f-82b2-bae1e6f3b32b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.567s {{(pid=72202) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:44:40 devstack cinder-volume[72202]: DEBUG oslo_concurrency.processutils [None req-1de722fa-2432-4e5f-82b2-bae1e6f3b32b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72202) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:44:40 devstack sudo[73221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 22 17:44:40 devstack sudo[73221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:44:40 devstack sudo[73221]: pam_unix(sudo:session): session closed for user root Apr 22 17:44:40 devstack cinder-volume[72202]: DEBUG oslo_concurrency.processutils [None req-1de722fa-2432-4e5f-82b2-bae1e6f3b32b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.535s {{(pid=72202) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:44:40 devstack cinder-volume[72202]: DEBUG cinder.manager [None req-1de722fa-2432-4e5f-82b2-bae1e6f3b32b None None] Notifying Schedulers of capabilities ... {{(pid=72202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 17:44:40 devstack cinder-volume[72202]: INFO cinder.volume.manager [None req-1de722fa-2432-4e5f-82b2-bae1e6f3b32b None None] Driver initialization completed successfully. Apr 22 17:44:40 devstack cinder-volume[72202]: INFO cinder.manager [None req-1de722fa-2432-4e5f-82b2-bae1e6f3b32b None None] Initiating service 2 cleanup Apr 22 17:44:40 devstack cinder-volume[72202]: INFO cinder.manager [None req-1de722fa-2432-4e5f-82b2-bae1e6f3b32b None None] Service 2 cleanup completed. Apr 22 17:44:40 devstack cinder-volume[72202]: DEBUG cinder.service [None req-1de722fa-2432-4e5f-82b2-bae1e6f3b32b None None] Creating RPC server for service cinder-volume {{(pid=72202) start /opt/stack/cinder/cinder/service.py:231}} Apr 22 17:44:40 devstack cinder-volume[72202]: DEBUG cinder.service [None req-1de722fa-2432-4e5f-82b2-bae1e6f3b32b None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=72202) start /opt/stack/cinder/cinder/service.py:237}} Apr 22 17:44:40 devstack cinder-volume[72202]: INFO cinder.volume.manager [None req-1de722fa-2432-4e5f-82b2-bae1e6f3b32b None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Apr 22 17:44:40 devstack cinder-volume[72202]: DEBUG cinder.volume.drivers.lvm [None req-1de722fa-2432-4e5f-82b2-bae1e6f3b32b None None] Updating volume stats {{(pid=72202) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 22 17:44:40 devstack cinder-volume[72202]: DEBUG oslo_concurrency.processutils [None req-1de722fa-2432-4e5f-82b2-bae1e6f3b32b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72202) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:44:40 devstack sudo[73225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 22 17:44:40 devstack sudo[73225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:44:41 devstack sudo[73225]: pam_unix(sudo:session): session closed for user root Apr 22 17:44:41 devstack cinder-volume[72202]: DEBUG oslo_concurrency.processutils [None req-1de722fa-2432-4e5f-82b2-bae1e6f3b32b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.505s {{(pid=72202) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:44:41 devstack cinder-volume[72202]: DEBUG oslo_concurrency.processutils [None req-1de722fa-2432-4e5f-82b2-bae1e6f3b32b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72202) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:44:41 devstack sudo[73231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 22 17:44:41 devstack sudo[73231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:44:41 devstack sudo[73231]: pam_unix(sudo:session): session closed for user root Apr 22 17:44:41 devstack cinder-volume[72202]: DEBUG oslo_concurrency.processutils [None req-1de722fa-2432-4e5f-82b2-bae1e6f3b32b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.527s {{(pid=72202) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:44:41 devstack cinder-volume[72202]: DEBUG oslo_concurrency.processutils [None req-1de722fa-2432-4e5f-82b2-bae1e6f3b32b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72202) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:44:42 devstack sudo[73234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 22 17:44:42 devstack sudo[73234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:44:42 devstack sudo[73234]: pam_unix(sudo:session): session closed for user root Apr 22 17:44:42 devstack cinder-volume[72202]: DEBUG oslo_concurrency.processutils [None req-1de722fa-2432-4e5f-82b2-bae1e6f3b32b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.468s {{(pid=72202) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:44:42 devstack cinder-volume[72202]: DEBUG oslo_concurrency.processutils [None req-1de722fa-2432-4e5f-82b2-bae1e6f3b32b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72202) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:44:42 devstack sudo[73291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 22 17:44:42 devstack sudo[73291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:44:42 devstack sudo[73291]: pam_unix(sudo:session): session closed for user root Apr 22 17:44:42 devstack cinder-volume[72202]: DEBUG oslo_concurrency.processutils [None req-1de722fa-2432-4e5f-82b2-bae1e6f3b32b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.479s {{(pid=72202) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:44:42 devstack cinder-volume[72202]: INFO cinder.volume.manager [None req-1de722fa-2432-4e5f-82b2-bae1e6f3b32b None None] Driver post RPC initialization completed successfully. Apr 22 17:44:52 devstack cinder-volume[72202]: DEBUG dbcounter [-] [72202] Writing DB stats cinder:SELECT=4 {{(pid=72202) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 22 17:44:52 devstack cinder-volume[72202]: DEBUG dbcounter [-] [72202] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=72202) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 22 17:45:36 devstack cinder-volume[72202]: DEBUG oslo_service.periodic_task [None req-4e43f25e-0a6e-4d28-890f-50c3b9670f77 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72202) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 22 17:45:36 devstack cinder-volume[72202]: DEBUG cinder.volume.drivers.lvm [None req-4e43f25e-0a6e-4d28-890f-50c3b9670f77 None None] Updating volume stats {{(pid=72202) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 22 17:45:36 devstack cinder-volume[72202]: DEBUG oslo_concurrency.processutils [None req-4e43f25e-0a6e-4d28-890f-50c3b9670f77 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72202) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:45:36 devstack sudo[75559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 22 17:45:36 devstack sudo[75559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:45:37 devstack sudo[75559]: pam_unix(sudo:session): session closed for user root Apr 22 17:45:37 devstack cinder-volume[72202]: DEBUG oslo_concurrency.processutils [None req-4e43f25e-0a6e-4d28-890f-50c3b9670f77 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.522s {{(pid=72202) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:45:37 devstack cinder-volume[72202]: DEBUG oslo_concurrency.processutils [None req-4e43f25e-0a6e-4d28-890f-50c3b9670f77 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72202) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:45:37 devstack sudo[75563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 22 17:45:37 devstack sudo[75563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:45:38 devstack sudo[75563]: pam_unix(sudo:session): session closed for user root Apr 22 17:45:38 devstack cinder-volume[72202]: DEBUG oslo_concurrency.processutils [None req-4e43f25e-0a6e-4d28-890f-50c3b9670f77 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.541s {{(pid=72202) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:45:38 devstack cinder-volume[72202]: DEBUG oslo_concurrency.processutils [None req-4e43f25e-0a6e-4d28-890f-50c3b9670f77 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72202) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:45:38 devstack sudo[75566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 22 17:45:38 devstack sudo[75566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:45:38 devstack sudo[75566]: pam_unix(sudo:session): session closed for user root Apr 22 17:45:38 devstack cinder-volume[72202]: DEBUG oslo_concurrency.processutils [None req-4e43f25e-0a6e-4d28-890f-50c3b9670f77 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.520s {{(pid=72202) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:45:38 devstack cinder-volume[72202]: DEBUG oslo_concurrency.processutils [None req-4e43f25e-0a6e-4d28-890f-50c3b9670f77 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72202) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:45:38 devstack sudo[75573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 22 17:45:38 devstack sudo[75573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:45:39 devstack sudo[75573]: pam_unix(sudo:session): session closed for user root Apr 22 17:45:39 devstack cinder-volume[72202]: DEBUG oslo_concurrency.processutils [None req-4e43f25e-0a6e-4d28-890f-50c3b9670f77 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.517s {{(pid=72202) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:45:39 devstack cinder-volume[72202]: DEBUG cinder.manager [None req-4e43f25e-0a6e-4d28-890f-50c3b9670f77 None None] Notifying Schedulers of capabilities ... {{(pid=72202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 17:46:36 devstack cinder-volume[72202]: DEBUG oslo_service.periodic_task [None req-4e43f25e-0a6e-4d28-890f-50c3b9670f77 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72202) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 22 17:46:36 devstack cinder-volume[72202]: DEBUG cinder.volume.drivers.lvm [None req-4e43f25e-0a6e-4d28-890f-50c3b9670f77 None None] Updating volume stats {{(pid=72202) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 22 17:46:36 devstack cinder-volume[72202]: DEBUG oslo_concurrency.processutils [None req-4e43f25e-0a6e-4d28-890f-50c3b9670f77 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72202) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:46:36 devstack sudo[78355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 22 17:46:36 devstack sudo[78355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:46:37 devstack sudo[78355]: pam_unix(sudo:session): session closed for user root Apr 22 17:46:37 devstack cinder-volume[72202]: DEBUG oslo_concurrency.processutils [None req-4e43f25e-0a6e-4d28-890f-50c3b9670f77 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.451s {{(pid=72202) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:46:37 devstack cinder-volume[72202]: DEBUG oslo_concurrency.processutils [None req-4e43f25e-0a6e-4d28-890f-50c3b9670f77 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72202) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:46:37 devstack sudo[78358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 22 17:46:37 devstack sudo[78358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:46:37 devstack sudo[78358]: pam_unix(sudo:session): session closed for user root Apr 22 17:46:37 devstack cinder-volume[72202]: DEBUG oslo_concurrency.processutils [None req-4e43f25e-0a6e-4d28-890f-50c3b9670f77 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.499s {{(pid=72202) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:46:37 devstack cinder-volume[72202]: DEBUG oslo_concurrency.processutils [None req-4e43f25e-0a6e-4d28-890f-50c3b9670f77 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72202) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:46:37 devstack sudo[78363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 22 17:46:37 devstack sudo[78363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:46:38 devstack sudo[78363]: pam_unix(sudo:session): session closed for user root Apr 22 17:46:38 devstack cinder-volume[72202]: DEBUG oslo_concurrency.processutils [None req-4e43f25e-0a6e-4d28-890f-50c3b9670f77 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.459s {{(pid=72202) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:46:38 devstack cinder-volume[72202]: DEBUG oslo_concurrency.processutils [None req-4e43f25e-0a6e-4d28-890f-50c3b9670f77 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72202) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:46:38 devstack sudo[78369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 22 17:46:38 devstack sudo[78369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:46:38 devstack sudo[78369]: pam_unix(sudo:session): session closed for user root Apr 22 17:46:38 devstack cinder-volume[72202]: DEBUG oslo_concurrency.processutils [None req-4e43f25e-0a6e-4d28-890f-50c3b9670f77 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.452s {{(pid=72202) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:46:38 devstack cinder-volume[72202]: DEBUG cinder.manager [None req-4e43f25e-0a6e-4d28-890f-50c3b9670f77 None None] Notifying Schedulers of capabilities ... {{(pid=72202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 17:46:52 devstack cinder-volume[72202]: DEBUG dbcounter [-] [72202] Writing DB stats cinder:SELECT=1 {{(pid=72202) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 22 17:46:52 devstack cinder-volume[72202]: DEBUG dbcounter [-] [72202] Writing DB stats cinder:UPDATE=1 {{(pid=72202) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 22 17:47:36 devstack cinder-volume[72202]: DEBUG oslo_service.periodic_task [None req-4e43f25e-0a6e-4d28-890f-50c3b9670f77 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72202) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 22 17:47:36 devstack cinder-volume[72202]: DEBUG cinder.volume.drivers.lvm [None req-4e43f25e-0a6e-4d28-890f-50c3b9670f77 None None] Updating volume stats {{(pid=72202) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 22 17:47:36 devstack cinder-volume[72202]: DEBUG oslo_concurrency.processutils [None req-4e43f25e-0a6e-4d28-890f-50c3b9670f77 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72202) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:47:36 devstack sudo[80391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 22 17:47:36 devstack sudo[80391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:47:37 devstack sudo[80391]: pam_unix(sudo:session): session closed for user root Apr 22 17:47:37 devstack cinder-volume[72202]: DEBUG oslo_concurrency.processutils [None req-4e43f25e-0a6e-4d28-890f-50c3b9670f77 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.479s {{(pid=72202) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:47:37 devstack cinder-volume[72202]: DEBUG oslo_concurrency.processutils [None req-4e43f25e-0a6e-4d28-890f-50c3b9670f77 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72202) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:47:37 devstack sudo[80398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 22 17:47:37 devstack sudo[80398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:47:37 devstack sudo[80398]: pam_unix(sudo:session): session closed for user root Apr 22 17:47:37 devstack cinder-volume[72202]: DEBUG oslo_concurrency.processutils [None req-4e43f25e-0a6e-4d28-890f-50c3b9670f77 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.472s {{(pid=72202) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:47:37 devstack cinder-volume[72202]: DEBUG oslo_concurrency.processutils [None req-4e43f25e-0a6e-4d28-890f-50c3b9670f77 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72202) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:47:37 devstack sudo[80425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 22 17:47:37 devstack sudo[80425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:47:38 devstack sudo[80425]: pam_unix(sudo:session): session closed for user root Apr 22 17:47:38 devstack cinder-volume[72202]: DEBUG oslo_concurrency.processutils [None req-4e43f25e-0a6e-4d28-890f-50c3b9670f77 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.523s {{(pid=72202) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:47:38 devstack cinder-volume[72202]: DEBUG oslo_concurrency.processutils [None req-4e43f25e-0a6e-4d28-890f-50c3b9670f77 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72202) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:47:38 devstack sudo[80435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 22 17:47:38 devstack sudo[80435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:47:38 devstack sudo[80435]: pam_unix(sudo:session): session closed for user root Apr 22 17:47:38 devstack cinder-volume[72202]: DEBUG oslo_concurrency.processutils [None req-4e43f25e-0a6e-4d28-890f-50c3b9670f77 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.496s {{(pid=72202) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:47:38 devstack cinder-volume[72202]: DEBUG cinder.manager [None req-4e43f25e-0a6e-4d28-890f-50c3b9670f77 None None] Notifying Schedulers of capabilities ... {{(pid=72202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 17:48:15 devstack cinder-volume[72091]: INFO oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] Caught SIGTERM, stopping children Apr 22 17:48:15 devstack cinder-volume[72091]: DEBUG oslo_concurrency.lockutils [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] Acquiring lock "singleton_lock" {{(pid=72091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 22 17:48:15 devstack cinder-volume[72091]: DEBUG oslo_concurrency.lockutils [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] Acquired lock "singleton_lock" {{(pid=72091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 22 17:48:15 devstack cinder-volume[72091]: DEBUG oslo_concurrency.lockutils [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] Releasing lock "singleton_lock" {{(pid=72091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 22 17:48:15 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] Stop services. {{(pid=72091) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 22 17:48:15 devstack cinder-volume[72091]: DEBUG oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] Killing children. {{(pid=72091) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 22 17:48:15 devstack cinder-volume[72091]: INFO oslo_service.backend._eventlet.service [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] Waiting on 1 children to exit Apr 22 17:48:20 devstack cinder-volume[72202]: DEBUG oslo_concurrency.lockutils [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] Acquiring lock "singleton_lock" {{(pid=72202) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 22 17:48:20 devstack cinder-volume[72202]: DEBUG oslo_concurrency.lockutils [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] Acquired lock "singleton_lock" {{(pid=72202) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 22 17:48:20 devstack cinder-volume[72202]: DEBUG oslo_concurrency.lockutils [None req-ac2e4415-4535-4f79-b346-04ff6c712d5c None None] Releasing lock "singleton_lock" {{(pid=72202) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 22 17:48:20 devstack cinder-volume[72202]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Apr 22 17:48:20 devstack cinder-volume[72202]: --- Logging error --- Apr 22 17:48:20 devstack cinder-volume[72202]: Traceback (most recent call last): Apr 22 17:48:20 devstack cinder-volume[72202]: File "/usr/lib/python3.10/logging/__init__.py", line 1100, in emit Apr 22 17:48:20 devstack cinder-volume[72202]: msg = self.format(record) Apr 22 17:48:20 devstack cinder-volume[72202]: File "/usr/lib/python3.10/logging/__init__.py", line 943, in format Apr 22 17:48:20 devstack cinder-volume[72202]: return fmt.format(record) Apr 22 17:48:20 devstack cinder-volume[72202]: File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/formatters.py", line 471, in format Apr 22 17:48:20 devstack cinder-volume[72202]: context = _update_record_with_context(record) Apr 22 17:48:20 devstack cinder-volume[72202]: File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/formatters.py", line 71, in _update_record_with_context Apr 22 17:48:20 devstack cinder-volume[72202]: context = record.__dict__.get('context', context_utils.get_current()) Apr 22 17:48:20 devstack cinder-volume[72202]: File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_context/context.py", line 505, in get_current Apr 22 17:48:20 devstack cinder-volume[72202]: return getattr(_request_store, 'context', None) Apr 22 17:48:20 devstack cinder-volume[72202]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/corolocal.py", line 44, in __getattribute__ Apr 22 17:48:20 devstack cinder-volume[72202]: _patch(self) Apr 22 17:48:20 devstack cinder-volume[72202]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/corolocal.py", line 34, in _patch Apr 22 17:48:20 devstack cinder-volume[72202]: greens[cur] = {} Apr 22 17:48:20 devstack cinder-volume[72202]: File "/usr/lib/python3.10/weakref.py", line 429, in __setitem__ Apr 22 17:48:20 devstack cinder-volume[72202]: self.data[ref(key, self._remove)] = value Apr 22 17:48:20 devstack cinder-volume[72202]: TypeError: cannot create weak reference to 'NoneType' object Apr 22 17:48:20 devstack cinder-volume[72202]: Call stack: Apr 22 17:48:20 devstack cinder-volume[72202]: File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/_drivers/common.py", line 467, in __del__ Apr 22 17:48:20 devstack cinder-volume[72202]: self._done() Apr 22 17:48:20 devstack cinder-volume[72202]: File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/_drivers/common.py", line 455, in _done Apr 22 17:48:20 devstack cinder-volume[72202]: self.connection.close() Apr 22 17:48:20 devstack cinder-volume[72202]: File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1217, in close Apr 22 17:48:20 devstack cinder-volume[72202]: self._set_current_channel(None) Apr 22 17:48:20 devstack cinder-volume[72202]: File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1180, in _set_current_channel Apr 22 17:48:20 devstack cinder-volume[72202]: self.connection.maybe_close_channel(self.channel) Apr 22 17:48:20 devstack cinder-volume[72202]: File "/opt/stack/data/venv/lib/python3.10/site-packages/kombu/connection.py", line 348, in maybe_close_channel Apr 22 17:48:20 devstack cinder-volume[72202]: channel.close() Apr 22 17:48:20 devstack cinder-volume[72202]: File "/opt/stack/data/venv/lib/python3.10/site-packages/amqp/channel.py", line 235, in close Apr 22 17:48:20 devstack cinder-volume[72202]: return self.send_method( Apr 22 17:48:20 devstack cinder-volume[72202]: File "/opt/stack/data/venv/lib/python3.10/site-packages/amqp/abstract_channel.py", line 79, in send_method Apr 22 17:48:20 devstack cinder-volume[72202]: return self.wait(wait, returns_tuple=returns_tuple) Apr 22 17:48:20 devstack cinder-volume[72202]: File "/opt/stack/data/venv/lib/python3.10/site-packages/amqp/abstract_channel.py", line 99, in wait Apr 22 17:48:20 devstack cinder-volume[72202]: self.connection.drain_events(timeout=timeout) Apr 22 17:48:20 devstack cinder-volume[72202]: File "/opt/stack/data/venv/lib/python3.10/site-packages/amqp/connection.py", line 526, in drain_events Apr 22 17:48:20 devstack cinder-volume[72202]: while not self.blocking_read(timeout): Apr 22 17:48:20 devstack cinder-volume[72202]: File "/opt/stack/data/venv/lib/python3.10/site-packages/amqp/connection.py", line 532, in blocking_read Apr 22 17:48:20 devstack cinder-volume[72202]: return self.on_inbound_frame(frame) Apr 22 17:48:20 devstack cinder-volume[72202]: File "/opt/stack/data/venv/lib/python3.10/site-packages/amqp/method_framing.py", line 53, in on_frame Apr 22 17:48:20 devstack cinder-volume[72202]: callback(channel, method_sig, buf, None) Apr 22 17:48:20 devstack cinder-volume[72202]: File "/opt/stack/data/venv/lib/python3.10/site-packages/amqp/connection.py", line 538, in on_inbound_method Apr 22 17:48:20 devstack cinder-volume[72202]: return self.channels[channel_id].dispatch_method( Apr 22 17:48:20 devstack cinder-volume[72202]: File "/opt/stack/data/venv/lib/python3.10/site-packages/amqp/abstract_channel.py", line 118, in dispatch_method Apr 22 17:48:20 devstack cinder-volume[72202]: AMQP_LOGGER.warning( Apr 22 17:48:20 devstack cinder-volume[72202]: Message: 'Received method %s during closing channel %s. This method will be ignored' Apr 22 17:48:20 devstack cinder-volume[72202]: Arguments: ((60, 30), 1) Apr 22 17:48:20 devstack cinder-volume[72202]: --- Logging error --- Apr 22 17:48:20 devstack cinder-volume[72202]: Traceback (most recent call last): Apr 22 17:48:20 devstack cinder-volume[72202]: File "/usr/lib/python3.10/logging/__init__.py", line 1100, in emit Apr 22 17:48:20 devstack cinder-volume[72202]: msg = self.format(record) Apr 22 17:48:20 devstack cinder-volume[72202]: File "/usr/lib/python3.10/logging/__init__.py", line 943, in format Apr 22 17:48:20 devstack cinder-volume[72202]: return fmt.format(record) Apr 22 17:48:20 devstack cinder-volume[72202]: File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/formatters.py", line 471, in format Apr 22 17:48:20 devstack cinder-volume[72202]: context = _update_record_with_context(record) Apr 22 17:48:20 devstack cinder-volume[72202]: File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/formatters.py", line 71, in _update_record_with_context Apr 22 17:48:20 devstack cinder-volume[72202]: context = record.__dict__.get('context', context_utils.get_current()) Apr 22 17:48:20 devstack cinder-volume[72202]: File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_context/context.py", line 505, in get_current Apr 22 17:48:20 devstack cinder-volume[72202]: return getattr(_request_store, 'context', None) Apr 22 17:48:20 devstack cinder-volume[72202]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/corolocal.py", line 44, in __getattribute__ Apr 22 17:48:21 devstack cinder-volume[72202]: _patch(self) Apr 22 17:48:21 devstack cinder-volume[72202]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/corolocal.py", line 34, in _patch Apr 22 17:48:21 devstack cinder-volume[72202]: greens[cur] = {} Apr 22 17:48:21 devstack cinder-volume[72202]: File "/usr/lib/python3.10/weakref.py", line 429, in __setitem__ Apr 22 17:48:21 devstack cinder-volume[72202]: self.data[ref(key, self._remove)] = value Apr 22 17:48:21 devstack cinder-volume[72202]: TypeError: cannot create weak reference to 'NoneType' object Apr 22 17:48:21 devstack cinder-volume[72202]: Call stack: Apr 22 17:48:21 devstack cinder-volume[72202]: File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/_drivers/common.py", line 467, in __del__ Apr 22 17:48:21 devstack cinder-volume[72202]: self._done() Apr 22 17:48:21 devstack cinder-volume[72202]: File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/_drivers/common.py", line 455, in _done Apr 22 17:48:21 devstack cinder-volume[72202]: self.connection.close() Apr 22 17:48:21 devstack cinder-volume[72202]: File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1217, in close Apr 22 17:48:21 devstack cinder-volume[72202]: self._set_current_channel(None) Apr 22 17:48:21 devstack cinder-volume[72202]: File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1180, in _set_current_channel Apr 22 17:48:21 devstack cinder-volume[72202]: self.connection.maybe_close_channel(self.channel) Apr 22 17:48:21 devstack cinder-volume[72202]: File "/opt/stack/data/venv/lib/python3.10/site-packages/kombu/connection.py", line 348, in maybe_close_channel Apr 22 17:48:21 devstack cinder-volume[72202]: channel.close() Apr 22 17:48:21 devstack cinder-volume[72202]: File "/opt/stack/data/venv/lib/python3.10/site-packages/amqp/channel.py", line 235, in close Apr 22 17:48:21 devstack cinder-volume[72202]: return self.send_method( Apr 22 17:48:21 devstack cinder-volume[72202]: File "/opt/stack/data/venv/lib/python3.10/site-packages/amqp/abstract_channel.py", line 79, in send_method Apr 22 17:48:21 devstack cinder-volume[72202]: return self.wait(wait, returns_tuple=returns_tuple) Apr 22 17:48:21 devstack cinder-volume[72202]: File "/opt/stack/data/venv/lib/python3.10/site-packages/amqp/abstract_channel.py", line 99, in wait Apr 22 17:48:21 devstack cinder-volume[72202]: self.connection.drain_events(timeout=timeout) Apr 22 17:48:21 devstack cinder-volume[72202]: File "/opt/stack/data/venv/lib/python3.10/site-packages/amqp/connection.py", line 526, in drain_events Apr 22 17:48:21 devstack cinder-volume[72202]: while not self.blocking_read(timeout): Apr 22 17:48:21 devstack cinder-volume[72202]: File "/opt/stack/data/venv/lib/python3.10/site-packages/amqp/connection.py", line 532, in blocking_read Apr 22 17:48:21 devstack cinder-volume[72202]: return self.on_inbound_frame(frame) Apr 22 17:48:21 devstack cinder-volume[72202]: File "/opt/stack/data/venv/lib/python3.10/site-packages/amqp/method_framing.py", line 53, in on_frame Apr 22 17:48:21 devstack cinder-volume[72202]: callback(channel, method_sig, buf, None) Apr 22 17:48:21 devstack cinder-volume[72202]: File "/opt/stack/data/venv/lib/python3.10/site-packages/amqp/connection.py", line 538, in on_inbound_method Apr 22 17:48:21 devstack cinder-volume[72202]: return self.channels[channel_id].dispatch_method( Apr 22 17:48:21 devstack cinder-volume[72202]: File "/opt/stack/data/venv/lib/python3.10/site-packages/amqp/abstract_channel.py", line 118, in dispatch_method Apr 22 17:48:21 devstack cinder-volume[72202]: AMQP_LOGGER.warning( Apr 22 17:48:21 devstack cinder-volume[72202]: Message: 'Received method %s during closing channel %s. This method will be ignored' Apr 22 17:48:21 devstack cinder-volume[72202]: Arguments: ((50, 41), 1) Apr 22 17:48:21 devstack cinder-volume[81237]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 22 17:48:21 devstack cinder-volume[81237]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 22 17:48:21 devstack cinder-volume[81237]: we strongly recommend against using it for new projects. Apr 22 17:48:21 devstack cinder-volume[81237]: If you are already using Eventlet, we recommend migrating to a different Apr 22 17:48:21 devstack cinder-volume[81237]: framework. For more detail see Apr 22 17:48:21 devstack cinder-volume[81237]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 22 17:48:21 devstack cinder-volume[81237]: import eventlet # noqa Apr 22 17:48:23 devstack cinder-volume[81237]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=81237) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 22 17:48:23 devstack cinder-volume[81237]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=81237) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 22 17:48:23 devstack cinder-volume[81237]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=81237) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 22 17:48:23 devstack cinder-volume[81237]: INFO dbcounter [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] Registered counter for database cinder Apr 22 17:48:23 devstack cinder-volume[81237]: DEBUG oslo_db.sqlalchemy.engines [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81237) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG dbcounter [-] [81237] Writer thread running {{(pid=81237) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 22 17:48:24 devstack cinder-volume[81237]: INFO cinder.rpc [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 22 17:48:24 devstack cinder-volume[81237]: INFO cinder.rpc [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_db.sqlalchemy.engines [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81237) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 22 17:48:24 devstack cinder-volume[81237]: INFO cinder.volume.manager [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] Determined volume DB was empty at startup. Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG cinder.volume.manager [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=81237) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 22 17:48:24 devstack cinder-volume[81237]: INFO cinder.volume.manager [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 22 17:48:24 devstack cinder-volume[81237]: WARNING stevedore.named [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 22 17:48:24 devstack cinder-volume[81237]: WARNING castellan.key_manager [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 22 17:48:24 devstack cinder-volume[81237]: WARNING cinder.keymgr.conf_key_mgr [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 22 17:48:24 devstack cinder-volume[81237]: INFO cinder.volume.manager [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_db.sqlalchemy.engines [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81237) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 22 17:48:24 devstack cinder-volume[81237]: INFO oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] Starting 1 workers Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] Started child 81360 {{(pid=81237) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] Full set of CONF: {{(pid=81237) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] ******************************************************************************** {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] Configuration options gathered from: {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] ================================================================================ {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] allow_availability_zone_fallback = False {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] allow_compression_on_image_upload = False {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] allowed_direct_url_schemes = [] {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] api_rate_limit = True {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] auth_strategy = keystone {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] backend_availability_zone = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] backend_host = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] backend_name = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] backend_stats_polling_interval = 60 {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] backup_api_class = cinder.backup.api.API {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] backup_name_template = backup-%s {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] backup_use_same_host = False {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] backup_use_temp_snapshot = False {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] chap_password = **** {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] chap_username = {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] cinder_internal_tenant_project_id = f7d29c702ca4460ab6791879d3e5428d {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] cinder_internal_tenant_user_id = 0cc6b5cb6dbd43749b11e89aeacbca73 {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] cluster = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] compression_format = gzip {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] compute_api_class = cinder.compute.nova.API {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] config_dir = [] {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] config_source = [] {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] control_exchange = openstack {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] debug = True {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] default_availability_zone = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] default_group_type = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] default_volume_type = QuobyteHD {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] disk_geometry = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] driver_client_cert = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] driver_client_cert_key = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] driver_data_namespace = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] driver_ssl_cert_path = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] driver_ssl_cert_verify = False {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] driver_use_ssl = False {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] enable_new_services = True {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81360]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] enable_unsupported_driver = False {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] enabled_backends = ['QuobyteHD'] {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] enforce_multipath_for_image_xfer = False {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] filter_function = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] glance_api_insecure = False {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] glance_api_servers = ['http://192.168.122.31/image'] {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] glance_api_ssl_compression = False {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] glance_ca_certificates_file = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] glance_catalog_info = image:glance:publicURL {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] glance_certfile = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] glance_keyfile = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] glance_num_retries = 3 {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] glance_request_timeout = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] goodness_function = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] graceful_shutdown_timeout = 5 {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] group_api_class = cinder.group.api.API {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] host = devstack {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] image_compress_on_upload = True {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] image_conversion_address_space_limit = 1 {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] image_conversion_cpu_limit = 60 {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] image_conversion_disable = False {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] image_upload_use_cinder_backend = False {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] image_upload_use_internal_tenant = False {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] image_volume_cache_enabled = False {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] image_volume_cache_max_count = 0 {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] image_volume_cache_max_size_gb = 0 {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] init_host_max_objects_retrieval = 0 {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] instance_format = [instance: %(uuid)s] {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] iscsi_target_flags = {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] iscsi_write_cache = on {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] iser_helper = tgtadm {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] iser_ip_address = 192.168.122.31 {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] iser_port = 3260 {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] log_color = False {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] log_config_append = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] log_dir = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] log_file = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] log_options = True {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] log_rotate_interval = 1 {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] log_rotate_interval_type = days {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] log_rotation_type = none {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] max_age = 0 {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] max_logfile_count = 30 {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] max_logfile_size_mb = 200 {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] max_over_subscription_ratio = 20.0 {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] message_reap_interval = 86400 {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] message_ttl = 2592000 {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] migration_create_volume_timeout_secs = 300 {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] monkey_patch = False {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] monkey_patch_modules = [] {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] my_ip = 192.168.122.31 {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] no_snapshot_gb_quota = False {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] num_iser_scan_tries = 3 {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] num_shell_tries = 3 {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] num_volume_device_scan_tries = 3 {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] nvmeof_conn_info_version = 1 {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] nvmet_ns_id = 10 {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] nvmet_port_id = 1 {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] osapi_max_limit = 1000 {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] osapi_volume_ext_list = [] {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] osapi_volume_listen = 0.0.0.0 {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] osapi_volume_listen_port = 8776 {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] osapi_volume_use_ssl = False {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] osapi_volume_workers = 2 {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] per_volume_size_limit = -1 {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] periodic_fuzzy_delay = 60 {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] periodic_interval = 60 {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] project_id_regex = [0-9a-f\-]+ {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] public_endpoint = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] publish_errors = False {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] quota_backup_gigabytes = 1000 {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] quota_backups = 10 {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] quota_gigabytes = 1000 {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] quota_groups = 10 {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] quota_snapshots = 10 {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] quota_volumes = 10 {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] rate_limit_burst = 0 {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] rate_limit_except_level = CRITICAL {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] rate_limit_interval = 0 {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] reinit_driver_count = 3 {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] replication_device = **** {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] report_discard_supported = False {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] report_interval = 120 {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] reservation_clean_interval = 86400 {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] reservation_expire = 86400 {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] reserved_image_namespaces = [] {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] reserved_percentage = 0 {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] rpc_response_timeout = 120 {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] run_external_periodic_tasks = True {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] scst_target_driver = iscsi {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] scst_target_iqn_name = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] service_down_time = 720 {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] shell_completion = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] snapshot_name_template = snapshot-%s {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] split_loggers = False {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] state_path = /opt/stack/data/cinder {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] storage_availability_zone = nova {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] storage_protocol = iSCSI {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] syslog_log_facility = LOG_USER {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] target_helper = lioadm {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] target_ip_address = 192.168.122.31 {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] target_port = 3260 {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] target_protocol = iscsi {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] target_secondary_ip_addresses = [] {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] trace_flags = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] transfer_api_class = cinder.transfer.api.API {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] transport_url = **** {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] until_refresh = 0 {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] use_chap_auth = False {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] use_default_quota_class = True {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] use_journal = False {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] use_json = False {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] use_multipath_for_image_xfer = False {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] use_stderr = False {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] use_syslog = False {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] verify_glance_signatures = enabled {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] volume_api_class = cinder.volume.api.API {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] volume_backend_name = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] volume_clear = zero {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] volume_clear_ionice = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] volume_clear_size = 0 {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] volume_copy_bps_limit = 0 {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] volume_dd_blocksize = 1M {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] volume_name_template = volume-%s {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] volume_service_inithost_offload = False {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] volume_usage_audit_period = month {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] zoning_mode = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] oslo_concurrency.disable_process_locking = False {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] keystone_authtoken.admin_password = **** {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] keystone_authtoken.admin_token = **** {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] keystone_authtoken.admin_user = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] keystone_authtoken.auth_admin_prefix = {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] keystone_authtoken.auth_port = 35357 {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] keystone_authtoken.auth_protocol = https {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] keystone_authtoken.auth_section = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] keystone_authtoken.auth_type = password {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] keystone_authtoken.auth_uri = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] keystone_authtoken.auth_version = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] keystone_authtoken.cache = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] keystone_authtoken.certfile = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] keystone_authtoken.delay_auth_decision = False {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] keystone_authtoken.http_connect_timeout = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] keystone_authtoken.identity_uri = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] keystone_authtoken.include_service_catalog = True {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] keystone_authtoken.insecure = False {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] keystone_authtoken.interface = public {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] keystone_authtoken.keyfile = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] keystone_authtoken.memcache_password = {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] keystone_authtoken.memcache_username = {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] keystone_authtoken.region_name = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] keystone_authtoken.service_token_roles_required = False {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] keystone_authtoken.service_type = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] keystone_authtoken.token_cache_time = 300 {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.31/identity {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] cache.backend = dogpile.cache.null {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] cache.backend_argument = **** {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] cache.backend_expiration_time = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] cache.config_prefix = cache.oslo {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] cache.debug_cache_backend = False {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] cache.enable_retry_client = False {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] cache.enable_socket_keepalive = False {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] cache.enabled = False {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] cache.enforce_fips_mode = False {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] cache.expiration_time = 600 {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] cache.hashclient_retry_attempts = 2 {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] cache.memcache_dead_retry = 300 {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] cache.memcache_pool_maxsize = 10 {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] cache.memcache_sasl_enabled = False {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] cache.password = **** {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] cache.proxies = [] {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] cache.redis_db = 0 {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] cache.redis_sentinel_service_name = mymaster {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] cache.redis_server = localhost:6379 {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] cache.retry_attempts = 2 {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] cache.retry_delay = 0.0 {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] cache.socket_keepalive_count = 1 {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] cache.socket_keepalive_idle = 1 {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] cache.socket_keepalive_interval = 1 {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] cache.socket_timeout = 1.0 {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] cache.tls_allowed_ciphers = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] cache.tls_cafile = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] cache.tls_certfile = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] cache.tls_enabled = False {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] cache.tls_keyfile = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] cache.username = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] coordination.backend_url = **** {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] database.asyncio_connection = **** {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] database.asyncio_slave_connection = **** {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] database.backend = sqlalchemy {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] database.connection = **** {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] database.connection_debug = 0 {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] database.connection_parameters = {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] database.connection_recycle_time = 3600 {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] database.connection_trace = False {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] database.db_inc_retry_interval = True {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] database.db_max_retries = 20 {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] database.db_max_retry_interval = 10 {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] database.db_retry_interval = 1 {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] database.max_overflow = 50 {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] database.max_pool_size = 5 {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] database.max_retries = 10 {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] database.mysql_wsrep_sync_wait = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] database.pool_timeout = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] database.retry_interval = 10 {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] database.slave_connection = **** {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] database.sqlite_synchronous = True {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] database.synchronous_reader = True {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] database.use_db_reconnect = False {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] profiler.connection_string = messaging:// {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] profiler.enabled = False {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] profiler.es_doc_type = notification {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] profiler.es_scroll_size = 10000 {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] profiler.es_scroll_time = 2m {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] profiler.filter_error_trace = False {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] profiler.hmac_keys = **** {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] profiler.sentinel_service_name = mymaster {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] profiler.socket_timeout = 0.1 {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] profiler.trace_requests = False {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] profiler.trace_sqlalchemy = False {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] profiler_jaeger.process_tags = {} {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] profiler_jaeger.service_name_prefix = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] profiler_otlp.service_name_prefix = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] oslo_policy.enforce_new_defaults = False {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: WARNING oslo_config.cfg [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] oslo_policy.enforce_scope = False {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] oslo_policy.policy_default_rule = default {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] oslo_policy.policy_file = policy.yaml {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] oslo_policy.remote_timeout = 60.0 {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] privsep_osbrick.group = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] privsep_osbrick.helper_command = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] privsep_osbrick.user = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] cinder_sys_admin.group = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] cinder_sys_admin.helper_command = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] cinder_sys_admin.user = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] service_user.auth_section = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] service_user.auth_type = password {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] service_user.cafile = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] service_user.certfile = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] service_user.collect_timing = False {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] service_user.insecure = False {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] service_user.keyfile = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] service_user.send_service_user_token = True {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] service_user.split_loggers = False {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] service_user.timeout = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] glance.auth_section = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] glance.auth_type = password {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] glance.certfile = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] glance.collect_timing = False {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] glance.insecure = False {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] glance.keyfile = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] glance.region_name = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] glance.split_loggers = False {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] glance.timeout = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] backend_defaults.backend_availability_zone = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] backend_defaults.chap_password = **** {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] backend_defaults.chap_username = {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] backend_defaults.disk_geometry = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] backend_defaults.driver_client_cert = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] backend_defaults.driver_client_cert_key = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] backend_defaults.driver_data_namespace = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] backend_defaults.driver_use_ssl = False {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] backend_defaults.enable_unsupported_driver = False {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] backend_defaults.extra_capabilities = {} {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] backend_defaults.filter_function = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] backend_defaults.goodness_function = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] backend_defaults.iscsi_target_flags = {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] backend_defaults.iscsi_write_cache = on {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] backend_defaults.iser_helper = tgtadm {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] backend_defaults.iser_ip_address = 192.168.122.31 {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] backend_defaults.iser_port = 3260 {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] backend_defaults.nas_host = {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] backend_defaults.nas_login = admin {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] backend_defaults.nas_mount_options = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] backend_defaults.nas_password = **** {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] backend_defaults.nas_private_key = {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] backend_defaults.nas_share_path = {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] backend_defaults.nas_ssh_port = 22 {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] backend_defaults.num_shell_tries = 3 {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] backend_defaults.nvmet_port_id = 1 {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] backend_defaults.quobyte_client_cfg = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] backend_defaults.quobyte_volume_url = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] backend_defaults.replication_device = **** {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] backend_defaults.report_discard_supported = False {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] backend_defaults.reserved_percentage = 0 {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] backend_defaults.scst_target_driver = iscsi {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] backend_defaults.scst_target_iqn_name = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] backend_defaults.storage_protocol = iSCSI {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] backend_defaults.target_helper = tgtadm {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] backend_defaults.target_ip_address = 192.168.122.31 {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] backend_defaults.target_port = 3260 {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] backend_defaults.target_protocol = iscsi {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] backend_defaults.trace_flags = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] backend_defaults.unique_fqdn_network = True {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] backend_defaults.use_chap_auth = False {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] backend_defaults.volume_backend_name = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] backend_defaults.volume_clear = zero {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] backend_defaults.volume_clear_ionice = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] backend_defaults.volume_clear_size = 0 {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81360]: INFO cinder.volume.manager [None req-a5d8620e-24eb-4fc2-8840-659b5a9239b6 None None] Starting volume driver QuobyteDriver (1.1.14) Apr 22 17:48:24 devstack cinder-volume[81360]: DEBUG cinder.volume.drivers.remotefs [None req-a5d8620e-24eb-4fc2-8840-659b5a9239b6 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=81360) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] oslo_reports.file_event_handler = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] oslo_reports.log_dir = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] QuobyteHD.backend_availability_zone = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] QuobyteHD.backend_host = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] QuobyteHD.chap_password = **** {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] QuobyteHD.chap_username = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] QuobyteHD.chiscsi_conf = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] QuobyteHD.disk_geometry = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] QuobyteHD.driver_client_cert = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] QuobyteHD.driver_client_cert_key = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] QuobyteHD.driver_data_namespace = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] QuobyteHD.driver_use_ssl = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] QuobyteHD.extra_capabilities = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] QuobyteHD.filter_function = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] QuobyteHD.goodness_function = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] QuobyteHD.iscsi_target_flags = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] QuobyteHD.iscsi_write_cache = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] QuobyteHD.iser_helper = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] QuobyteHD.iser_ip_address = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] QuobyteHD.iser_port = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] QuobyteHD.iser_target_prefix = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] QuobyteHD.nas_host = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] QuobyteHD.nas_login = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] QuobyteHD.nas_mount_options = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] QuobyteHD.nas_password = **** {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] QuobyteHD.nas_private_key = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] QuobyteHD.nas_share_path = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] QuobyteHD.nas_ssh_port = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] QuobyteHD.num_shell_tries = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] QuobyteHD.nvmet_ns_id = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] QuobyteHD.nvmet_port_id = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] QuobyteHD.replication_device = **** {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] QuobyteHD.report_discard_supported = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] QuobyteHD.reserved_percentage = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] QuobyteHD.scst_target_driver = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] QuobyteHD.storage_protocol = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] QuobyteHD.target_helper = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] QuobyteHD.target_ip_address = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] QuobyteHD.target_port = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] QuobyteHD.target_prefix = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] QuobyteHD.target_protocol = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] QuobyteHD.trace_flags = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] QuobyteHD.unique_fqdn_network = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] QuobyteHD.use_chap_auth = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] QuobyteHD.volume_clear = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] QuobyteHD.volume_clear_ionice = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] QuobyteHD.volume_clear_size = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] QuobyteHD.volumes_dir = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81360]: DEBUG cinder.volume.drivers.quobyte [None req-a5d8620e-24eb-4fc2-8840-659b5a9239b6 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=81360) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 22 17:48:24 devstack cinder-volume[81360]: WARNING cinder.volume.drivers.quobyte [None req-a5d8620e-24eb-4fc2-8840-659b5a9239b6 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 22 17:48:24 devstack cinder-volume[81360]: WARNING cinder.volume.drivers.quobyte [None req-a5d8620e-24eb-4fc2-8840-659b5a9239b6 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 22 17:48:24 devstack cinder-volume[81360]: DEBUG oslo_concurrency.processutils [None req-a5d8620e-24eb-4fc2-8840-659b5a9239b6 None None] Running cmd (subprocess): mount.quobyte {{(pid=81360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] oslo_messaging_rabbit.ssl = False {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] oslo_messaging_rabbit.ssl_version = {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] oslo_messaging_notifications.driver = [] {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] oslo_messaging_notifications.retry = -1 {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] oslo_messaging_notifications.transport_url = **** {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] key_manager.fixed_key = **** {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] barbican.barbican_api_version = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] barbican.barbican_endpoint = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] barbican.barbican_endpoint_type = public {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] barbican.barbican_region_name = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] barbican.cafile = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] barbican.certfile = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] barbican.collect_timing = False {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] barbican.insecure = False {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] barbican.keyfile = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] barbican.number_of_retries = 60 {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] barbican.retry_delay = 1 {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] barbican.send_service_user_token = False {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] barbican.split_loggers = False {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] barbican.timeout = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] barbican.verify_ssl = True {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] barbican.verify_ssl_path = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] barbican_service_user.auth_section = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] barbican_service_user.auth_type = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] barbican_service_user.cafile = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] barbican_service_user.certfile = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] barbican_service_user.collect_timing = False {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] barbican_service_user.insecure = False {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] barbican_service_user.keyfile = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] barbican_service_user.split_loggers = False {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] barbican_service_user.timeout = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] vault.approle_role_id = **** {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] vault.approle_secret_id = **** {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] vault.kv_mountpoint = secret {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] vault.kv_path = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] vault.kv_version = 2 {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] vault.namespace = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] vault.root_token_id = **** {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] vault.ssl_ca_crt_file = None {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] vault.timeout = 60.0 {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] vault.use_ssl = False {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:24 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] ******************************************************************************** {{(pid=81237) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 22 17:48:24 devstack quobyte-client[81361]: Reading configuration file: /etc/quobyte/client.cfg Apr 22 17:48:24 devstack quobyte-client[81361]: Invalid parameters found, error: missing mount point. Apr 22 17:48:24 devstack quobyte-client[81361]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Apr 22 17:48:24 devstack quobyte-client[81361]: Failed to parse all commandline parameters, please use -h/--help to see available options. Apr 22 17:48:24 devstack cinder-volume[81360]: DEBUG oslo_concurrency.processutils [None req-a5d8620e-24eb-4fc2-8840-659b5a9239b6 None None] CMD "mount.quobyte" returned: 1 in 0.084s {{(pid=81360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:48:24 devstack cinder-volume[81360]: DEBUG oslo_concurrency.lockutils [None req-a5d8620e-24eb-4fc2-8840-659b5a9239b6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:48:24 devstack cinder-volume[81360]: DEBUG oslo_concurrency.lockutils [None req-a5d8620e-24eb-4fc2-8840-659b5a9239b6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:48:24 devstack cinder-volume[81360]: DEBUG cinder.volume.drivers.quobyte [None req-a5d8620e-24eb-4fc2-8840-659b5a9239b6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:48:24 devstack cinder-volume[81360]: INFO cinder.volume.drivers.quobyte [None req-a5d8620e-24eb-4fc2-8840-659b5a9239b6 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 ... Apr 22 17:48:24 devstack cinder-volume[81360]: DEBUG oslo_concurrency.processutils [None req-a5d8620e-24eb-4fc2-8840-659b5a9239b6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 -c /etc/quobyte/client-cinder.cfg {{(pid=81360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:48:24 devstack sudo[81362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 -c /etc/quobyte/client-cinder.cfg Apr 22 17:48:24 devstack sudo[81362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:48:25 devstack sudo[81362]: pam_unix(sudo:session): session closed for user root Apr 22 17:48:25 devstack cinder-volume[81360]: DEBUG oslo_concurrency.processutils [None req-a5d8620e-24eb-4fc2-8840-659b5a9239b6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.534s {{(pid=81360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:48:25 devstack cinder-volume[81360]: INFO cinder.volume.drivers.quobyte [None req-a5d8620e-24eb-4fc2-8840-659b5a9239b6 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 succeeded Apr 22 17:48:25 devstack cinder-volume[81360]: DEBUG cinder.volume.drivers.quobyte [None req-a5d8620e-24eb-4fc2-8840-659b5a9239b6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:48:25 devstack cinder-volume[81360]: DEBUG oslo_concurrency.lockutils [None req-a5d8620e-24eb-4fc2-8840-659b5a9239b6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.543s {{(pid=81360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:48:25 devstack cinder-volume[81360]: DEBUG oslo_concurrency.processutils [None req-a5d8620e-24eb-4fc2-8840-659b5a9239b6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 {{(pid=81360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:48:25 devstack sudo[81431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 Apr 22 17:48:25 devstack sudo[81431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:48:25 devstack sudo[81431]: pam_unix(sudo:session): session closed for user root Apr 22 17:48:25 devstack cinder-volume[81360]: DEBUG oslo_concurrency.processutils [None req-a5d8620e-24eb-4fc2-8840-659b5a9239b6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33" returned: 0 in 0.417s {{(pid=81360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:48:25 devstack cinder-volume[81360]: INFO cinder.volume.driver [None req-a5d8620e-24eb-4fc2-8840-659b5a9239b6 None None] Driver hasn't implemented _init_vendor_properties() Apr 22 17:48:25 devstack cinder-volume[81360]: DEBUG cinder.volume.driver [None req-a5d8620e-24eb-4fc2-8840-659b5a9239b6 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6793174743652, 'free_capacity_gb': 1775.6793174743652, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=81360) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 22 17:48:25 devstack cinder-volume[81360]: DEBUG oslo_db.sqlalchemy.engines [None req-a5d8620e-24eb-4fc2-8840-659b5a9239b6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81360) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 22 17:48:25 devstack cinder-volume[81360]: DEBUG dbcounter [-] [81360] Writer thread running {{(pid=81360) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 22 17:48:25 devstack cinder-volume[81360]: DEBUG cinder.db.sqlalchemy.api [None req-a5d8620e-24eb-4fc2-8840-659b5a9239b6 None None] Building query based on filter {{(pid=81360) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 22 17:48:25 devstack cinder-volume[81360]: DEBUG cinder.image.image_utils [None req-a5d8620e-24eb-4fc2-8840-659b5a9239b6 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=81360) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 22 17:48:25 devstack cinder-volume[81360]: INFO cinder.keymgr.migration [None req-1f2e9aa4-4a2c-4e3d-a204-7dd4a96663f8 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 22 17:48:25 devstack cinder-volume[81360]: DEBUG oslo_concurrency.lockutils [None req-a5d8620e-24eb-4fc2-8840-659b5a9239b6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:48:25 devstack cinder-volume[81360]: DEBUG oslo_concurrency.lockutils [None req-a5d8620e-24eb-4fc2-8840-659b5a9239b6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:48:25 devstack cinder-volume[81360]: DEBUG cinder.volume.drivers.quobyte [None req-a5d8620e-24eb-4fc2-8840-659b5a9239b6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:48:25 devstack cinder-volume[81360]: DEBUG cinder.volume.drivers.quobyte [None req-a5d8620e-24eb-4fc2-8840-659b5a9239b6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:48:25 devstack cinder-volume[81360]: DEBUG oslo_concurrency.lockutils [None req-a5d8620e-24eb-4fc2-8840-659b5a9239b6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:48:25 devstack cinder-volume[81360]: DEBUG oslo_concurrency.processutils [None req-a5d8620e-24eb-4fc2-8840-659b5a9239b6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 {{(pid=81360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:48:25 devstack sudo[81434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 Apr 22 17:48:25 devstack sudo[81434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:48:25 devstack sudo[81434]: pam_unix(sudo:session): session closed for user root Apr 22 17:48:25 devstack cinder-volume[81360]: DEBUG oslo_concurrency.processutils [None req-a5d8620e-24eb-4fc2-8840-659b5a9239b6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33" returned: 0 in 0.413s {{(pid=81360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:48:25 devstack cinder-volume[81360]: DEBUG cinder.manager [None req-a5d8620e-24eb-4fc2-8840-659b5a9239b6 None None] Notifying Schedulers of capabilities ... {{(pid=81360) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 17:48:26 devstack cinder-volume[81360]: INFO cinder.volume.manager [None req-a5d8620e-24eb-4fc2-8840-659b5a9239b6 None None] Driver initialization completed successfully. Apr 22 17:48:26 devstack cinder-volume[81360]: INFO cinder.manager [None req-a5d8620e-24eb-4fc2-8840-659b5a9239b6 None None] Initiating service 3 cleanup Apr 22 17:48:26 devstack cinder-volume[81360]: INFO cinder.manager [None req-a5d8620e-24eb-4fc2-8840-659b5a9239b6 None None] Service 3 cleanup completed. Apr 22 17:48:26 devstack cinder-volume[81360]: DEBUG cinder.service [None req-a5d8620e-24eb-4fc2-8840-659b5a9239b6 None None] Creating RPC server for service cinder-volume {{(pid=81360) start /opt/stack/cinder/cinder/service.py:231}} Apr 22 17:48:26 devstack cinder-volume[81360]: DEBUG cinder.service [None req-a5d8620e-24eb-4fc2-8840-659b5a9239b6 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=81360) start /opt/stack/cinder/cinder/service.py:237}} Apr 22 17:48:26 devstack cinder-volume[81360]: INFO cinder.volume.manager [None req-a5d8620e-24eb-4fc2-8840-659b5a9239b6 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 22 17:48:26 devstack cinder-volume[81360]: DEBUG oslo_concurrency.lockutils [None req-a5d8620e-24eb-4fc2-8840-659b5a9239b6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:48:26 devstack cinder-volume[81360]: DEBUG oslo_concurrency.lockutils [None req-a5d8620e-24eb-4fc2-8840-659b5a9239b6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:48:26 devstack cinder-volume[81360]: DEBUG cinder.volume.drivers.quobyte [None req-a5d8620e-24eb-4fc2-8840-659b5a9239b6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:48:26 devstack cinder-volume[81360]: DEBUG cinder.volume.drivers.quobyte [None req-a5d8620e-24eb-4fc2-8840-659b5a9239b6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:48:26 devstack cinder-volume[81360]: DEBUG oslo_concurrency.lockutils [None req-a5d8620e-24eb-4fc2-8840-659b5a9239b6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:48:26 devstack cinder-volume[81360]: DEBUG oslo_concurrency.processutils [None req-a5d8620e-24eb-4fc2-8840-659b5a9239b6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 {{(pid=81360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:48:26 devstack sudo[81439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 Apr 22 17:48:26 devstack sudo[81439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:48:26 devstack sudo[81439]: pam_unix(sudo:session): session closed for user root Apr 22 17:48:26 devstack cinder-volume[81360]: DEBUG oslo_concurrency.processutils [None req-a5d8620e-24eb-4fc2-8840-659b5a9239b6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33" returned: 0 in 0.476s {{(pid=81360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:48:26 devstack cinder-volume[81360]: INFO cinder.volume.manager [None req-a5d8620e-24eb-4fc2-8840-659b5a9239b6 None None] Driver post RPC initialization completed successfully. Apr 22 17:48:29 devstack cinder-volume[81360]: DEBUG oslo_concurrency.lockutils [None req-12c24152-e0e8-484f-879b-84975f4baa9d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:48:29 devstack cinder-volume[81360]: DEBUG oslo_concurrency.lockutils [None req-12c24152-e0e8-484f-879b-84975f4baa9d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:48:29 devstack cinder-volume[81360]: DEBUG cinder.volume.drivers.quobyte [None req-12c24152-e0e8-484f-879b-84975f4baa9d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:48:29 devstack cinder-volume[81360]: DEBUG cinder.volume.drivers.quobyte [None req-12c24152-e0e8-484f-879b-84975f4baa9d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:48:29 devstack cinder-volume[81360]: DEBUG oslo_concurrency.lockutils [None req-12c24152-e0e8-484f-879b-84975f4baa9d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:48:29 devstack cinder-volume[81360]: DEBUG oslo_concurrency.processutils [None req-12c24152-e0e8-484f-879b-84975f4baa9d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 {{(pid=81360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:48:29 devstack sudo[81512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 Apr 22 17:48:29 devstack sudo[81512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:48:30 devstack sudo[81512]: pam_unix(sudo:session): session closed for user root Apr 22 17:48:30 devstack cinder-volume[81360]: DEBUG oslo_concurrency.processutils [None req-12c24152-e0e8-484f-879b-84975f4baa9d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33" returned: 0 in 0.407s {{(pid=81360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:48:30 devstack cinder-volume[81360]: DEBUG cinder.manager [None req-12c24152-e0e8-484f-879b-84975f4baa9d None None] Notifying Schedulers of capabilities ... {{(pid=81360) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 17:48:33 devstack cinder-volume[81237]: INFO oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] Caught SIGTERM, stopping children Apr 22 17:48:33 devstack cinder-volume[81237]: DEBUG oslo_concurrency.lockutils [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] Acquiring lock "singleton_lock" {{(pid=81237) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 22 17:48:33 devstack cinder-volume[81237]: DEBUG oslo_concurrency.lockutils [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] Acquired lock "singleton_lock" {{(pid=81237) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 22 17:48:33 devstack cinder-volume[81237]: DEBUG oslo_concurrency.lockutils [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] Releasing lock "singleton_lock" {{(pid=81237) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 22 17:48:33 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] Stop services. {{(pid=81237) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 22 17:48:33 devstack cinder-volume[81237]: DEBUG oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] Killing children. {{(pid=81237) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 22 17:48:33 devstack cinder-volume[81237]: INFO oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] Waiting on 1 children to exit Apr 22 17:48:34 devstack cinder-volume[81360]: DEBUG oslo_concurrency.lockutils [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] Acquiring lock "singleton_lock" {{(pid=81360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 22 17:48:34 devstack cinder-volume[81360]: DEBUG oslo_concurrency.lockutils [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] Acquired lock "singleton_lock" {{(pid=81360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 22 17:48:34 devstack cinder-volume[81360]: DEBUG oslo_concurrency.lockutils [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] Releasing lock "singleton_lock" {{(pid=81360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 22 17:48:34 devstack cinder-volume[81360]: WARNING amqp [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 22 17:48:34 devstack cinder-volume[81360]: WARNING amqp [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 22 17:48:34 devstack cinder-volume[81237]: INFO oslo_service.backend._eventlet.service [None req-e31feb86-0908-498b-b5bb-c97f8eb55171 None None] Child 81360 exited with status 0 Apr 22 17:48:34 devstack cinder-volume[81581]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 22 17:48:34 devstack cinder-volume[81581]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 22 17:48:34 devstack cinder-volume[81581]: we strongly recommend against using it for new projects. Apr 22 17:48:34 devstack cinder-volume[81581]: If you are already using Eventlet, we recommend migrating to a different Apr 22 17:48:34 devstack cinder-volume[81581]: framework. For more detail see Apr 22 17:48:34 devstack cinder-volume[81581]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 22 17:48:34 devstack cinder-volume[81581]: import eventlet # noqa Apr 22 17:48:36 devstack cinder-volume[81581]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=81581) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 22 17:48:36 devstack cinder-volume[81581]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=81581) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 22 17:48:36 devstack cinder-volume[81581]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=81581) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 22 17:48:37 devstack cinder-volume[81581]: INFO dbcounter [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] Registered counter for database cinder Apr 22 17:48:37 devstack cinder-volume[81581]: DEBUG oslo_db.sqlalchemy.engines [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81581) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG dbcounter [-] [81581] Writer thread running {{(pid=81581) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 22 17:48:38 devstack cinder-volume[81581]: INFO cinder.rpc [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 22 17:48:38 devstack cinder-volume[81581]: INFO cinder.rpc [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_db.sqlalchemy.engines [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81581) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 22 17:48:38 devstack cinder-volume[81581]: INFO cinder.volume.manager [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] Determined volume DB was empty at startup. Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG cinder.volume.manager [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] Cinder Volume DB check: vol_db_empty=True {{(pid=81581) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 22 17:48:38 devstack cinder-volume[81581]: WARNING stevedore.named [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 22 17:48:38 devstack cinder-volume[81581]: WARNING castellan.key_manager [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 22 17:48:38 devstack cinder-volume[81581]: WARNING cinder.keymgr.conf_key_mgr [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 22 17:48:38 devstack cinder-volume[81581]: INFO cinder.volume.manager [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_db.sqlalchemy.engines [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81581) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 22 17:48:38 devstack cinder-volume[81581]: INFO oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] Starting 1 workers Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] Started child 81771 {{(pid=81581) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] Full set of CONF: {{(pid=81581) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] ******************************************************************************** {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] Configuration options gathered from: {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] ================================================================================ {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] allow_availability_zone_fallback = False {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] allow_compression_on_image_upload = False {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] allowed_direct_url_schemes = [] {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] api_rate_limit = True {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] auth_strategy = keystone {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] backend_availability_zone = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] backend_host = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] backend_name = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] backend_stats_polling_interval = 60 {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] backup_api_class = cinder.backup.api.API {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] backup_name_template = backup-%s {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] backup_use_same_host = False {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] backup_use_temp_snapshot = False {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] chap_password = **** {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] chap_username = {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] cinder_internal_tenant_project_id = f7d29c702ca4460ab6791879d3e5428d {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] cinder_internal_tenant_user_id = 0cc6b5cb6dbd43749b11e89aeacbca73 {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] cluster = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] compression_format = gzip {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] compute_api_class = cinder.compute.nova.API {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] config_dir = [] {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] config_source = [] {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] control_exchange = openstack {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] debug = True {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] default_availability_zone = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] default_group_type = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] default_volume_type = QuobyteHD {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] disk_geometry = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] driver_client_cert = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] driver_client_cert_key = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] driver_data_namespace = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81771]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] driver_ssl_cert_path = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] driver_ssl_cert_verify = False {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] driver_use_ssl = False {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] enable_new_services = True {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] enable_unsupported_driver = False {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] enabled_backends = ['QuobyteHD'] {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] enforce_multipath_for_image_xfer = False {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] filter_function = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] glance_api_insecure = False {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] glance_api_servers = ['http://192.168.122.31/image'] {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] glance_api_ssl_compression = False {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] glance_ca_certificates_file = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] glance_catalog_info = image:glance:publicURL {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] glance_certfile = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] glance_keyfile = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] glance_num_retries = 3 {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] glance_request_timeout = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] goodness_function = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] graceful_shutdown_timeout = 5 {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] group_api_class = cinder.group.api.API {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] host = devstack {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] image_compress_on_upload = True {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] image_conversion_address_space_limit = 1 {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] image_conversion_cpu_limit = 60 {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] image_conversion_disable = False {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] image_upload_use_cinder_backend = False {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] image_upload_use_internal_tenant = False {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] image_volume_cache_enabled = False {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] image_volume_cache_max_count = 0 {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] image_volume_cache_max_size_gb = 0 {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] init_host_max_objects_retrieval = 0 {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] instance_format = [instance: %(uuid)s] {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] iscsi_target_flags = {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] iscsi_write_cache = on {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] iser_helper = tgtadm {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] iser_ip_address = 192.168.122.31 {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] iser_port = 3260 {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] log_color = False {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] log_config_append = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] log_dir = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] log_file = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] log_options = True {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] log_rotate_interval = 1 {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] log_rotate_interval_type = days {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] log_rotation_type = none {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] max_age = 0 {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] max_logfile_count = 30 {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] max_logfile_size_mb = 200 {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] max_over_subscription_ratio = 20.0 {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] message_reap_interval = 86400 {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] message_ttl = 2592000 {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] migration_create_volume_timeout_secs = 300 {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] monkey_patch = False {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] monkey_patch_modules = [] {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] my_ip = 192.168.122.31 {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] no_snapshot_gb_quota = False {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] num_iser_scan_tries = 3 {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] num_shell_tries = 3 {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] num_volume_device_scan_tries = 3 {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] nvmeof_conn_info_version = 1 {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] nvmet_ns_id = 10 {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] nvmet_port_id = 1 {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] osapi_max_limit = 1000 {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] osapi_volume_ext_list = [] {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] osapi_volume_listen = 0.0.0.0 {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] osapi_volume_listen_port = 8776 {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] osapi_volume_use_ssl = False {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] osapi_volume_workers = 2 {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] per_volume_size_limit = -1 {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] periodic_fuzzy_delay = 60 {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] periodic_interval = 60 {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] project_id_regex = [0-9a-f\-]+ {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] public_endpoint = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] publish_errors = False {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] quota_backup_gigabytes = 1000 {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] quota_backups = 10 {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-13d59d82-bebe-4caa-9ea0-d86b6d43bb03 None None] Starting volume driver QuobyteDriver (1.1.14) Apr 22 17:48:38 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-13d59d82-bebe-4caa-9ea0-d86b6d43bb03 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=81771) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] quota_gigabytes = 1000 {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] quota_groups = 10 {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] quota_snapshots = 10 {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] quota_volumes = 10 {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] rate_limit_burst = 0 {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] rate_limit_except_level = CRITICAL {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] rate_limit_interval = 0 {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] reinit_driver_count = 3 {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] replication_device = **** {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] report_discard_supported = False {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] report_interval = 120 {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] reservation_clean_interval = 86400 {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] reservation_expire = 86400 {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] reserved_image_namespaces = [] {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] reserved_percentage = 0 {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] rpc_response_timeout = 120 {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] run_external_periodic_tasks = True {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] scst_target_driver = iscsi {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] scst_target_iqn_name = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] service_down_time = 720 {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] shell_completion = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] snapshot_name_template = snapshot-%s {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] split_loggers = False {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] state_path = /opt/stack/data/cinder {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] storage_availability_zone = nova {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] storage_protocol = iSCSI {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] syslog_log_facility = LOG_USER {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] target_helper = lioadm {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] target_ip_address = 192.168.122.31 {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] target_port = 3260 {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] target_protocol = iscsi {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] target_secondary_ip_addresses = [] {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] trace_flags = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] transfer_api_class = cinder.transfer.api.API {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] transport_url = **** {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] until_refresh = 0 {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] use_chap_auth = False {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] use_default_quota_class = True {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] use_journal = False {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] use_json = False {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] use_multipath_for_image_xfer = False {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] use_stderr = False {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] use_syslog = False {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] verify_glance_signatures = enabled {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] volume_api_class = cinder.volume.api.API {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] volume_backend_name = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] volume_clear = zero {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] volume_clear_ionice = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] volume_clear_size = 0 {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] volume_copy_bps_limit = 0 {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] volume_dd_blocksize = 1M {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] volume_name_template = volume-%s {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] volume_service_inithost_offload = False {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] volume_usage_audit_period = month {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] zoning_mode = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] os_brick.lightos_discovery_client_address = localhost {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] os_brick.wait_mpath_device_interval = 1 {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] oslo_concurrency.disable_process_locking = False {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] keystone_authtoken.admin_password = **** {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] keystone_authtoken.admin_tenant_name = admin {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] keystone_authtoken.admin_token = **** {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] keystone_authtoken.admin_user = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] keystone_authtoken.auth_admin_prefix = {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] keystone_authtoken.auth_port = 35357 {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] keystone_authtoken.auth_protocol = https {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] keystone_authtoken.auth_section = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] keystone_authtoken.auth_type = password {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] keystone_authtoken.auth_uri = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] keystone_authtoken.auth_version = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] keystone_authtoken.cache = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] keystone_authtoken.certfile = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] keystone_authtoken.delay_auth_decision = False {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] keystone_authtoken.http_connect_timeout = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] keystone_authtoken.identity_uri = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] keystone_authtoken.include_service_catalog = True {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] keystone_authtoken.insecure = False {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] keystone_authtoken.interface = public {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] keystone_authtoken.keyfile = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] keystone_authtoken.memcache_password = {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] keystone_authtoken.memcache_secret_key = **** {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] keystone_authtoken.memcache_security_strategy = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] keystone_authtoken.memcache_username = {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] keystone_authtoken.region_name = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] keystone_authtoken.service_token_roles_required = False {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] keystone_authtoken.service_type = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] keystone_authtoken.token_cache_time = 300 {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.31/identity {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] cache.backend = dogpile.cache.null {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] cache.backend_argument = **** {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] cache.backend_expiration_time = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] cache.config_prefix = cache.oslo {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] cache.debug_cache_backend = False {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] cache.enable_retry_client = False {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] cache.enable_socket_keepalive = False {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] cache.enabled = False {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] cache.enforce_fips_mode = False {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] cache.expiration_time = 600 {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] cache.hashclient_dead_timeout = 60.0 {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] cache.hashclient_retry_attempts = 2 {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] cache.hashclient_retry_timeout = 1.0 {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] cache.memcache_dead_retry = 300 {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] cache.memcache_pool_maxsize = 10 {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] cache.memcache_pool_unused_timeout = 60 {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] cache.memcache_sasl_enabled = False {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] cache.memcache_servers = ['localhost:11211'] {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] cache.password = **** {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] cache.proxies = [] {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] cache.redis_db = 0 {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] cache.redis_sentinel_service_name = mymaster {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] cache.redis_server = localhost:6379 {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] cache.retry_attempts = 2 {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] cache.retry_delay = 0.0 {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] cache.socket_keepalive_count = 1 {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] cache.socket_keepalive_idle = 1 {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] cache.socket_keepalive_interval = 1 {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] cache.socket_timeout = 1.0 {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] cache.tls_allowed_ciphers = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] cache.tls_cafile = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] cache.tls_certfile = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] cache.tls_enabled = False {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] cache.tls_keyfile = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] cache.username = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] coordination.backend_url = **** {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] database.asyncio_connection = **** {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] database.asyncio_slave_connection = **** {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] database.backend = sqlalchemy {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] database.connection = **** {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] database.connection_debug = 0 {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] database.connection_parameters = {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] database.connection_recycle_time = 3600 {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-13d59d82-bebe-4caa-9ea0-d86b6d43bb03 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=81771) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] database.connection_trace = False {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81771]: WARNING cinder.volume.drivers.quobyte [None req-13d59d82-bebe-4caa-9ea0-d86b6d43bb03 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] database.db_inc_retry_interval = True {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] database.db_max_retries = 20 {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] database.db_max_retry_interval = 10 {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] database.db_retry_interval = 1 {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] database.max_overflow = 50 {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] database.max_pool_size = 5 {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] database.max_retries = 10 {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81771]: WARNING cinder.volume.drivers.quobyte [None req-13d59d82-bebe-4caa-9ea0-d86b6d43bb03 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] database.mysql_sql_mode = TRADITIONAL {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] database.mysql_wsrep_sync_wait = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] database.pool_timeout = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] database.retry_interval = 10 {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] database.slave_connection = **** {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-13d59d82-bebe-4caa-9ea0-d86b6d43bb03 None None] Running cmd (subprocess): mount.quobyte {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] database.sqlite_synchronous = True {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] database.synchronous_reader = True {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] database.use_db_reconnect = False {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] oslo_messaging_metrics.metrics_process_name = {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] profiler.connection_string = messaging:// {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] profiler.enabled = False {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] profiler.es_doc_type = notification {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] profiler.es_scroll_size = 10000 {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] profiler.es_scroll_time = 2m {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] profiler.filter_error_trace = False {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] profiler.hmac_keys = **** {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] profiler.sentinel_service_name = mymaster {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] profiler.socket_timeout = 0.1 {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] profiler.trace_requests = False {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] profiler.trace_sqlalchemy = False {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] profiler_jaeger.process_tags = {} {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] profiler_jaeger.service_name_prefix = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] profiler_otlp.service_name_prefix = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] oslo_policy.enforce_new_defaults = False {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: WARNING oslo_config.cfg [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] oslo_policy.enforce_scope = False {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] oslo_policy.policy_default_rule = default {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] oslo_policy.policy_file = policy.yaml {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] oslo_policy.remote_timeout = 60.0 {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] privsep_osbrick.capabilities = [21, 2] {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] privsep_osbrick.group = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] privsep_osbrick.helper_command = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] privsep_osbrick.log_daemon_traceback = False {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] privsep_osbrick.thread_pool_size = 4 {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] privsep_osbrick.user = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] cinder_sys_admin.group = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] cinder_sys_admin.helper_command = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] cinder_sys_admin.user = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] service_user.auth_section = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] service_user.auth_type = password {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] service_user.cafile = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] service_user.certfile = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] service_user.collect_timing = False {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] service_user.insecure = False {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] service_user.keyfile = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] service_user.send_service_user_token = True {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] service_user.split_loggers = False {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] service_user.timeout = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] glance.auth_section = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] glance.auth_type = password {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] glance.certfile = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] glance.collect_timing = False {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] glance.insecure = False {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] glance.keyfile = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] glance.region_name = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] glance.split_loggers = False {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] glance.timeout = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] backend_defaults.backend_availability_zone = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] backend_defaults.chap_password = **** {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] backend_defaults.chap_username = {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] backend_defaults.disk_geometry = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] backend_defaults.driver_client_cert = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] backend_defaults.driver_client_cert_key = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] backend_defaults.driver_data_namespace = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] backend_defaults.driver_ssl_cert_path = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] backend_defaults.driver_use_ssl = False {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] backend_defaults.enable_unsupported_driver = False {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] backend_defaults.extra_capabilities = {} {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] backend_defaults.filter_function = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] backend_defaults.goodness_function = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] backend_defaults.image_volume_cache_enabled = False {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] backend_defaults.iscsi_target_flags = {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] backend_defaults.iscsi_write_cache = on {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] backend_defaults.iser_helper = tgtadm {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] backend_defaults.iser_ip_address = 192.168.122.31 {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] backend_defaults.iser_port = 3260 {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] backend_defaults.nas_host = {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] backend_defaults.nas_login = admin {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] backend_defaults.nas_mount_options = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] backend_defaults.nas_password = **** {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] backend_defaults.nas_private_key = {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] backend_defaults.nas_secure_file_operations = auto {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] backend_defaults.nas_share_path = {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] backend_defaults.nas_ssh_port = 22 {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] backend_defaults.nas_volume_prov_type = thin {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] backend_defaults.num_shell_tries = 3 {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] backend_defaults.nvmet_ns_id = 10 {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] backend_defaults.nvmet_port_id = 1 {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] backend_defaults.quobyte_client_cfg = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] backend_defaults.quobyte_volume_url = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] backend_defaults.replication_device = **** {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] backend_defaults.report_discard_supported = False {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] backend_defaults.reserved_percentage = 0 {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] backend_defaults.scst_target_driver = iscsi {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] backend_defaults.scst_target_iqn_name = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] backend_defaults.storage_protocol = iSCSI {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] backend_defaults.target_helper = tgtadm {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] backend_defaults.target_ip_address = 192.168.122.31 {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] backend_defaults.target_port = 3260 {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] backend_defaults.target_protocol = iscsi {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] backend_defaults.trace_flags = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] backend_defaults.unique_fqdn_network = True {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] backend_defaults.use_chap_auth = False {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] backend_defaults.volume_backend_name = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] backend_defaults.volume_clear = zero {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] backend_defaults.volume_clear_ionice = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] backend_defaults.volume_clear_size = 0 {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] oslo_reports.file_event_handler = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] oslo_reports.file_event_handler_interval = 1 {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] oslo_reports.log_dir = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] QuobyteHD.backend_availability_zone = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] QuobyteHD.backend_host = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] QuobyteHD.chap_password = **** {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] QuobyteHD.chap_username = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] QuobyteHD.chiscsi_conf = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] QuobyteHD.disk_geometry = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] QuobyteHD.driver_client_cert = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] QuobyteHD.driver_client_cert_key = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] QuobyteHD.driver_data_namespace = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] QuobyteHD.driver_use_ssl = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] QuobyteHD.enable_unsupported_driver = True {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] QuobyteHD.extra_capabilities = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] QuobyteHD.filter_function = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] QuobyteHD.goodness_function = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] QuobyteHD.iscsi_target_flags = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] QuobyteHD.iscsi_write_cache = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] QuobyteHD.iser_helper = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] QuobyteHD.iser_ip_address = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] QuobyteHD.iser_port = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] QuobyteHD.iser_target_prefix = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] QuobyteHD.nas_host = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] QuobyteHD.nas_login = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] QuobyteHD.nas_mount_options = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] QuobyteHD.nas_password = **** {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] QuobyteHD.nas_private_key = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] QuobyteHD.nas_secure_file_operations = false {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] QuobyteHD.nas_share_path = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] QuobyteHD.nas_ssh_port = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] QuobyteHD.nas_volume_prov_type = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] QuobyteHD.num_iser_scan_tries = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] QuobyteHD.num_shell_tries = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] QuobyteHD.nvmet_ns_id = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] QuobyteHD.nvmet_port_id = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] QuobyteHD.replication_device = **** {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] QuobyteHD.report_discard_supported = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] QuobyteHD.reserved_percentage = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] QuobyteHD.scst_target_driver = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] QuobyteHD.scst_target_iqn_name = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] QuobyteHD.storage_protocol = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] QuobyteHD.target_helper = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] QuobyteHD.target_ip_address = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] QuobyteHD.target_port = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] QuobyteHD.target_prefix = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] QuobyteHD.target_protocol = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] QuobyteHD.trace_flags = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] QuobyteHD.unique_fqdn_network = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] QuobyteHD.use_chap_auth = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] QuobyteHD.volume_clear = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] QuobyteHD.volume_clear_ionice = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] QuobyteHD.volume_clear_size = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] QuobyteHD.volume_dd_blocksize = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] QuobyteHD.volumes_dir = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] oslo_messaging_rabbit.hostname = devstack {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] oslo_messaging_rabbit.ssl = False {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] oslo_messaging_rabbit.ssl_version = {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] oslo_messaging_notifications.driver = [] {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] oslo_messaging_notifications.retry = -1 {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] oslo_messaging_notifications.transport_url = **** {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] key_manager.fixed_key = **** {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] barbican.barbican_api_version = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] barbican.barbican_endpoint = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] barbican.barbican_endpoint_type = public {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] barbican.barbican_region_name = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] barbican.cafile = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] barbican.certfile = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] barbican.collect_timing = False {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] barbican.insecure = False {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] barbican.keyfile = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] barbican.number_of_retries = 60 {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] barbican.retry_delay = 1 {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] barbican.send_service_user_token = False {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] barbican.split_loggers = False {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] barbican.timeout = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] barbican.verify_ssl = True {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] barbican.verify_ssl_path = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] barbican_service_user.auth_section = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] barbican_service_user.auth_type = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] barbican_service_user.cafile = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] barbican_service_user.certfile = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] barbican_service_user.collect_timing = False {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] barbican_service_user.insecure = False {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] barbican_service_user.keyfile = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] barbican_service_user.split_loggers = False {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] barbican_service_user.timeout = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] vault.approle_role_id = **** {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] vault.approle_secret_id = **** {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] vault.kv_mountpoint = secret {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] vault.kv_path = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] vault.kv_version = 2 {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] vault.namespace = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] vault.root_token_id = **** {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] vault.ssl_ca_crt_file = None {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] vault.timeout = 60.0 {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] vault.use_ssl = False {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 17:48:38 devstack cinder-volume[81581]: DEBUG oslo_service.backend._eventlet.service [None req-40df5c5b-3c39-4b61-809c-7e02ab04ab1a None None] ******************************************************************************** {{(pid=81581) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 22 17:48:38 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-13d59d82-bebe-4caa-9ea0-d86b6d43bb03 None None] CMD "mount.quobyte" returned: 1 in 0.166s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:48:38 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-13d59d82-bebe-4caa-9ea0-d86b6d43bb03 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:48:38 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-13d59d82-bebe-4caa-9ea0-d86b6d43bb03 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:48:38 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-13d59d82-bebe-4caa-9ea0-d86b6d43bb03 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:48:38 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-13d59d82-bebe-4caa-9ea0-d86b6d43bb03 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:48:38 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-13d59d82-bebe-4caa-9ea0-d86b6d43bb03 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:48:38 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-13d59d82-bebe-4caa-9ea0-d86b6d43bb03 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:48:38 devstack sudo[81801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 Apr 22 17:48:38 devstack sudo[81801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:48:39 devstack sudo[81801]: pam_unix(sudo:session): session closed for user root Apr 22 17:48:39 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-13d59d82-bebe-4caa-9ea0-d86b6d43bb03 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33" returned: 0 in 1.075s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:48:39 devstack cinder-volume[81771]: INFO cinder.volume.driver [None req-13d59d82-bebe-4caa-9ea0-d86b6d43bb03 None None] Driver hasn't implemented _init_vendor_properties() Apr 22 17:48:39 devstack cinder-volume[81771]: DEBUG cinder.volume.driver [None req-13d59d82-bebe-4caa-9ea0-d86b6d43bb03 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6804428100586, 'free_capacity_gb': 1775.6804428100586, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=81771) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 22 17:48:39 devstack cinder-volume[81771]: DEBUG oslo_db.sqlalchemy.engines [None req-13d59d82-bebe-4caa-9ea0-d86b6d43bb03 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81771) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 22 17:48:39 devstack cinder-volume[81771]: DEBUG dbcounter [-] [81771] Writer thread running {{(pid=81771) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 22 17:48:39 devstack cinder-volume[81771]: DEBUG cinder.db.sqlalchemy.api [None req-13d59d82-bebe-4caa-9ea0-d86b6d43bb03 None None] Building query based on filter {{(pid=81771) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 22 17:48:39 devstack cinder-volume[81771]: DEBUG cinder.image.image_utils [None req-13d59d82-bebe-4caa-9ea0-d86b6d43bb03 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=81771) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 22 17:48:39 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-13d59d82-bebe-4caa-9ea0-d86b6d43bb03 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:48:39 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-13d59d82-bebe-4caa-9ea0-d86b6d43bb03 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:48:39 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-13d59d82-bebe-4caa-9ea0-d86b6d43bb03 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:48:39 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-13d59d82-bebe-4caa-9ea0-d86b6d43bb03 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:48:39 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-13d59d82-bebe-4caa-9ea0-d86b6d43bb03 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:48:39 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-13d59d82-bebe-4caa-9ea0-d86b6d43bb03 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:48:39 devstack cinder-volume[81771]: INFO cinder.keymgr.migration [None req-21a3c44a-73e0-49a6-a768-dec58c8a7e78 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 22 17:48:39 devstack sudo[81826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 Apr 22 17:48:39 devstack sudo[81826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:48:40 devstack sudo[81826]: pam_unix(sudo:session): session closed for user root Apr 22 17:48:40 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-13d59d82-bebe-4caa-9ea0-d86b6d43bb03 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33" returned: 0 in 0.438s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:48:40 devstack cinder-volume[81771]: DEBUG cinder.manager [None req-13d59d82-bebe-4caa-9ea0-d86b6d43bb03 None None] Notifying Schedulers of capabilities ... {{(pid=81771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 17:48:40 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-13d59d82-bebe-4caa-9ea0-d86b6d43bb03 None None] Driver initialization completed successfully. Apr 22 17:48:40 devstack cinder-volume[81771]: INFO cinder.manager [None req-13d59d82-bebe-4caa-9ea0-d86b6d43bb03 None None] Initiating service 3 cleanup Apr 22 17:48:40 devstack cinder-volume[81771]: INFO cinder.manager [None req-13d59d82-bebe-4caa-9ea0-d86b6d43bb03 None None] Service 3 cleanup completed. Apr 22 17:48:40 devstack cinder-volume[81771]: DEBUG cinder.service [None req-13d59d82-bebe-4caa-9ea0-d86b6d43bb03 None None] Creating RPC server for service cinder-volume {{(pid=81771) start /opt/stack/cinder/cinder/service.py:231}} Apr 22 17:48:40 devstack cinder-volume[81771]: DEBUG cinder.service [None req-13d59d82-bebe-4caa-9ea0-d86b6d43bb03 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=81771) start /opt/stack/cinder/cinder/service.py:237}} Apr 22 17:48:40 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-13d59d82-bebe-4caa-9ea0-d86b6d43bb03 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 22 17:48:40 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-13d59d82-bebe-4caa-9ea0-d86b6d43bb03 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:48:40 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-13d59d82-bebe-4caa-9ea0-d86b6d43bb03 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:48:40 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-13d59d82-bebe-4caa-9ea0-d86b6d43bb03 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:48:40 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-13d59d82-bebe-4caa-9ea0-d86b6d43bb03 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:48:40 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-13d59d82-bebe-4caa-9ea0-d86b6d43bb03 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:48:40 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-13d59d82-bebe-4caa-9ea0-d86b6d43bb03 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:48:40 devstack sudo[81830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 Apr 22 17:48:40 devstack sudo[81830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:48:40 devstack sudo[81830]: pam_unix(sudo:session): session closed for user root Apr 22 17:48:40 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-13d59d82-bebe-4caa-9ea0-d86b6d43bb03 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33" returned: 0 in 0.430s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:48:40 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-13d59d82-bebe-4caa-9ea0-d86b6d43bb03 None None] Driver post RPC initialization completed successfully. Apr 22 17:48:48 devstack cinder-volume[81581]: DEBUG dbcounter [-] [81581] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=81581) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 22 17:48:50 devstack cinder-volume[81771]: DEBUG dbcounter [-] [81771] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=81771) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 22 17:48:50 devstack cinder-volume[81771]: DEBUG dbcounter [-] [81771] Writing DB stats cinder:SELECT=3 {{(pid=81771) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 22 17:50:10 devstack cinder-volume[81771]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9dfda30-e67e-4983-ae22-8d16863ff1c6 tempest-DeleteServersTestJSON-2015012302 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 17:50:10 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-d9dfda30-e67e-4983-ae22-8d16863ff1c6 tempest-DeleteServersTestJSON-2015012302 None] Flow 'volume_create_manager' (bde15cb6-19f0-4e14-8978-3c4aa333f4d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:50:10 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-d9dfda30-e67e-4983-ae22-8d16863ff1c6 tempest-DeleteServersTestJSON-2015012302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d4967d4-d2ed-4881-8ec1-d407780430d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:50:10 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-d9dfda30-e67e-4983-ae22-8d16863ff1c6 tempest-DeleteServersTestJSON-2015012302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d4967d4-d2ed-4881-8ec1-d407780430d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:50:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1770653953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a737d05e-1720-4099-a88b-42c1cba0edf4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='189a37b0c6d64cb5a52a034451d08b2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:50:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:50:10Z,use_quota=True,user_id='c730097a3dea4c57b21de93bcd4c9ef1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:50:10 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-d9dfda30-e67e-4983-ae22-8d16863ff1c6 tempest-DeleteServersTestJSON-2015012302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18d8875d-d551-427c-8f88-dd9c1a610a34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:50:10 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-d9dfda30-e67e-4983-ae22-8d16863ff1c6 tempest-DeleteServersTestJSON-2015012302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18d8875d-d551-427c-8f88-dd9c1a610a34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:50:10 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-d9dfda30-e67e-4983-ae22-8d16863ff1c6 tempest-DeleteServersTestJSON-2015012302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62ccfd3a-ebfe-4b42-ad56-5eb3b142990a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:50:10 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-d9dfda30-e67e-4983-ae22-8d16863ff1c6 tempest-DeleteServersTestJSON-2015012302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62ccfd3a-ebfe-4b42-ad56-5eb3b142990a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a737d05e-1720-4099-a88b-42c1cba0edf4', 'volume_name': 'volume-a737d05e-1720-4099-a88b-42c1cba0edf4', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:50:11 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-d9dfda30-e67e-4983-ae22-8d16863ff1c6 tempest-DeleteServersTestJSON-2015012302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aca23e78-df1d-42fc-83c8-184c667c4759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:50:11 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-d9dfda30-e67e-4983-ae22-8d16863ff1c6 tempest-DeleteServersTestJSON-2015012302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aca23e78-df1d-42fc-83c8-184c667c4759) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:50:11 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-d9dfda30-e67e-4983-ae22-8d16863ff1c6 tempest-DeleteServersTestJSON-2015012302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a64e7ee3-d799-4963-872f-213ff30e871e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:50:11 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-d9dfda30-e67e-4983-ae22-8d16863ff1c6 tempest-DeleteServersTestJSON-2015012302 None] Volume a737d05e-1720-4099-a88b-42c1cba0edf4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a737d05e-1720-4099-a88b-42c1cba0edf4', 'volume_size': 1} Apr 22 17:50:11 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-d9dfda30-e67e-4983-ae22-8d16863ff1c6 tempest-DeleteServersTestJSON-2015012302 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:50:11 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-d9dfda30-e67e-4983-ae22-8d16863ff1c6 tempest-DeleteServersTestJSON-2015012302 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:50:11 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-d9dfda30-e67e-4983-ae22-8d16863ff1c6 tempest-DeleteServersTestJSON-2015012302 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:50:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1770653953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a737d05e-1720-4099-a88b-42c1cba0edf4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='189a37b0c6d64cb5a52a034451d08b2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:50:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:50:10Z,use_quota=True,user_id='c730097a3dea4c57b21de93bcd4c9ef1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)}" {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 17:50:11 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-d9dfda30-e67e-4983-ae22-8d16863ff1c6 tempest-DeleteServersTestJSON-2015012302 None] Creating volume a737d05e-1720-4099-a88b-42c1cba0edf4 {{(pid=81771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 17:50:11 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-d9dfda30-e67e-4983-ae22-8d16863ff1c6 tempest-DeleteServersTestJSON-2015012302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:50:11 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-d9dfda30-e67e-4983-ae22-8d16863ff1c6 tempest-DeleteServersTestJSON-2015012302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:50:11 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-d9dfda30-e67e-4983-ae22-8d16863ff1c6 tempest-DeleteServersTestJSON-2015012302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:50:11 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-d9dfda30-e67e-4983-ae22-8d16863ff1c6 tempest-DeleteServersTestJSON-2015012302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:50:11 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-d9dfda30-e67e-4983-ae22-8d16863ff1c6 tempest-DeleteServersTestJSON-2015012302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:50:11 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-d9dfda30-e67e-4983-ae22-8d16863ff1c6 tempest-DeleteServersTestJSON-2015012302 None] Selected osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 as target Quobyte volume. {{(pid=81771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 17:50:11 devstack cinder-volume[81771]: INFO cinder.volume.drivers.remotefs [None req-d9dfda30-e67e-4983-ae22-8d16863ff1c6 tempest-DeleteServersTestJSON-2015012302 None] casted to osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 Apr 22 17:50:11 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-d9dfda30-e67e-4983-ae22-8d16863ff1c6 tempest-DeleteServersTestJSON-2015012302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a737d05e-1720-4099-a88b-42c1cba0edf4 1073741824 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:50:11 devstack sudo[82523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a737d05e-1720-4099-a88b-42c1cba0edf4 1073741824 Apr 22 17:50:11 devstack sudo[82523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:50:13 devstack sudo[82523]: pam_unix(sudo:session): session closed for user root Apr 22 17:50:13 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-d9dfda30-e67e-4983-ae22-8d16863ff1c6 tempest-DeleteServersTestJSON-2015012302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a737d05e-1720-4099-a88b-42c1cba0edf4 1073741824" returned: 0 in 2.379s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:50:13 devstack cinder-volume[81771]: DEBUG cinder.volume.flows.manager.create_volume [None req-f825c706-7b6b-4700-b32a-b1eef6a02101 tempest-VolumesAdminNegativeTest-1680575122 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 17:50:13 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-f825c706-7b6b-4700-b32a-b1eef6a02101 tempest-VolumesAdminNegativeTest-1680575122 None] Flow 'volume_create_manager' (dfed9cf6-846f-4c1e-90bc-136bcde3acb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:50:13 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-f825c706-7b6b-4700-b32a-b1eef6a02101 tempest-VolumesAdminNegativeTest-1680575122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e3424a0-47a4-4515-8cc4-be843592728f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:50:13 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-f825c706-7b6b-4700-b32a-b1eef6a02101 tempest-VolumesAdminNegativeTest-1680575122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e3424a0-47a4-4515-8cc4-be843592728f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:50:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1216272806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8ad8230-0a48-48b4-a8f5-30f64643b8f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d807a0d68ca48c2b1fc5db89c9f9609',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:50:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:50:13Z,use_quota=True,user_id='3dc82887b9ef43419723f427b4e6329b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:50:13 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-f825c706-7b6b-4700-b32a-b1eef6a02101 tempest-VolumesAdminNegativeTest-1680575122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8aafc0d-c316-41a8-b16e-e3c694216bf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:50:13 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-f825c706-7b6b-4700-b32a-b1eef6a02101 tempest-VolumesAdminNegativeTest-1680575122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8aafc0d-c316-41a8-b16e-e3c694216bf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:50:13 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-f825c706-7b6b-4700-b32a-b1eef6a02101 tempest-VolumesAdminNegativeTest-1680575122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c41dec6-943e-4df1-a2f2-cdb1c15e8b91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:50:13 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-f825c706-7b6b-4700-b32a-b1eef6a02101 tempest-VolumesAdminNegativeTest-1680575122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c41dec6-943e-4df1-a2f2-cdb1c15e8b91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8ad8230-0a48-48b4-a8f5-30f64643b8f8', 'volume_name': 'volume-d8ad8230-0a48-48b4-a8f5-30f64643b8f8', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:50:13 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-f825c706-7b6b-4700-b32a-b1eef6a02101 tempest-VolumesAdminNegativeTest-1680575122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (357b0098-e97c-4f61-ba11-9d9db681ed08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:50:13 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-f825c706-7b6b-4700-b32a-b1eef6a02101 tempest-VolumesAdminNegativeTest-1680575122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (357b0098-e97c-4f61-ba11-9d9db681ed08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:50:13 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-f825c706-7b6b-4700-b32a-b1eef6a02101 tempest-VolumesAdminNegativeTest-1680575122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cab0fc63-794c-4d1b-a8f1-4412b8017803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:50:13 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-f825c706-7b6b-4700-b32a-b1eef6a02101 tempest-VolumesAdminNegativeTest-1680575122 None] Volume d8ad8230-0a48-48b4-a8f5-30f64643b8f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8ad8230-0a48-48b4-a8f5-30f64643b8f8', 'volume_size': 1} Apr 22 17:50:13 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-f825c706-7b6b-4700-b32a-b1eef6a02101 tempest-VolumesAdminNegativeTest-1680575122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:50:14 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-d9dfda30-e67e-4983-ae22-8d16863ff1c6 tempest-DeleteServersTestJSON-2015012302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a737d05e-1720-4099-a88b-42c1cba0edf4 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:50:14 devstack sudo[82843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a737d05e-1720-4099-a88b-42c1cba0edf4 Apr 22 17:50:14 devstack sudo[82843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:50:15 devstack sudo[82843]: pam_unix(sudo:session): session closed for user root Apr 22 17:50:15 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-d9dfda30-e67e-4983-ae22-8d16863ff1c6 tempest-DeleteServersTestJSON-2015012302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a737d05e-1720-4099-a88b-42c1cba0edf4" returned: 0 in 1.348s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:50:15 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-d9dfda30-e67e-4983-ae22-8d16863ff1c6 tempest-DeleteServersTestJSON-2015012302 None] <== create_volume: return (4302ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'} {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 17:50:15 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-d9dfda30-e67e-4983-ae22-8d16863ff1c6 tempest-DeleteServersTestJSON-2015012302 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.311s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:50:15 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-f825c706-7b6b-4700-b32a-b1eef6a02101 tempest-VolumesAdminNegativeTest-1680575122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.408s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:50:15 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-f825c706-7b6b-4700-b32a-b1eef6a02101 tempest-VolumesAdminNegativeTest-1680575122 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:50:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1216272806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8ad8230-0a48-48b4-a8f5-30f64643b8f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d807a0d68ca48c2b1fc5db89c9f9609',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:50:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:50:13Z,use_quota=True,user_id='3dc82887b9ef43419723f427b4e6329b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)}" {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 17:50:15 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-f825c706-7b6b-4700-b32a-b1eef6a02101 tempest-VolumesAdminNegativeTest-1680575122 None] Creating volume d8ad8230-0a48-48b4-a8f5-30f64643b8f8 {{(pid=81771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 17:50:15 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-f825c706-7b6b-4700-b32a-b1eef6a02101 tempest-VolumesAdminNegativeTest-1680575122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:50:15 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-f825c706-7b6b-4700-b32a-b1eef6a02101 tempest-VolumesAdminNegativeTest-1680575122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:50:15 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-f825c706-7b6b-4700-b32a-b1eef6a02101 tempest-VolumesAdminNegativeTest-1680575122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:50:15 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-f825c706-7b6b-4700-b32a-b1eef6a02101 tempest-VolumesAdminNegativeTest-1680575122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:50:15 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-f825c706-7b6b-4700-b32a-b1eef6a02101 tempest-VolumesAdminNegativeTest-1680575122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:50:15 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-f825c706-7b6b-4700-b32a-b1eef6a02101 tempest-VolumesAdminNegativeTest-1680575122 None] Selected osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 as target Quobyte volume. {{(pid=81771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 17:50:15 devstack cinder-volume[81771]: INFO cinder.volume.drivers.remotefs [None req-f825c706-7b6b-4700-b32a-b1eef6a02101 tempest-VolumesAdminNegativeTest-1680575122 None] casted to osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 Apr 22 17:50:15 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-f825c706-7b6b-4700-b32a-b1eef6a02101 tempest-VolumesAdminNegativeTest-1680575122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-d8ad8230-0a48-48b4-a8f5-30f64643b8f8 1073741824 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:50:15 devstack sudo[82855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-d8ad8230-0a48-48b4-a8f5-30f64643b8f8 1073741824 Apr 22 17:50:15 devstack sudo[82855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:50:15 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-d9dfda30-e67e-4983-ae22-8d16863ff1c6 tempest-DeleteServersTestJSON-2015012302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a64e7ee3-d799-4963-872f-213ff30e871e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a737d05e-1720-4099-a88b-42c1cba0edf4', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:50:15 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-d9dfda30-e67e-4983-ae22-8d16863ff1c6 tempest-DeleteServersTestJSON-2015012302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6d65248-590f-48da-9528-1e3f7f1817ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:50:15 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-d9dfda30-e67e-4983-ae22-8d16863ff1c6 tempest-DeleteServersTestJSON-2015012302 None] Volume volume-a737d05e-1720-4099-a88b-42c1cba0edf4 (a737d05e-1720-4099-a88b-42c1cba0edf4): created successfully Apr 22 17:50:15 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-d9dfda30-e67e-4983-ae22-8d16863ff1c6 tempest-DeleteServersTestJSON-2015012302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6d65248-590f-48da-9528-1e3f7f1817ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:50:15 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-d9dfda30-e67e-4983-ae22-8d16863ff1c6 tempest-DeleteServersTestJSON-2015012302 None] Flow 'volume_create_manager' (bde15cb6-19f0-4e14-8978-3c4aa333f4d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:50:15 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-d9dfda30-e67e-4983-ae22-8d16863ff1c6 tempest-DeleteServersTestJSON-2015012302 None] Created volume successfully. Apr 22 17:50:16 devstack sudo[82855]: pam_unix(sudo:session): session closed for user root Apr 22 17:50:16 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-f825c706-7b6b-4700-b32a-b1eef6a02101 tempest-VolumesAdminNegativeTest-1680575122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-d8ad8230-0a48-48b4-a8f5-30f64643b8f8 1073741824" returned: 0 in 0.895s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:50:16 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-f825c706-7b6b-4700-b32a-b1eef6a02101 tempest-VolumesAdminNegativeTest-1680575122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-d8ad8230-0a48-48b4-a8f5-30f64643b8f8 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:50:16 devstack sudo[82876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-d8ad8230-0a48-48b4-a8f5-30f64643b8f8 Apr 22 17:50:16 devstack sudo[82876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:50:17 devstack sudo[82876]: pam_unix(sudo:session): session closed for user root Apr 22 17:50:17 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-f825c706-7b6b-4700-b32a-b1eef6a02101 tempest-VolumesAdminNegativeTest-1680575122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-d8ad8230-0a48-48b4-a8f5-30f64643b8f8" returned: 0 in 0.810s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:50:17 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-f825c706-7b6b-4700-b32a-b1eef6a02101 tempest-VolumesAdminNegativeTest-1680575122 None] <== create_volume: return (1785ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'} {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 17:50:17 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-f825c706-7b6b-4700-b32a-b1eef6a02101 tempest-VolumesAdminNegativeTest-1680575122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.794s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:50:17 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-f825c706-7b6b-4700-b32a-b1eef6a02101 tempest-VolumesAdminNegativeTest-1680575122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cab0fc63-794c-4d1b-a8f1-4412b8017803) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8ad8230-0a48-48b4-a8f5-30f64643b8f8', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:50:17 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-f825c706-7b6b-4700-b32a-b1eef6a02101 tempest-VolumesAdminNegativeTest-1680575122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b52b760-6aa4-4d06-9268-d4a3684113b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:50:17 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-f825c706-7b6b-4700-b32a-b1eef6a02101 tempest-VolumesAdminNegativeTest-1680575122 None] Volume volume-d8ad8230-0a48-48b4-a8f5-30f64643b8f8 (d8ad8230-0a48-48b4-a8f5-30f64643b8f8): created successfully Apr 22 17:50:17 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-f825c706-7b6b-4700-b32a-b1eef6a02101 tempest-VolumesAdminNegativeTest-1680575122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b52b760-6aa4-4d06-9268-d4a3684113b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:50:17 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-f825c706-7b6b-4700-b32a-b1eef6a02101 tempest-VolumesAdminNegativeTest-1680575122 None] Flow 'volume_create_manager' (dfed9cf6-846f-4c1e-90bc-136bcde3acb9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:50:17 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-f825c706-7b6b-4700-b32a-b1eef6a02101 tempest-VolumesAdminNegativeTest-1680575122 None] Created volume successfully. Apr 22 17:50:18 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-ee2dc061-e595-40b0-ba00-f8ccd8e61dc4 tempest-VolumesAdminNegativeTest-1680575122 None] Acquiring lock "cinder-d8ad8230-0a48-48b4-a8f5-30f64643b8f8-delete_volume" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:50:18 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-ee2dc061-e595-40b0-ba00-f8ccd8e61dc4 tempest-VolumesAdminNegativeTest-1680575122 None] Lock "cinder-d8ad8230-0a48-48b4-a8f5-30f64643b8f8-delete_volume" acquired by "delete_volume" :: waited 0.078s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:50:19 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-ee2dc061-e595-40b0-ba00-f8ccd8e61dc4 tempest-VolumesAdminNegativeTest-1680575122 None] Acquiring lock "cinder-quobyte-d8ad8230-0a48-48b4-a8f5-30f64643b8f8" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:50:19 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-ee2dc061-e595-40b0-ba00-f8ccd8e61dc4 tempest-VolumesAdminNegativeTest-1680575122 None] Lock "cinder-quobyte-d8ad8230-0a48-48b4-a8f5-30f64643b8f8" acquired by "delete_volume" :: waited 0.051s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:50:19 devstack cinder-volume[81771]: INFO oslo.privsep.daemon [None req-ee2dc061-e595-40b0-ba00-f8ccd8e61dc4 tempest-VolumesAdminNegativeTest-1680575122 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpuaayevr4/privsep.sock'] Apr 22 17:50:19 devstack sudo[82895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpuaayevr4/privsep.sock Apr 22 17:50:19 devstack sudo[82895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:50:20 devstack cinder-volume[81771]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Apr 22 17:50:20 devstack cinder-volume[81771]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 22 17:50:20 devstack cinder-volume[81771]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Apr 22 17:50:20 devstack cinder-volume[81771]: WARNING oslo.privsep.daemon [-] privsep log: Apr 22 17:50:20 devstack cinder-volume[81771]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Apr 22 17:50:20 devstack cinder-volume[81771]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Apr 22 17:50:20 devstack cinder-volume[81771]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 22 17:50:20 devstack cinder-volume[81771]: WARNING oslo.privsep.daemon [-] privsep log: Apr 22 17:50:20 devstack cinder-volume[81771]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Apr 22 17:50:20 devstack cinder-volume[81771]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:66: EventletDeprecationWarning: Apr 22 17:50:20 devstack cinder-volume[81771]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 22 17:50:20 devstack cinder-volume[81771]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Apr 22 17:50:20 devstack cinder-volume[81771]: WARNING oslo.privsep.daemon [-] privsep log: Apr 22 17:50:20 devstack cinder-volume[81771]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Apr 22 17:50:20 devstack cinder-volume[81771]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Apr 22 17:50:20 devstack cinder-volume[81771]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 22 17:50:20 devstack cinder-volume[81771]: WARNING oslo.privsep.daemon [-] privsep log: Apr 22 17:50:20 devstack cinder-volume[81771]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Apr 22 17:50:22 devstack sudo[82895]: pam_unix(sudo:session): session closed for user root Apr 22 17:50:22 devstack cinder-volume[81771]: INFO oslo.privsep.daemon [None req-ee2dc061-e595-40b0-ba00-f8ccd8e61dc4 tempest-VolumesAdminNegativeTest-1680575122 None] Spawned new privsep daemon via rootwrap Apr 22 17:50:22 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [None req-ee2dc061-e595-40b0-ba00-f8ccd8e61dc4 tempest-VolumesAdminNegativeTest-1680575122 None] Accepted privsep connection to /tmp/tmpuaayevr4/privsep.sock {{(pid=81771) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:418}} Apr 22 17:50:22 devstack cinder-volume[81771]: INFO oslo.privsep.daemon [-] privsep daemon starting Apr 22 17:50:22 devstack cinder-volume[81771]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Apr 22 17:50:22 devstack cinder-volume[81771]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Apr 22 17:50:22 devstack cinder-volume[81771]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82958 Apr 22 17:50:22 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2b09a70-771f-4331-b754-f0f1d65f9449]: (2,) {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:50:22 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[766a5faf-2f29-4845-bfc7-c075af8939b1]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:50:22 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-ee2dc061-e595-40b0-ba00-f8ccd8e61dc4 tempest-VolumesAdminNegativeTest-1680575122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-d8ad8230-0a48-48b4-a8f5-30f64643b8f8 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:50:22 devstack sudo[82969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-d8ad8230-0a48-48b4-a8f5-30f64643b8f8 Apr 22 17:50:22 devstack sudo[82969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:50:24 devstack sudo[82969]: pam_unix(sudo:session): session closed for user root Apr 22 17:50:24 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-ee2dc061-e595-40b0-ba00-f8ccd8e61dc4 tempest-VolumesAdminNegativeTest-1680575122 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-d8ad8230-0a48-48b4-a8f5-30f64643b8f8" returned: 0 in 1.989s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:50:24 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-ee2dc061-e595-40b0-ba00-f8ccd8e61dc4 tempest-VolumesAdminNegativeTest-1680575122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-d8ad8230-0a48-48b4-a8f5-30f64643b8f8 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:50:24 devstack sudo[83008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-d8ad8230-0a48-48b4-a8f5-30f64643b8f8 Apr 22 17:50:24 devstack sudo[83008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:50:25 devstack cinder-volume[81771]: WARNING py.warnings [req-b37efae2-8c84-4ea8-ace0-aca0885ca04b req-7eecf4da-1a64-43fa-9655-8d94e010e0e7 tempest-DeleteServersTestJSON-2015012302 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Apr 22 17:50:25 devstack cinder-volume[81771]: .first() Apr 22 17:50:25 devstack cinder-volume[81771]: Apr 22 17:50:25 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [req-b37efae2-8c84-4ea8-ace0-aca0885ca04b req-7eecf4da-1a64-43fa-9655-8d94e010e0e7 tempest-DeleteServersTestJSON-2015012302 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:50:25 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [req-b37efae2-8c84-4ea8-ace0-aca0885ca04b req-7eecf4da-1a64-43fa-9655-8d94e010e0e7 tempest-DeleteServersTestJSON-2015012302 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.024s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:50:25 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d24f72a-095e-4d48-acd6-8054e3ee94fa]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:50:25 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [req-b37efae2-8c84-4ea8-ace0-aca0885ca04b req-7eecf4da-1a64-43fa-9655-8d94e010e0e7 tempest-DeleteServersTestJSON-2015012302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a737d05e-1720-4099-a88b-42c1cba0edf4 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:50:25 devstack sudo[83022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a737d05e-1720-4099-a88b-42c1cba0edf4 Apr 22 17:50:25 devstack sudo[83022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:50:25 devstack sudo[83008]: pam_unix(sudo:session): session closed for user root Apr 22 17:50:26 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-ee2dc061-e595-40b0-ba00-f8ccd8e61dc4 tempest-VolumesAdminNegativeTest-1680575122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-d8ad8230-0a48-48b4-a8f5-30f64643b8f8" returned: 0 in 1.569s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:50:26 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-ee2dc061-e595-40b0-ba00-f8ccd8e61dc4 tempest-VolumesAdminNegativeTest-1680575122 None] Lock "cinder-quobyte-d8ad8230-0a48-48b4-a8f5-30f64643b8f8" released by "delete_volume" :: held 6.849s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:50:26 devstack cinder-volume[81771]: WARNING cinder.quota [None req-ee2dc061-e595-40b0-ba00-f8ccd8e61dc4 tempest-VolumesAdminNegativeTest-1680575122 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 22 17:50:26 devstack cinder-volume[81771]: WARNING cinder.quota [None req-ee2dc061-e595-40b0-ba00-f8ccd8e61dc4 tempest-VolumesAdminNegativeTest-1680575122 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 22 17:50:26 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-ee2dc061-e595-40b0-ba00-f8ccd8e61dc4 tempest-VolumesAdminNegativeTest-1680575122 None] Created reservations ['1454ea63-caa2-4eaf-85cf-e872c435ce8d', '509a8209-a1e2-414b-afde-c51cf1a8028c', '7e9f7dc0-0067-49c2-8e4e-185430c6a611', '9e7f2c76-b92e-456e-8f48-c514c1bdf494'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 17:50:26 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-ee2dc061-e595-40b0-ba00-f8ccd8e61dc4 tempest-VolumesAdminNegativeTest-1680575122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:50:26 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-ee2dc061-e595-40b0-ba00-f8ccd8e61dc4 tempest-VolumesAdminNegativeTest-1680575122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:50:26 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-ee2dc061-e595-40b0-ba00-f8ccd8e61dc4 tempest-VolumesAdminNegativeTest-1680575122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:50:26 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-ee2dc061-e595-40b0-ba00-f8ccd8e61dc4 tempest-VolumesAdminNegativeTest-1680575122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:50:26 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-ee2dc061-e595-40b0-ba00-f8ccd8e61dc4 tempest-VolumesAdminNegativeTest-1680575122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:50:26 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-ee2dc061-e595-40b0-ba00-f8ccd8e61dc4 tempest-VolumesAdminNegativeTest-1680575122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:50:26 devstack sudo[83057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 Apr 22 17:50:26 devstack sudo[83057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:50:27 devstack sudo[83022]: pam_unix(sudo:session): session closed for user root Apr 22 17:50:27 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [req-b37efae2-8c84-4ea8-ace0-aca0885ca04b req-7eecf4da-1a64-43fa-9655-8d94e010e0e7 tempest-DeleteServersTestJSON-2015012302 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a737d05e-1720-4099-a88b-42c1cba0edf4" returned: 0 in 2.067s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:50:27 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [req-b37efae2-8c84-4ea8-ace0-aca0885ca04b req-7eecf4da-1a64-43fa-9655-8d94e010e0e7 tempest-DeleteServersTestJSON-2015012302 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.121s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:50:27 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [req-b37efae2-8c84-4ea8-ace0-aca0885ca04b req-7eecf4da-1a64-43fa-9655-8d94e010e0e7 tempest-DeleteServersTestJSON-2015012302 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93', 'name': 'volume-a737d05e-1720-4099-a88b-42c1cba0edf4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c84ef61c-6b00-4fa3-8ac5-a23aaa3c41da', 'enforce_multipath': True} {{(pid=81771) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 22 17:50:28 devstack sudo[83057]: pam_unix(sudo:session): session closed for user root Apr 22 17:50:28 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-ee2dc061-e595-40b0-ba00-f8ccd8e61dc4 tempest-VolumesAdminNegativeTest-1680575122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33" returned: 0 in 1.701s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:50:28 devstack cinder-volume[81771]: DEBUG cinder.manager [None req-ee2dc061-e595-40b0-ba00-f8ccd8e61dc4 tempest-VolumesAdminNegativeTest-1680575122 None] Notifying Schedulers of capabilities ... {{(pid=81771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 17:50:28 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-ee2dc061-e595-40b0-ba00-f8ccd8e61dc4 tempest-VolumesAdminNegativeTest-1680575122 None] Deleted volume successfully. Apr 22 17:50:28 devstack cinder-volume[81771]: INFO cinder.volume.manager [req-b37efae2-8c84-4ea8-ace0-aca0885ca04b req-7eecf4da-1a64-43fa-9655-8d94e010e0e7 tempest-DeleteServersTestJSON-2015012302 None] attachment_update completed successfully. Apr 22 17:50:28 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-ee2dc061-e595-40b0-ba00-f8ccd8e61dc4 tempest-VolumesAdminNegativeTest-1680575122 None] Lock "cinder-d8ad8230-0a48-48b4-a8f5-30f64643b8f8-delete_volume" released by "delete_volume" :: held 9.389s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:50:29 devstack cinder-volume[81771]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a994c51-cd41-42cd-a0e2-34d3f3de751a tempest-ServerRescueNegativeTestJSON-1761861628 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 17:50:29 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-7a994c51-cd41-42cd-a0e2-34d3f3de751a tempest-ServerRescueNegativeTestJSON-1761861628 None] Flow 'volume_create_manager' (065f2bba-a38d-4c6a-a177-ef788a7bc989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:50:29 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-7a994c51-cd41-42cd-a0e2-34d3f3de751a tempest-ServerRescueNegativeTestJSON-1761861628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0d28de7-b485-43a5-b4f5-20bd6b3d4557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:50:29 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-7a994c51-cd41-42cd-a0e2-34d3f3de751a tempest-ServerRescueNegativeTestJSON-1761861628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0d28de7-b485-43a5-b4f5-20bd6b3d4557) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:50:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-106137243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce795ae2-e493-4fde-b74e-ec59d0b420a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96cfee9f2eb84246b8a2461553926bc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:50:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:50:29Z,use_quota=True,user_id='dfd662714a814999b284b10ffd007aa7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:50:29 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-7a994c51-cd41-42cd-a0e2-34d3f3de751a tempest-ServerRescueNegativeTestJSON-1761861628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63767b60-8b2f-4670-90a6-ea87804e0e86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:50:29 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-7a994c51-cd41-42cd-a0e2-34d3f3de751a tempest-ServerRescueNegativeTestJSON-1761861628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63767b60-8b2f-4670-90a6-ea87804e0e86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:50:29 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-7a994c51-cd41-42cd-a0e2-34d3f3de751a tempest-ServerRescueNegativeTestJSON-1761861628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd25e083-6dd4-4b3c-9b37-6cd32354ef96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:50:29 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-7a994c51-cd41-42cd-a0e2-34d3f3de751a tempest-ServerRescueNegativeTestJSON-1761861628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd25e083-6dd4-4b3c-9b37-6cd32354ef96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce795ae2-e493-4fde-b74e-ec59d0b420a6', 'volume_name': 'volume-ce795ae2-e493-4fde-b74e-ec59d0b420a6', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:50:29 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-7a994c51-cd41-42cd-a0e2-34d3f3de751a tempest-ServerRescueNegativeTestJSON-1761861628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b427672c-2410-410a-9a83-65ab52f892f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:50:29 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-7a994c51-cd41-42cd-a0e2-34d3f3de751a tempest-ServerRescueNegativeTestJSON-1761861628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b427672c-2410-410a-9a83-65ab52f892f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:50:29 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-7a994c51-cd41-42cd-a0e2-34d3f3de751a tempest-ServerRescueNegativeTestJSON-1761861628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aeb9bb75-c424-4d41-ac2e-13c43d9accc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:50:29 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-7a994c51-cd41-42cd-a0e2-34d3f3de751a tempest-ServerRescueNegativeTestJSON-1761861628 None] Volume ce795ae2-e493-4fde-b74e-ec59d0b420a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce795ae2-e493-4fde-b74e-ec59d0b420a6', 'volume_size': 1} Apr 22 17:50:29 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-7a994c51-cd41-42cd-a0e2-34d3f3de751a tempest-ServerRescueNegativeTestJSON-1761861628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:50:29 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-7a994c51-cd41-42cd-a0e2-34d3f3de751a tempest-ServerRescueNegativeTestJSON-1761861628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:50:29 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-7a994c51-cd41-42cd-a0e2-34d3f3de751a tempest-ServerRescueNegativeTestJSON-1761861628 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:50:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-106137243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce795ae2-e493-4fde-b74e-ec59d0b420a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96cfee9f2eb84246b8a2461553926bc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:50:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:50:29Z,use_quota=True,user_id='dfd662714a814999b284b10ffd007aa7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)}" {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 17:50:29 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-7a994c51-cd41-42cd-a0e2-34d3f3de751a tempest-ServerRescueNegativeTestJSON-1761861628 None] Creating volume ce795ae2-e493-4fde-b74e-ec59d0b420a6 {{(pid=81771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 17:50:29 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-7a994c51-cd41-42cd-a0e2-34d3f3de751a tempest-ServerRescueNegativeTestJSON-1761861628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:50:29 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-7a994c51-cd41-42cd-a0e2-34d3f3de751a tempest-ServerRescueNegativeTestJSON-1761861628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:50:29 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-7a994c51-cd41-42cd-a0e2-34d3f3de751a tempest-ServerRescueNegativeTestJSON-1761861628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:50:29 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-7a994c51-cd41-42cd-a0e2-34d3f3de751a tempest-ServerRescueNegativeTestJSON-1761861628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:50:29 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-7a994c51-cd41-42cd-a0e2-34d3f3de751a tempest-ServerRescueNegativeTestJSON-1761861628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:50:29 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-7a994c51-cd41-42cd-a0e2-34d3f3de751a tempest-ServerRescueNegativeTestJSON-1761861628 None] Selected osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 as target Quobyte volume. {{(pid=81771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 17:50:29 devstack cinder-volume[81771]: INFO cinder.volume.drivers.remotefs [None req-7a994c51-cd41-42cd-a0e2-34d3f3de751a tempest-ServerRescueNegativeTestJSON-1761861628 None] casted to osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 Apr 22 17:50:29 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-7a994c51-cd41-42cd-a0e2-34d3f3de751a tempest-ServerRescueNegativeTestJSON-1761861628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-ce795ae2-e493-4fde-b74e-ec59d0b420a6 1073741824 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:50:29 devstack sudo[83164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-ce795ae2-e493-4fde-b74e-ec59d0b420a6 1073741824 Apr 22 17:50:29 devstack sudo[83164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:50:29 devstack cinder-volume[81771]: DEBUG oslo_service.periodic_task [None req-1a7bdab5-8190-4e00-a2e2-843e5894ab49 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81771) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 22 17:50:29 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-1a7bdab5-8190-4e00-a2e2-843e5894ab49 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:50:29 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-1a7bdab5-8190-4e00-a2e2-843e5894ab49 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:50:29 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-1a7bdab5-8190-4e00-a2e2-843e5894ab49 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:50:29 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-1a7bdab5-8190-4e00-a2e2-843e5894ab49 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:50:29 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-1a7bdab5-8190-4e00-a2e2-843e5894ab49 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:50:29 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-1a7bdab5-8190-4e00-a2e2-843e5894ab49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:50:29 devstack sudo[83166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 Apr 22 17:50:29 devstack sudo[83166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:50:30 devstack sudo[83164]: pam_unix(sudo:session): session closed for user root Apr 22 17:50:30 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-7a994c51-cd41-42cd-a0e2-34d3f3de751a tempest-ServerRescueNegativeTestJSON-1761861628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-ce795ae2-e493-4fde-b74e-ec59d0b420a6 1073741824" returned: 0 in 1.053s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:50:30 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-7a994c51-cd41-42cd-a0e2-34d3f3de751a tempest-ServerRescueNegativeTestJSON-1761861628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-ce795ae2-e493-4fde-b74e-ec59d0b420a6 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:50:30 devstack sudo[83492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-ce795ae2-e493-4fde-b74e-ec59d0b420a6 Apr 22 17:50:30 devstack sudo[83492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:50:31 devstack sudo[83166]: pam_unix(sudo:session): session closed for user root Apr 22 17:50:31 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-1a7bdab5-8190-4e00-a2e2-843e5894ab49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33" returned: 0 in 1.165s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:50:31 devstack cinder-volume[81771]: DEBUG cinder.manager [None req-1a7bdab5-8190-4e00-a2e2-843e5894ab49 None None] Notifying Schedulers of capabilities ... {{(pid=81771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 17:50:31 devstack sudo[83492]: pam_unix(sudo:session): session closed for user root Apr 22 17:50:31 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-7a994c51-cd41-42cd-a0e2-34d3f3de751a tempest-ServerRescueNegativeTestJSON-1761861628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-ce795ae2-e493-4fde-b74e-ec59d0b420a6" returned: 0 in 0.783s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:50:31 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-7a994c51-cd41-42cd-a0e2-34d3f3de751a tempest-ServerRescueNegativeTestJSON-1761861628 None] <== create_volume: return (1912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'} {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 17:50:31 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-7a994c51-cd41-42cd-a0e2-34d3f3de751a tempest-ServerRescueNegativeTestJSON-1761861628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.915s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:50:31 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-7a994c51-cd41-42cd-a0e2-34d3f3de751a tempest-ServerRescueNegativeTestJSON-1761861628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aeb9bb75-c424-4d41-ac2e-13c43d9accc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce795ae2-e493-4fde-b74e-ec59d0b420a6', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:50:31 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-7a994c51-cd41-42cd-a0e2-34d3f3de751a tempest-ServerRescueNegativeTestJSON-1761861628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a9b1573-b7f0-44da-ba6d-d3261ae9feda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:50:31 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-7a994c51-cd41-42cd-a0e2-34d3f3de751a tempest-ServerRescueNegativeTestJSON-1761861628 None] Volume volume-ce795ae2-e493-4fde-b74e-ec59d0b420a6 (ce795ae2-e493-4fde-b74e-ec59d0b420a6): created successfully Apr 22 17:50:31 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-7a994c51-cd41-42cd-a0e2-34d3f3de751a tempest-ServerRescueNegativeTestJSON-1761861628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a9b1573-b7f0-44da-ba6d-d3261ae9feda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:50:31 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-7a994c51-cd41-42cd-a0e2-34d3f3de751a tempest-ServerRescueNegativeTestJSON-1761861628 None] Flow 'volume_create_manager' (065f2bba-a38d-4c6a-a177-ef788a7bc989) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:50:31 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-7a994c51-cd41-42cd-a0e2-34d3f3de751a tempest-ServerRescueNegativeTestJSON-1761861628 None] Created volume successfully. Apr 22 17:50:39 devstack cinder-volume[81771]: INFO cinder.volume.manager [req-d425926f-df4d-4554-9e75-0e882de37df7 req-16ce9de5-b402-4f69-8c60-3521084cd8c0 tempest-DeleteServersTestJSON-2015012302 None] Terminate volume connection completed successfully. Apr 22 17:50:39 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [req-d425926f-df4d-4554-9e75-0e882de37df7 req-16ce9de5-b402-4f69-8c60-3521084cd8c0 tempest-DeleteServersTestJSON-2015012302 None] Deleting attachment c84ef61c-6b00-4fa3-8ac5-a23aaa3c41da. {{(pid=81771) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 22 17:50:43 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-52799e59-f55c-4d05-b5a2-079b065c38e5 tempest-DeleteServersTestJSON-2015012302 None] Acquiring lock "cinder-a737d05e-1720-4099-a88b-42c1cba0edf4-delete_volume" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:50:43 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-52799e59-f55c-4d05-b5a2-079b065c38e5 tempest-DeleteServersTestJSON-2015012302 None] Lock "cinder-a737d05e-1720-4099-a88b-42c1cba0edf4-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:50:43 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-52799e59-f55c-4d05-b5a2-079b065c38e5 tempest-DeleteServersTestJSON-2015012302 None] Acquiring lock "cinder-quobyte-a737d05e-1720-4099-a88b-42c1cba0edf4" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:50:43 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-52799e59-f55c-4d05-b5a2-079b065c38e5 tempest-DeleteServersTestJSON-2015012302 None] Lock "cinder-quobyte-a737d05e-1720-4099-a88b-42c1cba0edf4" acquired by "delete_volume" :: waited 0.019s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:50:44 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[aee84c3c-bf15-481d-a2b3-5fa6bce2fea8]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:50:44 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-52799e59-f55c-4d05-b5a2-079b065c38e5 tempest-DeleteServersTestJSON-2015012302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a737d05e-1720-4099-a88b-42c1cba0edf4 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:50:44 devstack sudo[83715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a737d05e-1720-4099-a88b-42c1cba0edf4 Apr 22 17:50:44 devstack sudo[83715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:50:44 devstack sudo[83715]: pam_unix(sudo:session): session closed for user root Apr 22 17:50:44 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-52799e59-f55c-4d05-b5a2-079b065c38e5 tempest-DeleteServersTestJSON-2015012302 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a737d05e-1720-4099-a88b-42c1cba0edf4" returned: 0 in 0.848s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:50:44 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-52799e59-f55c-4d05-b5a2-079b065c38e5 tempest-DeleteServersTestJSON-2015012302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a737d05e-1720-4099-a88b-42c1cba0edf4 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:50:44 devstack sudo[83736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a737d05e-1720-4099-a88b-42c1cba0edf4 Apr 22 17:50:44 devstack sudo[83736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:50:45 devstack sudo[83736]: pam_unix(sudo:session): session closed for user root Apr 22 17:50:45 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-52799e59-f55c-4d05-b5a2-079b065c38e5 tempest-DeleteServersTestJSON-2015012302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a737d05e-1720-4099-a88b-42c1cba0edf4" returned: 0 in 1.038s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:50:45 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-52799e59-f55c-4d05-b5a2-079b065c38e5 tempest-DeleteServersTestJSON-2015012302 None] Lock "cinder-quobyte-a737d05e-1720-4099-a88b-42c1cba0edf4" released by "delete_volume" :: held 1.966s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:50:46 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-52799e59-f55c-4d05-b5a2-079b065c38e5 tempest-DeleteServersTestJSON-2015012302 None] Created reservations ['a6f808ca-6557-4c67-ac2a-275eeea1d427', 'fc8673df-496d-4819-85f1-84ed216bcda0', 'f8778d46-0c57-4efc-899c-2c179e7feaa0', '629697fa-17e0-4b23-a5d6-0a5d7db74424'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 17:50:46 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-52799e59-f55c-4d05-b5a2-079b065c38e5 tempest-DeleteServersTestJSON-2015012302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:50:46 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-52799e59-f55c-4d05-b5a2-079b065c38e5 tempest-DeleteServersTestJSON-2015012302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:50:46 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-52799e59-f55c-4d05-b5a2-079b065c38e5 tempest-DeleteServersTestJSON-2015012302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:50:46 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-52799e59-f55c-4d05-b5a2-079b065c38e5 tempest-DeleteServersTestJSON-2015012302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:50:46 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-52799e59-f55c-4d05-b5a2-079b065c38e5 tempest-DeleteServersTestJSON-2015012302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:50:46 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-52799e59-f55c-4d05-b5a2-079b065c38e5 tempest-DeleteServersTestJSON-2015012302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:50:46 devstack sudo[83746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 Apr 22 17:50:46 devstack sudo[83746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:50:47 devstack sudo[83746]: pam_unix(sudo:session): session closed for user root Apr 22 17:50:47 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-52799e59-f55c-4d05-b5a2-079b065c38e5 tempest-DeleteServersTestJSON-2015012302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33" returned: 0 in 0.918s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:50:47 devstack cinder-volume[81771]: DEBUG cinder.manager [None req-52799e59-f55c-4d05-b5a2-079b065c38e5 tempest-DeleteServersTestJSON-2015012302 None] Notifying Schedulers of capabilities ... {{(pid=81771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 17:50:47 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-52799e59-f55c-4d05-b5a2-079b065c38e5 tempest-DeleteServersTestJSON-2015012302 None] Deleted volume successfully. Apr 22 17:50:47 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-52799e59-f55c-4d05-b5a2-079b065c38e5 tempest-DeleteServersTestJSON-2015012302 None] Lock "cinder-a737d05e-1720-4099-a88b-42c1cba0edf4-delete_volume" released by "delete_volume" :: held 3.414s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:50:56 devstack cinder-volume[81771]: DEBUG dbcounter [-] [81771] Writing DB stats cinder:UPDATE=23,cinder:SELECT=26,cinder:DELETE=1,cinder:INSERT=9 {{(pid=81771) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 22 17:50:57 devstack cinder-volume[81771]: DEBUG dbcounter [-] [81771] Writing DB stats cinder:SELECT=20,cinder:UPDATE=31,cinder:INSERT=2,cinder:DELETE=4 {{(pid=81771) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 22 17:51:02 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-1673f0a2-9d5d-4164-be57-e95bd880c047 tempest-ServerRescueNegativeTestJSON-1761861628 None] Acquiring lock "cinder-ce795ae2-e493-4fde-b74e-ec59d0b420a6-delete_volume" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:51:02 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-1673f0a2-9d5d-4164-be57-e95bd880c047 tempest-ServerRescueNegativeTestJSON-1761861628 None] Lock "cinder-ce795ae2-e493-4fde-b74e-ec59d0b420a6-delete_volume" acquired by "delete_volume" :: waited 0.101s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:51:02 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-1673f0a2-9d5d-4164-be57-e95bd880c047 tempest-ServerRescueNegativeTestJSON-1761861628 None] Acquiring lock "cinder-quobyte-ce795ae2-e493-4fde-b74e-ec59d0b420a6" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:51:02 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-1673f0a2-9d5d-4164-be57-e95bd880c047 tempest-ServerRescueNegativeTestJSON-1761861628 None] Lock "cinder-quobyte-ce795ae2-e493-4fde-b74e-ec59d0b420a6" acquired by "delete_volume" :: waited 0.043s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:51:02 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[3709ce46-724b-4b47-829c-a51d6c7c5209]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:51:02 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-1673f0a2-9d5d-4164-be57-e95bd880c047 tempest-ServerRescueNegativeTestJSON-1761861628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-ce795ae2-e493-4fde-b74e-ec59d0b420a6 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:51:03 devstack sudo[83952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-ce795ae2-e493-4fde-b74e-ec59d0b420a6 Apr 22 17:51:03 devstack sudo[83952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:51:03 devstack cinder-volume[81771]: DEBUG cinder.volume.flows.manager.create_volume [req-8c2ca36c-68e5-4447-b795-22ed16aaec43 req-84c8048c-781c-494c-b3c7-f9f73bde0c87 tempest-VolumesSnapshotsTestJSON-1647801802 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 17:51:03 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [req-8c2ca36c-68e5-4447-b795-22ed16aaec43 req-84c8048c-781c-494c-b3c7-f9f73bde0c87 tempest-VolumesSnapshotsTestJSON-1647801802 None] Flow 'volume_create_manager' (1cd556b1-ab81-4970-bf1b-1ff1fe065ee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:51:03 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [req-8c2ca36c-68e5-4447-b795-22ed16aaec43 req-84c8048c-781c-494c-b3c7-f9f73bde0c87 tempest-VolumesSnapshotsTestJSON-1647801802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8b07763-6901-425e-bf09-d19e5494e472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:51:03 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [req-8c2ca36c-68e5-4447-b795-22ed16aaec43 req-84c8048c-781c-494c-b3c7-f9f73bde0c87 tempest-VolumesSnapshotsTestJSON-1647801802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8b07763-6901-425e-bf09-d19e5494e472) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:51:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-2145084535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6e76e79-16d9-4f0c-8651-76f50427a1de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='786d096d079448b0b3db8c39f228df89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:51:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:51:04Z,use_quota=True,user_id='84a9f1260551429b938ec2d64fef09d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:51:03 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [req-8c2ca36c-68e5-4447-b795-22ed16aaec43 req-84c8048c-781c-494c-b3c7-f9f73bde0c87 tempest-VolumesSnapshotsTestJSON-1647801802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7ac853b-6554-48d4-84ce-89f935b9b344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:51:03 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [req-8c2ca36c-68e5-4447-b795-22ed16aaec43 req-84c8048c-781c-494c-b3c7-f9f73bde0c87 tempest-VolumesSnapshotsTestJSON-1647801802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7ac853b-6554-48d4-84ce-89f935b9b344) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:51:03 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [req-8c2ca36c-68e5-4447-b795-22ed16aaec43 req-84c8048c-781c-494c-b3c7-f9f73bde0c87 tempest-VolumesSnapshotsTestJSON-1647801802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99f987e7-4736-4276-8c48-a9c6dbe7a517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:51:03 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [req-8c2ca36c-68e5-4447-b795-22ed16aaec43 req-84c8048c-781c-494c-b3c7-f9f73bde0c87 tempest-VolumesSnapshotsTestJSON-1647801802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99f987e7-4736-4276-8c48-a9c6dbe7a517) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6e76e79-16d9-4f0c-8651-76f50427a1de', 'volume_name': 'volume-c6e76e79-16d9-4f0c-8651-76f50427a1de', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:51:03 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [req-8c2ca36c-68e5-4447-b795-22ed16aaec43 req-84c8048c-781c-494c-b3c7-f9f73bde0c87 tempest-VolumesSnapshotsTestJSON-1647801802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be045183-5518-4d35-8af5-64aa5f0a665c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:51:03 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [req-8c2ca36c-68e5-4447-b795-22ed16aaec43 req-84c8048c-781c-494c-b3c7-f9f73bde0c87 tempest-VolumesSnapshotsTestJSON-1647801802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be045183-5518-4d35-8af5-64aa5f0a665c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:51:03 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [req-8c2ca36c-68e5-4447-b795-22ed16aaec43 req-84c8048c-781c-494c-b3c7-f9f73bde0c87 tempest-VolumesSnapshotsTestJSON-1647801802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae446a84-eb19-454d-aebd-2a064926c76e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:51:03 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [req-8c2ca36c-68e5-4447-b795-22ed16aaec43 req-84c8048c-781c-494c-b3c7-f9f73bde0c87 tempest-VolumesSnapshotsTestJSON-1647801802 None] Volume c6e76e79-16d9-4f0c-8651-76f50427a1de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6e76e79-16d9-4f0c-8651-76f50427a1de', 'volume_size': 1} Apr 22 17:51:03 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [req-8c2ca36c-68e5-4447-b795-22ed16aaec43 req-84c8048c-781c-494c-b3c7-f9f73bde0c87 tempest-VolumesSnapshotsTestJSON-1647801802 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:51:03 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [req-8c2ca36c-68e5-4447-b795-22ed16aaec43 req-84c8048c-781c-494c-b3c7-f9f73bde0c87 tempest-VolumesSnapshotsTestJSON-1647801802 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:51:03 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [req-8c2ca36c-68e5-4447-b795-22ed16aaec43 req-84c8048c-781c-494c-b3c7-f9f73bde0c87 tempest-VolumesSnapshotsTestJSON-1647801802 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:51:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-2145084535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6e76e79-16d9-4f0c-8651-76f50427a1de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='786d096d079448b0b3db8c39f228df89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:51:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:51:04Z,use_quota=True,user_id='84a9f1260551429b938ec2d64fef09d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)}" {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 17:51:03 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [req-8c2ca36c-68e5-4447-b795-22ed16aaec43 req-84c8048c-781c-494c-b3c7-f9f73bde0c87 tempest-VolumesSnapshotsTestJSON-1647801802 None] Creating volume c6e76e79-16d9-4f0c-8651-76f50427a1de {{(pid=81771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 17:51:03 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [req-8c2ca36c-68e5-4447-b795-22ed16aaec43 req-84c8048c-781c-494c-b3c7-f9f73bde0c87 tempest-VolumesSnapshotsTestJSON-1647801802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:51:03 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [req-8c2ca36c-68e5-4447-b795-22ed16aaec43 req-84c8048c-781c-494c-b3c7-f9f73bde0c87 tempest-VolumesSnapshotsTestJSON-1647801802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:51:03 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [req-8c2ca36c-68e5-4447-b795-22ed16aaec43 req-84c8048c-781c-494c-b3c7-f9f73bde0c87 tempest-VolumesSnapshotsTestJSON-1647801802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:51:03 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [req-8c2ca36c-68e5-4447-b795-22ed16aaec43 req-84c8048c-781c-494c-b3c7-f9f73bde0c87 tempest-VolumesSnapshotsTestJSON-1647801802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:51:03 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [req-8c2ca36c-68e5-4447-b795-22ed16aaec43 req-84c8048c-781c-494c-b3c7-f9f73bde0c87 tempest-VolumesSnapshotsTestJSON-1647801802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:51:03 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [req-8c2ca36c-68e5-4447-b795-22ed16aaec43 req-84c8048c-781c-494c-b3c7-f9f73bde0c87 tempest-VolumesSnapshotsTestJSON-1647801802 None] Selected osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 as target Quobyte volume. {{(pid=81771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 17:51:03 devstack cinder-volume[81771]: INFO cinder.volume.drivers.remotefs [req-8c2ca36c-68e5-4447-b795-22ed16aaec43 req-84c8048c-781c-494c-b3c7-f9f73bde0c87 tempest-VolumesSnapshotsTestJSON-1647801802 None] casted to osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 Apr 22 17:51:03 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [req-8c2ca36c-68e5-4447-b795-22ed16aaec43 req-84c8048c-781c-494c-b3c7-f9f73bde0c87 tempest-VolumesSnapshotsTestJSON-1647801802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-c6e76e79-16d9-4f0c-8651-76f50427a1de 1073741824 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:51:03 devstack sudo[83965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-c6e76e79-16d9-4f0c-8651-76f50427a1de 1073741824 Apr 22 17:51:03 devstack sudo[83965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:51:04 devstack sudo[83952]: pam_unix(sudo:session): session closed for user root Apr 22 17:51:04 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-1673f0a2-9d5d-4164-be57-e95bd880c047 tempest-ServerRescueNegativeTestJSON-1761861628 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-ce795ae2-e493-4fde-b74e-ec59d0b420a6" returned: 0 in 1.555s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:51:04 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-1673f0a2-9d5d-4164-be57-e95bd880c047 tempest-ServerRescueNegativeTestJSON-1761861628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-ce795ae2-e493-4fde-b74e-ec59d0b420a6 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:51:04 devstack sudo[83970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-ce795ae2-e493-4fde-b74e-ec59d0b420a6 Apr 22 17:51:04 devstack sudo[83970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:51:05 devstack sudo[83965]: pam_unix(sudo:session): session closed for user root Apr 22 17:51:05 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [req-8c2ca36c-68e5-4447-b795-22ed16aaec43 req-84c8048c-781c-494c-b3c7-f9f73bde0c87 tempest-VolumesSnapshotsTestJSON-1647801802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-c6e76e79-16d9-4f0c-8651-76f50427a1de 1073741824" returned: 0 in 1.778s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:51:05 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [req-8c2ca36c-68e5-4447-b795-22ed16aaec43 req-84c8048c-781c-494c-b3c7-f9f73bde0c87 tempest-VolumesSnapshotsTestJSON-1647801802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-c6e76e79-16d9-4f0c-8651-76f50427a1de {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:51:05 devstack sudo[83970]: pam_unix(sudo:session): session closed for user root Apr 22 17:51:05 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-1673f0a2-9d5d-4164-be57-e95bd880c047 tempest-ServerRescueNegativeTestJSON-1761861628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-ce795ae2-e493-4fde-b74e-ec59d0b420a6" returned: 0 in 1.152s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:51:05 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-1673f0a2-9d5d-4164-be57-e95bd880c047 tempest-ServerRescueNegativeTestJSON-1761861628 None] Lock "cinder-quobyte-ce795ae2-e493-4fde-b74e-ec59d0b420a6" released by "delete_volume" :: held 2.816s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:51:05 devstack sudo[84002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-c6e76e79-16d9-4f0c-8651-76f50427a1de Apr 22 17:51:05 devstack sudo[84002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:51:05 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-1673f0a2-9d5d-4164-be57-e95bd880c047 tempest-ServerRescueNegativeTestJSON-1761861628 None] Created reservations ['c84038e2-80c2-4c1e-a02e-027c7d0bf91f', 'd2857b10-95ae-4c17-9931-8f6202ceeab2', '1c166594-d5c3-4eed-bebd-13a193d97e23', '84d50be6-6486-4d04-8f4b-da1ce06f0a16'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 17:51:05 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-1673f0a2-9d5d-4164-be57-e95bd880c047 tempest-ServerRescueNegativeTestJSON-1761861628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:51:05 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-1673f0a2-9d5d-4164-be57-e95bd880c047 tempest-ServerRescueNegativeTestJSON-1761861628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:51:05 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-1673f0a2-9d5d-4164-be57-e95bd880c047 tempest-ServerRescueNegativeTestJSON-1761861628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:51:05 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-1673f0a2-9d5d-4164-be57-e95bd880c047 tempest-ServerRescueNegativeTestJSON-1761861628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:51:05 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-1673f0a2-9d5d-4164-be57-e95bd880c047 tempest-ServerRescueNegativeTestJSON-1761861628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:51:05 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-1673f0a2-9d5d-4164-be57-e95bd880c047 tempest-ServerRescueNegativeTestJSON-1761861628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:51:06 devstack sudo[84004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 Apr 22 17:51:06 devstack sudo[84004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:51:07 devstack sudo[84002]: pam_unix(sudo:session): session closed for user root Apr 22 17:51:07 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [req-8c2ca36c-68e5-4447-b795-22ed16aaec43 req-84c8048c-781c-494c-b3c7-f9f73bde0c87 tempest-VolumesSnapshotsTestJSON-1647801802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-c6e76e79-16d9-4f0c-8651-76f50427a1de" returned: 0 in 1.716s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:51:07 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [req-8c2ca36c-68e5-4447-b795-22ed16aaec43 req-84c8048c-781c-494c-b3c7-f9f73bde0c87 tempest-VolumesSnapshotsTestJSON-1647801802 None] <== create_volume: return (3578ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'} {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 17:51:07 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [req-8c2ca36c-68e5-4447-b795-22ed16aaec43 req-84c8048c-781c-494c-b3c7-f9f73bde0c87 tempest-VolumesSnapshotsTestJSON-1647801802 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.581s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:51:07 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [req-8c2ca36c-68e5-4447-b795-22ed16aaec43 req-84c8048c-781c-494c-b3c7-f9f73bde0c87 tempest-VolumesSnapshotsTestJSON-1647801802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae446a84-eb19-454d-aebd-2a064926c76e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6e76e79-16d9-4f0c-8651-76f50427a1de', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:51:07 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [req-8c2ca36c-68e5-4447-b795-22ed16aaec43 req-84c8048c-781c-494c-b3c7-f9f73bde0c87 tempest-VolumesSnapshotsTestJSON-1647801802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54db7223-5f3b-4d18-b4c5-3a1aee9679f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:51:07 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [req-8c2ca36c-68e5-4447-b795-22ed16aaec43 req-84c8048c-781c-494c-b3c7-f9f73bde0c87 tempest-VolumesSnapshotsTestJSON-1647801802 None] Volume volume-c6e76e79-16d9-4f0c-8651-76f50427a1de (c6e76e79-16d9-4f0c-8651-76f50427a1de): created successfully Apr 22 17:51:07 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [req-8c2ca36c-68e5-4447-b795-22ed16aaec43 req-84c8048c-781c-494c-b3c7-f9f73bde0c87 tempest-VolumesSnapshotsTestJSON-1647801802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54db7223-5f3b-4d18-b4c5-3a1aee9679f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:51:07 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [req-8c2ca36c-68e5-4447-b795-22ed16aaec43 req-84c8048c-781c-494c-b3c7-f9f73bde0c87 tempest-VolumesSnapshotsTestJSON-1647801802 None] Flow 'volume_create_manager' (1cd556b1-ab81-4970-bf1b-1ff1fe065ee5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:51:07 devstack cinder-volume[81771]: INFO cinder.volume.manager [req-8c2ca36c-68e5-4447-b795-22ed16aaec43 req-84c8048c-781c-494c-b3c7-f9f73bde0c87 tempest-VolumesSnapshotsTestJSON-1647801802 None] Created volume successfully. Apr 22 17:51:07 devstack sudo[84004]: pam_unix(sudo:session): session closed for user root Apr 22 17:51:07 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-1673f0a2-9d5d-4164-be57-e95bd880c047 tempest-ServerRescueNegativeTestJSON-1761861628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33" returned: 0 in 1.615s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:51:07 devstack cinder-volume[81771]: DEBUG cinder.manager [None req-1673f0a2-9d5d-4164-be57-e95bd880c047 tempest-ServerRescueNegativeTestJSON-1761861628 None] Notifying Schedulers of capabilities ... {{(pid=81771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 17:51:07 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-1673f0a2-9d5d-4164-be57-e95bd880c047 tempest-ServerRescueNegativeTestJSON-1761861628 None] Deleted volume successfully. Apr 22 17:51:07 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-1673f0a2-9d5d-4164-be57-e95bd880c047 tempest-ServerRescueNegativeTestJSON-1761861628 None] Lock "cinder-ce795ae2-e493-4fde-b74e-ec59d0b420a6-delete_volume" released by "delete_volume" :: held 4.962s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:51:09 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [req-e3622a0f-bfb7-43ac-bca9-3e44da4e853e req-e06d3193-a1d2-433b-b282-10c82e09d973 tempest-VolumesSnapshotsTestJSON-1647801802 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:51:09 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [req-e3622a0f-bfb7-43ac-bca9-3e44da4e853e req-e06d3193-a1d2-433b-b282-10c82e09d973 tempest-VolumesSnapshotsTestJSON-1647801802 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:51:09 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [req-e3622a0f-bfb7-43ac-bca9-3e44da4e853e req-e06d3193-a1d2-433b-b282-10c82e09d973 tempest-VolumesSnapshotsTestJSON-1647801802 None] Creating offline snapshot fa0c9f17-56d9-4556-8b84-e73b03e81b8e of volume c6e76e79-16d9-4f0c-8651-76f50427a1de {{(pid=81771) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 22 17:51:09 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d470df0-36e9-4833-b815-ad15a09c196b]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:51:09 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [req-e3622a0f-bfb7-43ac-bca9-3e44da4e853e req-e06d3193-a1d2-433b-b282-10c82e09d973 tempest-VolumesSnapshotsTestJSON-1647801802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-c6e76e79-16d9-4f0c-8651-76f50427a1de {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:51:09 devstack sudo[84039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-c6e76e79-16d9-4f0c-8651-76f50427a1de Apr 22 17:51:09 devstack sudo[84039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:51:10 devstack sudo[84039]: pam_unix(sudo:session): session closed for user root Apr 22 17:51:10 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [req-e3622a0f-bfb7-43ac-bca9-3e44da4e853e req-e06d3193-a1d2-433b-b282-10c82e09d973 tempest-VolumesSnapshotsTestJSON-1647801802 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-c6e76e79-16d9-4f0c-8651-76f50427a1de" returned: 0 in 1.075s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:51:10 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [req-e3622a0f-bfb7-43ac-bca9-3e44da4e853e req-e06d3193-a1d2-433b-b282-10c82e09d973 tempest-VolumesSnapshotsTestJSON-1647801802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-c6e76e79-16d9-4f0c-8651-76f50427a1de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-c6e76e79-16d9-4f0c-8651-76f50427a1de.fa0c9f17-56d9-4556-8b84-e73b03e81b8e 1G {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:51:10 devstack sudo[84045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-c6e76e79-16d9-4f0c-8651-76f50427a1de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-c6e76e79-16d9-4f0c-8651-76f50427a1de.fa0c9f17-56d9-4556-8b84-e73b03e81b8e 1G Apr 22 17:51:10 devstack sudo[84045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:51:11 devstack sudo[84045]: pam_unix(sudo:session): session closed for user root Apr 22 17:51:11 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [req-e3622a0f-bfb7-43ac-bca9-3e44da4e853e req-e06d3193-a1d2-433b-b282-10c82e09d973 tempest-VolumesSnapshotsTestJSON-1647801802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-c6e76e79-16d9-4f0c-8651-76f50427a1de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-c6e76e79-16d9-4f0c-8651-76f50427a1de.fa0c9f17-56d9-4556-8b84-e73b03e81b8e 1G" returned: 0 in 0.892s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:51:11 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [req-e3622a0f-bfb7-43ac-bca9-3e44da4e853e req-e06d3193-a1d2-433b-b282-10c82e09d973 tempest-VolumesSnapshotsTestJSON-1647801802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6e76e79-16d9-4f0c-8651-76f50427a1de -F qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-c6e76e79-16d9-4f0c-8651-76f50427a1de.fa0c9f17-56d9-4556-8b84-e73b03e81b8e {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:51:11 devstack sudo[84052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6e76e79-16d9-4f0c-8651-76f50427a1de -F qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-c6e76e79-16d9-4f0c-8651-76f50427a1de.fa0c9f17-56d9-4556-8b84-e73b03e81b8e Apr 22 17:51:11 devstack sudo[84052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:51:12 devstack sudo[84052]: pam_unix(sudo:session): session closed for user root Apr 22 17:51:12 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [req-e3622a0f-bfb7-43ac-bca9-3e44da4e853e req-e06d3193-a1d2-433b-b282-10c82e09d973 tempest-VolumesSnapshotsTestJSON-1647801802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6e76e79-16d9-4f0c-8651-76f50427a1de -F qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-c6e76e79-16d9-4f0c-8651-76f50427a1de.fa0c9f17-56d9-4556-8b84-e73b03e81b8e" returned: 0 in 1.019s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:51:12 devstack cinder-volume[81771]: WARNING cinder.volume.drivers.remotefs [req-e3622a0f-bfb7-43ac-bca9-3e44da4e853e req-e06d3193-a1d2-433b-b282-10c82e09d973 tempest-VolumesSnapshotsTestJSON-1647801802 None] /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-c6e76e79-16d9-4f0c-8651-76f50427a1de.fa0c9f17-56d9-4556-8b84-e73b03e81b8e is being set with open permissions: ugo+rw Apr 22 17:51:12 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [req-e3622a0f-bfb7-43ac-bca9-3e44da4e853e req-e06d3193-a1d2-433b-b282-10c82e09d973 tempest-VolumesSnapshotsTestJSON-1647801802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-c6e76e79-16d9-4f0c-8651-76f50427a1de.fa0c9f17-56d9-4556-8b84-e73b03e81b8e {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:51:12 devstack sudo[84061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-c6e76e79-16d9-4f0c-8651-76f50427a1de.fa0c9f17-56d9-4556-8b84-e73b03e81b8e Apr 22 17:51:12 devstack sudo[84061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:51:13 devstack sudo[84061]: pam_unix(sudo:session): session closed for user root Apr 22 17:51:13 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [req-e3622a0f-bfb7-43ac-bca9-3e44da4e853e req-e06d3193-a1d2-433b-b282-10c82e09d973 tempest-VolumesSnapshotsTestJSON-1647801802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-c6e76e79-16d9-4f0c-8651-76f50427a1de.fa0c9f17-56d9-4556-8b84-e73b03e81b8e" returned: 0 in 0.963s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:51:13 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [req-e3622a0f-bfb7-43ac-bca9-3e44da4e853e req-e06d3193-a1d2-433b-b282-10c82e09d973 tempest-VolumesSnapshotsTestJSON-1647801802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-c6e76e79-16d9-4f0c-8651-76f50427a1de.info {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:51:13 devstack sudo[84067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-c6e76e79-16d9-4f0c-8651-76f50427a1de.info Apr 22 17:51:13 devstack sudo[84067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:51:13 devstack sudo[84067]: pam_unix(sudo:session): session closed for user root Apr 22 17:51:13 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [req-e3622a0f-bfb7-43ac-bca9-3e44da4e853e req-e06d3193-a1d2-433b-b282-10c82e09d973 tempest-VolumesSnapshotsTestJSON-1647801802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-c6e76e79-16d9-4f0c-8651-76f50427a1de.info" returned: 0 in 0.576s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:51:13 devstack cinder-volume[81771]: WARNING cinder.volume.drivers.remotefs [req-e3622a0f-bfb7-43ac-bca9-3e44da4e853e req-e06d3193-a1d2-433b-b282-10c82e09d973 tempest-VolumesSnapshotsTestJSON-1647801802 None] /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-c6e76e79-16d9-4f0c-8651-76f50427a1de.info is being set with open permissions: ugo+rw Apr 22 17:51:13 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [req-e3622a0f-bfb7-43ac-bca9-3e44da4e853e req-e06d3193-a1d2-433b-b282-10c82e09d973 tempest-VolumesSnapshotsTestJSON-1647801802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-c6e76e79-16d9-4f0c-8651-76f50427a1de.info {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:51:13 devstack sudo[84071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-c6e76e79-16d9-4f0c-8651-76f50427a1de.info Apr 22 17:51:13 devstack sudo[84071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:51:14 devstack sudo[84071]: pam_unix(sudo:session): session closed for user root Apr 22 17:51:14 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [req-e3622a0f-bfb7-43ac-bca9-3e44da4e853e req-e06d3193-a1d2-433b-b282-10c82e09d973 tempest-VolumesSnapshotsTestJSON-1647801802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-c6e76e79-16d9-4f0c-8651-76f50427a1de.info" returned: 0 in 0.879s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:51:14 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [req-e3622a0f-bfb7-43ac-bca9-3e44da4e853e req-e06d3193-a1d2-433b-b282-10c82e09d973 tempest-VolumesSnapshotsTestJSON-1647801802 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.523s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:51:14 devstack cinder-volume[81771]: INFO cinder.volume.manager [req-e3622a0f-bfb7-43ac-bca9-3e44da4e853e req-e06d3193-a1d2-433b-b282-10c82e09d973 tempest-VolumesSnapshotsTestJSON-1647801802 None] Create snapshot completed successfully Apr 22 17:51:15 devstack cinder-volume[81771]: DEBUG cinder.coordination [req-23a6cfd9-d39a-4f00-a8d1-32bb1b1631ec req-c46c071e-0354-4a59-8e7a-40c94bad7b3a tempest-VolumesSnapshotsTestJSON-1647801802 None] Acquiring lock "cinder-fa0c9f17-56d9-4556-8b84-e73b03e81b8e-delete_snapshot" by "delete_snapshot" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:51:15 devstack cinder-volume[81771]: DEBUG cinder.coordination [req-23a6cfd9-d39a-4f00-a8d1-32bb1b1631ec req-c46c071e-0354-4a59-8e7a-40c94bad7b3a tempest-VolumesSnapshotsTestJSON-1647801802 None] Lock "cinder-fa0c9f17-56d9-4556-8b84-e73b03e81b8e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:51:15 devstack cinder-volume[81771]: DEBUG cinder.coordination [req-23a6cfd9-d39a-4f00-a8d1-32bb1b1631ec req-c46c071e-0354-4a59-8e7a-40c94bad7b3a tempest-VolumesSnapshotsTestJSON-1647801802 None] Acquiring lock "cinder-quobyte-c6e76e79-16d9-4f0c-8651-76f50427a1de" by "delete_snapshot" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:51:15 devstack cinder-volume[81771]: DEBUG cinder.coordination [req-23a6cfd9-d39a-4f00-a8d1-32bb1b1631ec req-c46c071e-0354-4a59-8e7a-40c94bad7b3a tempest-VolumesSnapshotsTestJSON-1647801802 None] Lock "cinder-quobyte-c6e76e79-16d9-4f0c-8651-76f50427a1de" acquired by "delete_snapshot" :: waited 0.018s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:51:15 devstack cinder-volume[81771]: DEBUG cinder.coordination [req-23a6cfd9-d39a-4f00-a8d1-32bb1b1631ec req-c46c071e-0354-4a59-8e7a-40c94bad7b3a tempest-VolumesSnapshotsTestJSON-1647801802 None] Acquiring lock "cinder-quobyte-fa0c9f17-56d9-4556-8b84-e73b03e81b8e" by "_delete_snapshot" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:51:15 devstack cinder-volume[81771]: DEBUG cinder.coordination [req-23a6cfd9-d39a-4f00-a8d1-32bb1b1631ec req-c46c071e-0354-4a59-8e7a-40c94bad7b3a tempest-VolumesSnapshotsTestJSON-1647801802 None] Lock "cinder-quobyte-fa0c9f17-56d9-4556-8b84-e73b03e81b8e" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:51:15 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [req-23a6cfd9-d39a-4f00-a8d1-32bb1b1631ec req-c46c071e-0354-4a59-8e7a-40c94bad7b3a tempest-VolumesSnapshotsTestJSON-1647801802 None] Deleting offline snapshot fa0c9f17-56d9-4556-8b84-e73b03e81b8e of volume c6e76e79-16d9-4f0c-8651-76f50427a1de {{(pid=81771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 22 17:51:15 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [req-23a6cfd9-d39a-4f00-a8d1-32bb1b1631ec req-c46c071e-0354-4a59-8e7a-40c94bad7b3a tempest-VolumesSnapshotsTestJSON-1647801802 None] snapshot_file for this snap is: volume-c6e76e79-16d9-4f0c-8651-76f50427a1de.fa0c9f17-56d9-4556-8b84-e73b03e81b8e {{(pid=81771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 22 17:51:15 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a20b748-4ab3-4f1e-9897-fdaa355d42e4]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:51:15 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [req-23a6cfd9-d39a-4f00-a8d1-32bb1b1631ec req-c46c071e-0354-4a59-8e7a-40c94bad7b3a tempest-VolumesSnapshotsTestJSON-1647801802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-c6e76e79-16d9-4f0c-8651-76f50427a1de.fa0c9f17-56d9-4556-8b84-e73b03e81b8e {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:51:15 devstack sudo[84075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-c6e76e79-16d9-4f0c-8651-76f50427a1de.fa0c9f17-56d9-4556-8b84-e73b03e81b8e Apr 22 17:51:15 devstack sudo[84075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:51:15 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-750549ca-2d3e-4a71-ab60-b61c809a89c8 tempest-GroupsV314Test-1716709815 None] Group tempest-GroupsV314Test-Group-1448947952: creating Apr 22 17:51:15 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-750549ca-2d3e-4a71-ab60-b61c809a89c8 tempest-GroupsV314Test-1716709815 None] Group tempest-GroupsV314Test-Group-1448947952: created successfully Apr 22 17:51:15 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-750549ca-2d3e-4a71-ab60-b61c809a89c8 tempest-GroupsV314Test-1716709815 None] Create group completed successfully. Apr 22 17:51:15 devstack sudo[84075]: pam_unix(sudo:session): session closed for user root Apr 22 17:51:15 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [req-23a6cfd9-d39a-4f00-a8d1-32bb1b1631ec req-c46c071e-0354-4a59-8e7a-40c94bad7b3a tempest-VolumesSnapshotsTestJSON-1647801802 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-c6e76e79-16d9-4f0c-8651-76f50427a1de.fa0c9f17-56d9-4556-8b84-e73b03e81b8e" returned: 0 in 0.668s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:51:15 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [req-23a6cfd9-d39a-4f00-a8d1-32bb1b1631ec req-c46c071e-0354-4a59-8e7a-40c94bad7b3a tempest-VolumesSnapshotsTestJSON-1647801802 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c6e76e79-16d9-4f0c-8651-76f50427a1de(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81771) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 22 17:51:15 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[879527b4-5b21-44df-9c9c-9d0a09f6d9b8]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:51:15 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [req-23a6cfd9-d39a-4f00-a8d1-32bb1b1631ec req-c46c071e-0354-4a59-8e7a-40c94bad7b3a tempest-VolumesSnapshotsTestJSON-1647801802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-c6e76e79-16d9-4f0c-8651-76f50427a1de {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:51:15 devstack sudo[84107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-c6e76e79-16d9-4f0c-8651-76f50427a1de Apr 22 17:51:16 devstack sudo[84107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:51:16 devstack sudo[84107]: pam_unix(sudo:session): session closed for user root Apr 22 17:51:16 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [req-23a6cfd9-d39a-4f00-a8d1-32bb1b1631ec req-c46c071e-0354-4a59-8e7a-40c94bad7b3a tempest-VolumesSnapshotsTestJSON-1647801802 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-c6e76e79-16d9-4f0c-8651-76f50427a1de" returned: 0 in 0.710s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:51:16 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [req-23a6cfd9-d39a-4f00-a8d1-32bb1b1631ec req-c46c071e-0354-4a59-8e7a-40c94bad7b3a tempest-VolumesSnapshotsTestJSON-1647801802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-c6e76e79-16d9-4f0c-8651-76f50427a1de.fa0c9f17-56d9-4556-8b84-e73b03e81b8e {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:51:16 devstack sudo[84115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-c6e76e79-16d9-4f0c-8651-76f50427a1de.fa0c9f17-56d9-4556-8b84-e73b03e81b8e Apr 22 17:51:16 devstack sudo[84115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:51:17 devstack cinder-volume[81771]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4e1d1cc-77c5-4714-a754-cab0bbd70da0 tempest-GroupsV314Test-1716709815 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 17:51:17 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-a4e1d1cc-77c5-4714-a754-cab0bbd70da0 tempest-GroupsV314Test-1716709815 None] Flow 'volume_create_manager' (44071d5a-ddf6-4b82-891c-ab74ca4fdbd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:51:17 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-a4e1d1cc-77c5-4714-a754-cab0bbd70da0 tempest-GroupsV314Test-1716709815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78068289-b52a-4d55-a9b6-27f9fc343c88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:51:17 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-a4e1d1cc-77c5-4714-a754-cab0bbd70da0 tempest-GroupsV314Test-1716709815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78068289-b52a-4d55-a9b6-27f9fc343c88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:51:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2076601154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d7ecc7bc-8726-4c2d-9f75-b1a095a56971,host='devstack@QuobyteHD#QuobyteHD',id=b406e226-fea3-474c-ac0b-de22c6f77255,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34626a0f920541bdb579d73791df51f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:51:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:51:17Z,use_quota=True,user_id='fe2dd0d2b51c481096c50e0092436e71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f578ca5b-b94c-4920-b755-c29f3a9dfb31),volume_type_id=f578ca5b-b94c-4920-b755-c29f3a9dfb31)' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:51:17 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-a4e1d1cc-77c5-4714-a754-cab0bbd70da0 tempest-GroupsV314Test-1716709815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7767f4d8-be89-4704-887c-8444ef7e1c4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:51:17 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-a4e1d1cc-77c5-4714-a754-cab0bbd70da0 tempest-GroupsV314Test-1716709815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7767f4d8-be89-4704-887c-8444ef7e1c4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:51:17 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-a4e1d1cc-77c5-4714-a754-cab0bbd70da0 tempest-GroupsV314Test-1716709815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bdc895e-0ced-4269-9ed1-d6d0f9b172b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:51:17 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-a4e1d1cc-77c5-4714-a754-cab0bbd70da0 tempest-GroupsV314Test-1716709815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bdc895e-0ced-4269-9ed1-d6d0f9b172b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b406e226-fea3-474c-ac0b-de22c6f77255', 'volume_name': 'volume-b406e226-fea3-474c-ac0b-de22c6f77255', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:51:17 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-a4e1d1cc-77c5-4714-a754-cab0bbd70da0 tempest-GroupsV314Test-1716709815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2194e199-112c-4c77-aaeb-ffaf9efb5f7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:51:17 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-a4e1d1cc-77c5-4714-a754-cab0bbd70da0 tempest-GroupsV314Test-1716709815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2194e199-112c-4c77-aaeb-ffaf9efb5f7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:51:17 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-a4e1d1cc-77c5-4714-a754-cab0bbd70da0 tempest-GroupsV314Test-1716709815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (518a5fd2-89fb-45a5-aa1c-649c111dd405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:51:17 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-a4e1d1cc-77c5-4714-a754-cab0bbd70da0 tempest-GroupsV314Test-1716709815 None] Volume b406e226-fea3-474c-ac0b-de22c6f77255: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b406e226-fea3-474c-ac0b-de22c6f77255', 'volume_size': 1} Apr 22 17:51:17 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-a4e1d1cc-77c5-4714-a754-cab0bbd70da0 tempest-GroupsV314Test-1716709815 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:51:17 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-a4e1d1cc-77c5-4714-a754-cab0bbd70da0 tempest-GroupsV314Test-1716709815 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:51:17 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-a4e1d1cc-77c5-4714-a754-cab0bbd70da0 tempest-GroupsV314Test-1716709815 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d7ecc7bc-8726-4c2d-9f75-b1a095a56971,created_at=2026-04-22T15:51:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2076601154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d7ecc7bc-8726-4c2d-9f75-b1a095a56971,host='devstack@QuobyteHD#QuobyteHD',id=b406e226-fea3-474c-ac0b-de22c6f77255,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34626a0f920541bdb579d73791df51f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:51:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:51:17Z,use_quota=True,user_id='fe2dd0d2b51c481096c50e0092436e71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f578ca5b-b94c-4920-b755-c29f3a9dfb31),volume_type_id=f578ca5b-b94c-4920-b755-c29f3a9dfb31)}" {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 17:51:17 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-a4e1d1cc-77c5-4714-a754-cab0bbd70da0 tempest-GroupsV314Test-1716709815 None] Creating volume b406e226-fea3-474c-ac0b-de22c6f77255 {{(pid=81771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 17:51:17 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-a4e1d1cc-77c5-4714-a754-cab0bbd70da0 tempest-GroupsV314Test-1716709815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:51:17 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-a4e1d1cc-77c5-4714-a754-cab0bbd70da0 tempest-GroupsV314Test-1716709815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:51:17 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-a4e1d1cc-77c5-4714-a754-cab0bbd70da0 tempest-GroupsV314Test-1716709815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:51:17 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-a4e1d1cc-77c5-4714-a754-cab0bbd70da0 tempest-GroupsV314Test-1716709815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:51:17 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-a4e1d1cc-77c5-4714-a754-cab0bbd70da0 tempest-GroupsV314Test-1716709815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:51:17 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-a4e1d1cc-77c5-4714-a754-cab0bbd70da0 tempest-GroupsV314Test-1716709815 None] Selected osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 as target Quobyte volume. {{(pid=81771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 17:51:17 devstack cinder-volume[81771]: INFO cinder.volume.drivers.remotefs [None req-a4e1d1cc-77c5-4714-a754-cab0bbd70da0 tempest-GroupsV314Test-1716709815 None] casted to osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 Apr 22 17:51:17 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-a4e1d1cc-77c5-4714-a754-cab0bbd70da0 tempest-GroupsV314Test-1716709815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b406e226-fea3-474c-ac0b-de22c6f77255 1073741824 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:51:17 devstack sudo[84123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b406e226-fea3-474c-ac0b-de22c6f77255 1073741824 Apr 22 17:51:17 devstack sudo[84123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:51:17 devstack sudo[84115]: pam_unix(sudo:session): session closed for user root Apr 22 17:51:17 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [req-23a6cfd9-d39a-4f00-a8d1-32bb1b1631ec req-c46c071e-0354-4a59-8e7a-40c94bad7b3a tempest-VolumesSnapshotsTestJSON-1647801802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-c6e76e79-16d9-4f0c-8651-76f50427a1de.fa0c9f17-56d9-4556-8b84-e73b03e81b8e" returned: 0 in 0.757s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:51:17 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [req-23a6cfd9-d39a-4f00-a8d1-32bb1b1631ec req-c46c071e-0354-4a59-8e7a-40c94bad7b3a tempest-VolumesSnapshotsTestJSON-1647801802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-c6e76e79-16d9-4f0c-8651-76f50427a1de.fa0c9f17-56d9-4556-8b84-e73b03e81b8e {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:51:17 devstack sudo[84125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-c6e76e79-16d9-4f0c-8651-76f50427a1de.fa0c9f17-56d9-4556-8b84-e73b03e81b8e Apr 22 17:51:17 devstack sudo[84125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:51:18 devstack sudo[84125]: pam_unix(sudo:session): session closed for user root Apr 22 17:51:18 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [req-23a6cfd9-d39a-4f00-a8d1-32bb1b1631ec req-c46c071e-0354-4a59-8e7a-40c94bad7b3a tempest-VolumesSnapshotsTestJSON-1647801802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-c6e76e79-16d9-4f0c-8651-76f50427a1de.fa0c9f17-56d9-4556-8b84-e73b03e81b8e" returned: 0 in 0.714s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:51:18 devstack cinder-volume[81771]: DEBUG cinder.coordination [req-23a6cfd9-d39a-4f00-a8d1-32bb1b1631ec req-c46c071e-0354-4a59-8e7a-40c94bad7b3a tempest-VolumesSnapshotsTestJSON-1647801802 None] Lock "cinder-quobyte-fa0c9f17-56d9-4556-8b84-e73b03e81b8e" released by "_delete_snapshot" :: held 2.997s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:51:18 devstack cinder-volume[81771]: DEBUG cinder.coordination [req-23a6cfd9-d39a-4f00-a8d1-32bb1b1631ec req-c46c071e-0354-4a59-8e7a-40c94bad7b3a tempest-VolumesSnapshotsTestJSON-1647801802 None] Lock "cinder-quobyte-c6e76e79-16d9-4f0c-8651-76f50427a1de" released by "delete_snapshot" :: held 3.027s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:51:18 devstack cinder-volume[81771]: WARNING cinder.quota [req-23a6cfd9-d39a-4f00-a8d1-32bb1b1631ec req-c46c071e-0354-4a59-8e7a-40c94bad7b3a tempest-VolumesSnapshotsTestJSON-1647801802 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 22 17:51:18 devstack cinder-volume[81771]: DEBUG cinder.quota [req-23a6cfd9-d39a-4f00-a8d1-32bb1b1631ec req-c46c071e-0354-4a59-8e7a-40c94bad7b3a tempest-VolumesSnapshotsTestJSON-1647801802 None] Created reservations ['9a5d2c9d-1dcf-4551-86ff-de0b964ddb92', '53a76dc3-5d63-46d9-acca-2e1ba26be7bc', '1e645904-2bd5-4278-939f-e23201986a63', '3e61a9db-a3b7-49b8-b8ce-b9dc60a4b5bf'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 17:51:18 devstack cinder-volume[81771]: INFO cinder.volume.manager [req-23a6cfd9-d39a-4f00-a8d1-32bb1b1631ec req-c46c071e-0354-4a59-8e7a-40c94bad7b3a tempest-VolumesSnapshotsTestJSON-1647801802 None] Delete snapshot completed successfully. Apr 22 17:51:18 devstack cinder-volume[81771]: DEBUG cinder.coordination [req-23a6cfd9-d39a-4f00-a8d1-32bb1b1631ec req-c46c071e-0354-4a59-8e7a-40c94bad7b3a tempest-VolumesSnapshotsTestJSON-1647801802 None] Lock "cinder-fa0c9f17-56d9-4556-8b84-e73b03e81b8e-delete_snapshot" released by "delete_snapshot" :: held 3.255s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:51:18 devstack sudo[84123]: pam_unix(sudo:session): session closed for user root Apr 22 17:51:18 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-a4e1d1cc-77c5-4714-a754-cab0bbd70da0 tempest-GroupsV314Test-1716709815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b406e226-fea3-474c-ac0b-de22c6f77255 1073741824" returned: 0 in 1.056s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:51:18 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-a4e1d1cc-77c5-4714-a754-cab0bbd70da0 tempest-GroupsV314Test-1716709815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b406e226-fea3-474c-ac0b-de22c6f77255 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:51:18 devstack sudo[84134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b406e226-fea3-474c-ac0b-de22c6f77255 Apr 22 17:51:18 devstack sudo[84134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:51:18 devstack cinder-volume[81771]: DEBUG cinder.coordination [req-b092f8fc-4a18-4aed-93ab-3c2e414f5942 req-a3d16456-630a-4fe4-9da6-e9fb5e1a39cf tempest-VolumesSnapshotsTestJSON-1647801802 None] Acquiring lock "cinder-c6e76e79-16d9-4f0c-8651-76f50427a1de-delete_volume" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:51:18 devstack cinder-volume[81771]: DEBUG cinder.coordination [req-b092f8fc-4a18-4aed-93ab-3c2e414f5942 req-a3d16456-630a-4fe4-9da6-e9fb5e1a39cf tempest-VolumesSnapshotsTestJSON-1647801802 None] Lock "cinder-c6e76e79-16d9-4f0c-8651-76f50427a1de-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:51:18 devstack cinder-volume[81771]: DEBUG cinder.coordination [req-b092f8fc-4a18-4aed-93ab-3c2e414f5942 req-a3d16456-630a-4fe4-9da6-e9fb5e1a39cf tempest-VolumesSnapshotsTestJSON-1647801802 None] Acquiring lock "cinder-quobyte-c6e76e79-16d9-4f0c-8651-76f50427a1de" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:51:18 devstack cinder-volume[81771]: DEBUG cinder.coordination [req-b092f8fc-4a18-4aed-93ab-3c2e414f5942 req-a3d16456-630a-4fe4-9da6-e9fb5e1a39cf tempest-VolumesSnapshotsTestJSON-1647801802 None] Lock "cinder-quobyte-c6e76e79-16d9-4f0c-8651-76f50427a1de" acquired by "delete_volume" :: waited 0.021s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:51:18 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[307328f8-ad0c-4466-9443-dc22e576d945]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:51:18 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [req-b092f8fc-4a18-4aed-93ab-3c2e414f5942 req-a3d16456-630a-4fe4-9da6-e9fb5e1a39cf tempest-VolumesSnapshotsTestJSON-1647801802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-c6e76e79-16d9-4f0c-8651-76f50427a1de {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:51:18 devstack sudo[84136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-c6e76e79-16d9-4f0c-8651-76f50427a1de Apr 22 17:51:18 devstack sudo[84136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:51:18 devstack cinder-volume[81771]: DEBUG cinder.volume.flows.manager.create_volume [req-62ed0f07-90be-4329-afe9-94925acd78b4 req-aa69ee25-8673-4752-bf5e-9ceccb8b7a3e tempest-ServerBootFromVolumeStableRescueTest-800024217 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 17:51:18 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [req-62ed0f07-90be-4329-afe9-94925acd78b4 req-aa69ee25-8673-4752-bf5e-9ceccb8b7a3e tempest-ServerBootFromVolumeStableRescueTest-800024217 None] Flow 'volume_create_manager' (eecabee6-86ed-4df6-a169-403f5d19892e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:51:18 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [req-62ed0f07-90be-4329-afe9-94925acd78b4 req-aa69ee25-8673-4752-bf5e-9ceccb8b7a3e tempest-ServerBootFromVolumeStableRescueTest-800024217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf30a491-dbd0-47de-8ce9-d70c236e505e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:51:18 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [req-62ed0f07-90be-4329-afe9-94925acd78b4 req-aa69ee25-8673-4752-bf5e-9ceccb8b7a3e tempest-ServerBootFromVolumeStableRescueTest-800024217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf30a491-dbd0-47de-8ce9-d70c236e505e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:51:18Z,deleted=False,deleted_at=None,display_description='',display_name='fd768d82-d140-46b8-a4fe-4a9b9004a4b4-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7107516-205a-44b0-b159-4965c9ded840,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60cbe8aa72e44583b8549f74d54325d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:51:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:51:19Z,use_quota=True,user_id='b063426c8b9b41a5a48e0e1035ec179c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:51:18 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [req-62ed0f07-90be-4329-afe9-94925acd78b4 req-aa69ee25-8673-4752-bf5e-9ceccb8b7a3e tempest-ServerBootFromVolumeStableRescueTest-800024217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5f8badf-86c4-4bc4-b650-72c502ca5485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:51:18 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [req-62ed0f07-90be-4329-afe9-94925acd78b4 req-aa69ee25-8673-4752-bf5e-9ceccb8b7a3e tempest-ServerBootFromVolumeStableRescueTest-800024217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5f8badf-86c4-4bc4-b650-72c502ca5485) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:51:18 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [req-62ed0f07-90be-4329-afe9-94925acd78b4 req-aa69ee25-8673-4752-bf5e-9ceccb8b7a3e tempest-ServerBootFromVolumeStableRescueTest-800024217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe65d79f-af41-4a1e-bec0-f3bfec61dd67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:51:18 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [req-62ed0f07-90be-4329-afe9-94925acd78b4 req-aa69ee25-8673-4752-bf5e-9ceccb8b7a3e tempest-ServerBootFromVolumeStableRescueTest-800024217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe65d79f-af41-4a1e-bec0-f3bfec61dd67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7107516-205a-44b0-b159-4965c9ded840', 'volume_name': 'volume-a7107516-205a-44b0-b159-4965c9ded840', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:51:18 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [req-62ed0f07-90be-4329-afe9-94925acd78b4 req-aa69ee25-8673-4752-bf5e-9ceccb8b7a3e tempest-ServerBootFromVolumeStableRescueTest-800024217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7f9823a-0cdc-436a-8332-4cc85d3e5d1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:51:18 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [req-62ed0f07-90be-4329-afe9-94925acd78b4 req-aa69ee25-8673-4752-bf5e-9ceccb8b7a3e tempest-ServerBootFromVolumeStableRescueTest-800024217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7f9823a-0cdc-436a-8332-4cc85d3e5d1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:51:18 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [req-62ed0f07-90be-4329-afe9-94925acd78b4 req-aa69ee25-8673-4752-bf5e-9ceccb8b7a3e tempest-ServerBootFromVolumeStableRescueTest-800024217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2fa03aa-9a5b-4be0-a424-f1e06ccadadc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:51:18 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [req-62ed0f07-90be-4329-afe9-94925acd78b4 req-aa69ee25-8673-4752-bf5e-9ceccb8b7a3e tempest-ServerBootFromVolumeStableRescueTest-800024217 None] Volume a7107516-205a-44b0-b159-4965c9ded840: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7107516-205a-44b0-b159-4965c9ded840', 'volume_size': 1} Apr 22 17:51:18 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [req-62ed0f07-90be-4329-afe9-94925acd78b4 req-aa69ee25-8673-4752-bf5e-9ceccb8b7a3e tempest-ServerBootFromVolumeStableRescueTest-800024217 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:51:19 devstack sudo[84134]: pam_unix(sudo:session): session closed for user root Apr 22 17:51:19 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-a4e1d1cc-77c5-4714-a754-cab0bbd70da0 tempest-GroupsV314Test-1716709815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b406e226-fea3-474c-ac0b-de22c6f77255" returned: 0 in 0.708s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:51:19 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-a4e1d1cc-77c5-4714-a754-cab0bbd70da0 tempest-GroupsV314Test-1716709815 None] <== create_volume: return (1819ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'} {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 17:51:19 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-a4e1d1cc-77c5-4714-a754-cab0bbd70da0 tempest-GroupsV314Test-1716709815 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.822s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:51:19 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [req-62ed0f07-90be-4329-afe9-94925acd78b4 req-aa69ee25-8673-4752-bf5e-9ceccb8b7a3e tempest-ServerBootFromVolumeStableRescueTest-800024217 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.200s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:51:19 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [req-62ed0f07-90be-4329-afe9-94925acd78b4 req-aa69ee25-8673-4752-bf5e-9ceccb8b7a3e tempest-ServerBootFromVolumeStableRescueTest-800024217 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:51:18Z,deleted=False,deleted_at=None,display_description='',display_name='fd768d82-d140-46b8-a4fe-4a9b9004a4b4-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7107516-205a-44b0-b159-4965c9ded840,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60cbe8aa72e44583b8549f74d54325d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:51:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:51:19Z,use_quota=True,user_id='b063426c8b9b41a5a48e0e1035ec179c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)}" {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 17:51:19 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [req-62ed0f07-90be-4329-afe9-94925acd78b4 req-aa69ee25-8673-4752-bf5e-9ceccb8b7a3e tempest-ServerBootFromVolumeStableRescueTest-800024217 None] Creating volume a7107516-205a-44b0-b159-4965c9ded840 {{(pid=81771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 17:51:19 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [req-62ed0f07-90be-4329-afe9-94925acd78b4 req-aa69ee25-8673-4752-bf5e-9ceccb8b7a3e tempest-ServerBootFromVolumeStableRescueTest-800024217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:51:19 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [req-62ed0f07-90be-4329-afe9-94925acd78b4 req-aa69ee25-8673-4752-bf5e-9ceccb8b7a3e tempest-ServerBootFromVolumeStableRescueTest-800024217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:51:19 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [req-62ed0f07-90be-4329-afe9-94925acd78b4 req-aa69ee25-8673-4752-bf5e-9ceccb8b7a3e tempest-ServerBootFromVolumeStableRescueTest-800024217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:51:19 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [req-62ed0f07-90be-4329-afe9-94925acd78b4 req-aa69ee25-8673-4752-bf5e-9ceccb8b7a3e tempest-ServerBootFromVolumeStableRescueTest-800024217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:51:19 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [req-62ed0f07-90be-4329-afe9-94925acd78b4 req-aa69ee25-8673-4752-bf5e-9ceccb8b7a3e tempest-ServerBootFromVolumeStableRescueTest-800024217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:51:19 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [req-62ed0f07-90be-4329-afe9-94925acd78b4 req-aa69ee25-8673-4752-bf5e-9ceccb8b7a3e tempest-ServerBootFromVolumeStableRescueTest-800024217 None] Selected osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 as target Quobyte volume. {{(pid=81771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 17:51:19 devstack cinder-volume[81771]: INFO cinder.volume.drivers.remotefs [req-62ed0f07-90be-4329-afe9-94925acd78b4 req-aa69ee25-8673-4752-bf5e-9ceccb8b7a3e tempest-ServerBootFromVolumeStableRescueTest-800024217 None] casted to osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 Apr 22 17:51:19 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [req-62ed0f07-90be-4329-afe9-94925acd78b4 req-aa69ee25-8673-4752-bf5e-9ceccb8b7a3e tempest-ServerBootFromVolumeStableRescueTest-800024217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a7107516-205a-44b0-b159-4965c9ded840 1073741824 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:51:19 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-a4e1d1cc-77c5-4714-a754-cab0bbd70da0 tempest-GroupsV314Test-1716709815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (518a5fd2-89fb-45a5-aa1c-649c111dd405) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b406e226-fea3-474c-ac0b-de22c6f77255', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:51:19 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-a4e1d1cc-77c5-4714-a754-cab0bbd70da0 tempest-GroupsV314Test-1716709815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1aa1d474-a132-470f-8064-4f168007a73f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:51:19 devstack sudo[84139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a7107516-205a-44b0-b159-4965c9ded840 1073741824 Apr 22 17:51:19 devstack sudo[84139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:51:19 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-a4e1d1cc-77c5-4714-a754-cab0bbd70da0 tempest-GroupsV314Test-1716709815 None] Volume volume-b406e226-fea3-474c-ac0b-de22c6f77255 (b406e226-fea3-474c-ac0b-de22c6f77255): created successfully Apr 22 17:51:19 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-a4e1d1cc-77c5-4714-a754-cab0bbd70da0 tempest-GroupsV314Test-1716709815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1aa1d474-a132-470f-8064-4f168007a73f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:51:19 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-a4e1d1cc-77c5-4714-a754-cab0bbd70da0 tempest-GroupsV314Test-1716709815 None] Flow 'volume_create_manager' (44071d5a-ddf6-4b82-891c-ab74ca4fdbd8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:51:19 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-a4e1d1cc-77c5-4714-a754-cab0bbd70da0 tempest-GroupsV314Test-1716709815 None] Created volume successfully. Apr 22 17:51:19 devstack sudo[84136]: pam_unix(sudo:session): session closed for user root Apr 22 17:51:19 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [req-b092f8fc-4a18-4aed-93ab-3c2e414f5942 req-a3d16456-630a-4fe4-9da6-e9fb5e1a39cf tempest-VolumesSnapshotsTestJSON-1647801802 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-c6e76e79-16d9-4f0c-8651-76f50427a1de" returned: 0 in 0.832s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:51:19 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [req-b092f8fc-4a18-4aed-93ab-3c2e414f5942 req-a3d16456-630a-4fe4-9da6-e9fb5e1a39cf tempest-VolumesSnapshotsTestJSON-1647801802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-c6e76e79-16d9-4f0c-8651-76f50427a1de {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:51:19 devstack sudo[84145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-c6e76e79-16d9-4f0c-8651-76f50427a1de Apr 22 17:51:19 devstack sudo[84145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:51:20 devstack sudo[84145]: pam_unix(sudo:session): session closed for user root Apr 22 17:51:20 devstack sudo[84139]: pam_unix(sudo:session): session closed for user root Apr 22 17:51:20 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [req-b092f8fc-4a18-4aed-93ab-3c2e414f5942 req-a3d16456-630a-4fe4-9da6-e9fb5e1a39cf tempest-VolumesSnapshotsTestJSON-1647801802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-c6e76e79-16d9-4f0c-8651-76f50427a1de" returned: 0 in 0.543s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:51:20 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [req-62ed0f07-90be-4329-afe9-94925acd78b4 req-aa69ee25-8673-4752-bf5e-9ceccb8b7a3e tempest-ServerBootFromVolumeStableRescueTest-800024217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a7107516-205a-44b0-b159-4965c9ded840 1073741824" returned: 0 in 0.949s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:51:20 devstack cinder-volume[81771]: DEBUG cinder.coordination [req-b092f8fc-4a18-4aed-93ab-3c2e414f5942 req-a3d16456-630a-4fe4-9da6-e9fb5e1a39cf tempest-VolumesSnapshotsTestJSON-1647801802 None] Lock "cinder-quobyte-c6e76e79-16d9-4f0c-8651-76f50427a1de" released by "delete_volume" :: held 1.476s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:51:20 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [req-62ed0f07-90be-4329-afe9-94925acd78b4 req-aa69ee25-8673-4752-bf5e-9ceccb8b7a3e tempest-ServerBootFromVolumeStableRescueTest-800024217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a7107516-205a-44b0-b159-4965c9ded840 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:51:20 devstack sudo[84151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a7107516-205a-44b0-b159-4965c9ded840 Apr 22 17:51:20 devstack sudo[84151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:51:20 devstack cinder-volume[81771]: DEBUG cinder.quota [req-b092f8fc-4a18-4aed-93ab-3c2e414f5942 req-a3d16456-630a-4fe4-9da6-e9fb5e1a39cf tempest-VolumesSnapshotsTestJSON-1647801802 None] Created reservations ['fc742f34-8de2-4b3c-8d43-5f120d461f96', '62298e1e-de2a-455a-ac94-532d8cd4f84b', '604d200c-8ac0-4e2c-b511-f3d49b300155', 'e50d4019-3779-42f2-a566-bdab15b6b772'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 17:51:20 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [req-b092f8fc-4a18-4aed-93ab-3c2e414f5942 req-a3d16456-630a-4fe4-9da6-e9fb5e1a39cf tempest-VolumesSnapshotsTestJSON-1647801802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:51:20 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [req-b092f8fc-4a18-4aed-93ab-3c2e414f5942 req-a3d16456-630a-4fe4-9da6-e9fb5e1a39cf tempest-VolumesSnapshotsTestJSON-1647801802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:51:20 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [req-b092f8fc-4a18-4aed-93ab-3c2e414f5942 req-a3d16456-630a-4fe4-9da6-e9fb5e1a39cf tempest-VolumesSnapshotsTestJSON-1647801802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:51:20 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [req-b092f8fc-4a18-4aed-93ab-3c2e414f5942 req-a3d16456-630a-4fe4-9da6-e9fb5e1a39cf tempest-VolumesSnapshotsTestJSON-1647801802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:51:20 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [req-b092f8fc-4a18-4aed-93ab-3c2e414f5942 req-a3d16456-630a-4fe4-9da6-e9fb5e1a39cf tempest-VolumesSnapshotsTestJSON-1647801802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:51:20 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [req-b092f8fc-4a18-4aed-93ab-3c2e414f5942 req-a3d16456-630a-4fe4-9da6-e9fb5e1a39cf tempest-VolumesSnapshotsTestJSON-1647801802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:51:20 devstack sudo[84153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 Apr 22 17:51:20 devstack sudo[84153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:51:20 devstack sudo[84151]: pam_unix(sudo:session): session closed for user root Apr 22 17:51:20 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [req-62ed0f07-90be-4329-afe9-94925acd78b4 req-aa69ee25-8673-4752-bf5e-9ceccb8b7a3e tempest-ServerBootFromVolumeStableRescueTest-800024217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a7107516-205a-44b0-b159-4965c9ded840" returned: 0 in 0.647s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:51:20 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [req-62ed0f07-90be-4329-afe9-94925acd78b4 req-aa69ee25-8673-4752-bf5e-9ceccb8b7a3e tempest-ServerBootFromVolumeStableRescueTest-800024217 None] <== create_volume: return (1683ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'} {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 17:51:20 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [req-62ed0f07-90be-4329-afe9-94925acd78b4 req-aa69ee25-8673-4752-bf5e-9ceccb8b7a3e tempest-ServerBootFromVolumeStableRescueTest-800024217 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.686s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:51:20 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [req-62ed0f07-90be-4329-afe9-94925acd78b4 req-aa69ee25-8673-4752-bf5e-9ceccb8b7a3e tempest-ServerBootFromVolumeStableRescueTest-800024217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2fa03aa-9a5b-4be0-a424-f1e06ccadadc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7107516-205a-44b0-b159-4965c9ded840', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:51:20 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [req-62ed0f07-90be-4329-afe9-94925acd78b4 req-aa69ee25-8673-4752-bf5e-9ceccb8b7a3e tempest-ServerBootFromVolumeStableRescueTest-800024217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da72e691-8b1e-4ae9-8013-e77cab57b65a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:51:20 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [req-62ed0f07-90be-4329-afe9-94925acd78b4 req-aa69ee25-8673-4752-bf5e-9ceccb8b7a3e tempest-ServerBootFromVolumeStableRescueTest-800024217 None] Volume volume-a7107516-205a-44b0-b159-4965c9ded840 (a7107516-205a-44b0-b159-4965c9ded840): created successfully Apr 22 17:51:20 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [req-62ed0f07-90be-4329-afe9-94925acd78b4 req-aa69ee25-8673-4752-bf5e-9ceccb8b7a3e tempest-ServerBootFromVolumeStableRescueTest-800024217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da72e691-8b1e-4ae9-8013-e77cab57b65a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:51:20 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [req-62ed0f07-90be-4329-afe9-94925acd78b4 req-aa69ee25-8673-4752-bf5e-9ceccb8b7a3e tempest-ServerBootFromVolumeStableRescueTest-800024217 None] Flow 'volume_create_manager' (eecabee6-86ed-4df6-a169-403f5d19892e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:51:20 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-58f1261b-5b00-4a18-ba1a-1e46409286df tempest-GroupsV314Test-1716709815 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:51:20 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-58f1261b-5b00-4a18-ba1a-1e46409286df tempest-GroupsV314Test-1716709815 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:51:20 devstack cinder-volume[81771]: INFO cinder.volume.drivers.remotefs [None req-58f1261b-5b00-4a18-ba1a-1e46409286df tempest-GroupsV314Test-1716709815 None] Cloning volume b406e226-fea3-474c-ac0b-de22c6f77255 to volume 7eea2c16-06a4-4f71-85d7-18b544a38724 Apr 22 17:51:20 devstack sudo[84153]: pam_unix(sudo:session): session closed for user root Apr 22 17:51:20 devstack cinder-volume[81771]: INFO cinder.volume.manager [req-62ed0f07-90be-4329-afe9-94925acd78b4 req-aa69ee25-8673-4752-bf5e-9ceccb8b7a3e tempest-ServerBootFromVolumeStableRescueTest-800024217 None] Created volume successfully. Apr 22 17:51:21 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [req-b092f8fc-4a18-4aed-93ab-3c2e414f5942 req-a3d16456-630a-4fe4-9da6-e9fb5e1a39cf tempest-VolumesSnapshotsTestJSON-1647801802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33" returned: 0 in 0.747s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:51:21 devstack cinder-volume[81771]: DEBUG cinder.manager [req-b092f8fc-4a18-4aed-93ab-3c2e414f5942 req-a3d16456-630a-4fe4-9da6-e9fb5e1a39cf tempest-VolumesSnapshotsTestJSON-1647801802 None] Notifying Schedulers of capabilities ... {{(pid=81771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 17:51:21 devstack cinder-volume[81771]: INFO cinder.volume.manager [req-b092f8fc-4a18-4aed-93ab-3c2e414f5942 req-a3d16456-630a-4fe4-9da6-e9fb5e1a39cf tempest-VolumesSnapshotsTestJSON-1647801802 None] Deleted volume successfully. Apr 22 17:51:21 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-58f1261b-5b00-4a18-ba1a-1e46409286df tempest-GroupsV314Test-1716709815 None] Creating offline snapshot 9fb01e81-fa96-405e-806e-959e53e9b198 of volume b406e226-fea3-474c-ac0b-de22c6f77255 {{(pid=81771) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 22 17:51:21 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ffa8d77-494b-4463-bd76-7f9fb6713185]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:51:21 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-58f1261b-5b00-4a18-ba1a-1e46409286df tempest-GroupsV314Test-1716709815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b406e226-fea3-474c-ac0b-de22c6f77255 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:51:21 devstack cinder-volume[81771]: DEBUG cinder.coordination [req-b092f8fc-4a18-4aed-93ab-3c2e414f5942 req-a3d16456-630a-4fe4-9da6-e9fb5e1a39cf tempest-VolumesSnapshotsTestJSON-1647801802 None] Lock "cinder-c6e76e79-16d9-4f0c-8651-76f50427a1de-delete_volume" released by "delete_volume" :: held 2.583s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:51:21 devstack sudo[84158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b406e226-fea3-474c-ac0b-de22c6f77255 Apr 22 17:51:21 devstack sudo[84158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:51:21 devstack sudo[84158]: pam_unix(sudo:session): session closed for user root Apr 22 17:51:21 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-58f1261b-5b00-4a18-ba1a-1e46409286df tempest-GroupsV314Test-1716709815 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b406e226-fea3-474c-ac0b-de22c6f77255" returned: 0 in 0.773s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:51:21 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-58f1261b-5b00-4a18-ba1a-1e46409286df tempest-GroupsV314Test-1716709815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b406e226-fea3-474c-ac0b-de22c6f77255,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b406e226-fea3-474c-ac0b-de22c6f77255.9fb01e81-fa96-405e-806e-959e53e9b198 1G {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:51:21 devstack sudo[84163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b406e226-fea3-474c-ac0b-de22c6f77255,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b406e226-fea3-474c-ac0b-de22c6f77255.9fb01e81-fa96-405e-806e-959e53e9b198 1G Apr 22 17:51:21 devstack sudo[84163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:51:22 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [req-62ed0f07-90be-4329-afe9-94925acd78b4 req-0c420b59-4e83-42fa-b2a2-195d98969159 tempest-ServerBootFromVolumeStableRescueTest-800024217 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:51:22 devstack sudo[84163]: pam_unix(sudo:session): session closed for user root Apr 22 17:51:22 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-58f1261b-5b00-4a18-ba1a-1e46409286df tempest-GroupsV314Test-1716709815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b406e226-fea3-474c-ac0b-de22c6f77255,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b406e226-fea3-474c-ac0b-de22c6f77255.9fb01e81-fa96-405e-806e-959e53e9b198 1G" returned: 0 in 0.866s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:51:22 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-58f1261b-5b00-4a18-ba1a-1e46409286df tempest-GroupsV314Test-1716709815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b406e226-fea3-474c-ac0b-de22c6f77255 -F qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b406e226-fea3-474c-ac0b-de22c6f77255.9fb01e81-fa96-405e-806e-959e53e9b198 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:51:22 devstack sudo[84176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b406e226-fea3-474c-ac0b-de22c6f77255 -F qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b406e226-fea3-474c-ac0b-de22c6f77255.9fb01e81-fa96-405e-806e-959e53e9b198 Apr 22 17:51:22 devstack sudo[84176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:51:23 devstack sudo[84176]: pam_unix(sudo:session): session closed for user root Apr 22 17:51:23 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-58f1261b-5b00-4a18-ba1a-1e46409286df tempest-GroupsV314Test-1716709815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b406e226-fea3-474c-ac0b-de22c6f77255 -F qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b406e226-fea3-474c-ac0b-de22c6f77255.9fb01e81-fa96-405e-806e-959e53e9b198" returned: 0 in 0.698s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:51:23 devstack cinder-volume[81771]: WARNING cinder.volume.drivers.remotefs [None req-58f1261b-5b00-4a18-ba1a-1e46409286df tempest-GroupsV314Test-1716709815 None] /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b406e226-fea3-474c-ac0b-de22c6f77255.9fb01e81-fa96-405e-806e-959e53e9b198 is being set with open permissions: ugo+rw: NotImplementedError Apr 22 17:51:23 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-58f1261b-5b00-4a18-ba1a-1e46409286df tempest-GroupsV314Test-1716709815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b406e226-fea3-474c-ac0b-de22c6f77255.9fb01e81-fa96-405e-806e-959e53e9b198 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:51:23 devstack sudo[84183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b406e226-fea3-474c-ac0b-de22c6f77255.9fb01e81-fa96-405e-806e-959e53e9b198 Apr 22 17:51:23 devstack sudo[84183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:51:24 devstack sudo[84183]: pam_unix(sudo:session): session closed for user root Apr 22 17:51:24 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-58f1261b-5b00-4a18-ba1a-1e46409286df tempest-GroupsV314Test-1716709815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b406e226-fea3-474c-ac0b-de22c6f77255.9fb01e81-fa96-405e-806e-959e53e9b198" returned: 0 in 0.622s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:51:24 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-58f1261b-5b00-4a18-ba1a-1e46409286df tempest-GroupsV314Test-1716709815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b406e226-fea3-474c-ac0b-de22c6f77255.info {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:51:24 devstack sudo[84186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b406e226-fea3-474c-ac0b-de22c6f77255.info Apr 22 17:51:24 devstack sudo[84186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:51:24 devstack sudo[84186]: pam_unix(sudo:session): session closed for user root Apr 22 17:51:24 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-58f1261b-5b00-4a18-ba1a-1e46409286df tempest-GroupsV314Test-1716709815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b406e226-fea3-474c-ac0b-de22c6f77255.info" returned: 0 in 0.730s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:51:24 devstack cinder-volume[81771]: WARNING cinder.volume.drivers.remotefs [None req-58f1261b-5b00-4a18-ba1a-1e46409286df tempest-GroupsV314Test-1716709815 None] /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b406e226-fea3-474c-ac0b-de22c6f77255.info is being set with open permissions: ugo+rw: NotImplementedError Apr 22 17:51:24 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-58f1261b-5b00-4a18-ba1a-1e46409286df tempest-GroupsV314Test-1716709815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b406e226-fea3-474c-ac0b-de22c6f77255.info {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:51:24 devstack sudo[84189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b406e226-fea3-474c-ac0b-de22c6f77255.info Apr 22 17:51:24 devstack sudo[84189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:51:25 devstack cinder-volume[81771]: DEBUG cinder.volume.flows.manager.create_volume [None req-12efc747-03b4-4b2b-a668-da72d9c57e36 tempest-VolumesTestJSON-1695673024 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 17:51:25 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-12efc747-03b4-4b2b-a668-da72d9c57e36 tempest-VolumesTestJSON-1695673024 None] Flow 'volume_create_manager' (fd911d26-c82c-477b-a3ba-f3138b794ec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:51:25 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-12efc747-03b4-4b2b-a668-da72d9c57e36 tempest-VolumesTestJSON-1695673024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a15d2c5a-e7ea-42e8-aae0-58919ffce15d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:51:25 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-12efc747-03b4-4b2b-a668-da72d9c57e36 tempest-VolumesTestJSON-1695673024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a15d2c5a-e7ea-42e8-aae0-58919ffce15d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:51:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2011106422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32cc268c-7af8-4379-9f84-885cd58daaec,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7d5ce4afb9ca42a49e483d5897339651',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:51:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:51:25Z,use_quota=True,user_id='766cf71afddf4e778bf637fbd23ee19e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:51:25 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-12efc747-03b4-4b2b-a668-da72d9c57e36 tempest-VolumesTestJSON-1695673024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6024208-a119-4e1b-9150-717a16fd117d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:51:25 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-12efc747-03b4-4b2b-a668-da72d9c57e36 tempest-VolumesTestJSON-1695673024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6024208-a119-4e1b-9150-717a16fd117d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:51:25 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-12efc747-03b4-4b2b-a668-da72d9c57e36 tempest-VolumesTestJSON-1695673024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (888a239b-400c-42ab-a693-44f64c4b7ba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:51:25 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-12efc747-03b4-4b2b-a668-da72d9c57e36 tempest-VolumesTestJSON-1695673024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (888a239b-400c-42ab-a693-44f64c4b7ba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32cc268c-7af8-4379-9f84-885cd58daaec', 'volume_name': 'volume-32cc268c-7af8-4379-9f84-885cd58daaec', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:51:25 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-12efc747-03b4-4b2b-a668-da72d9c57e36 tempest-VolumesTestJSON-1695673024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18131a37-af27-4bb3-9843-d0b7c6d2d830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:51:25 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-12efc747-03b4-4b2b-a668-da72d9c57e36 tempest-VolumesTestJSON-1695673024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18131a37-af27-4bb3-9843-d0b7c6d2d830) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:51:25 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-12efc747-03b4-4b2b-a668-da72d9c57e36 tempest-VolumesTestJSON-1695673024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b74747ac-ed16-488e-8376-0c17ad21da01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:51:25 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-12efc747-03b4-4b2b-a668-da72d9c57e36 tempest-VolumesTestJSON-1695673024 None] Volume 32cc268c-7af8-4379-9f84-885cd58daaec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32cc268c-7af8-4379-9f84-885cd58daaec', 'volume_size': 1} Apr 22 17:51:25 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-12efc747-03b4-4b2b-a668-da72d9c57e36 tempest-VolumesTestJSON-1695673024 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:51:25 devstack sudo[84189]: pam_unix(sudo:session): session closed for user root Apr 22 17:51:25 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-58f1261b-5b00-4a18-ba1a-1e46409286df tempest-GroupsV314Test-1716709815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b406e226-fea3-474c-ac0b-de22c6f77255.info" returned: 0 in 0.529s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:51:25 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-58f1261b-5b00-4a18-ba1a-1e46409286df tempest-GroupsV314Test-1716709815 None] Acquiring lock "cinder-quobyte-7eea2c16-06a4-4f71-85d7-18b544a38724" by "_copy_volume_from_snapshot" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:51:25 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-58f1261b-5b00-4a18-ba1a-1e46409286df tempest-GroupsV314Test-1716709815 None] Lock "cinder-quobyte-7eea2c16-06a4-4f71-85d7-18b544a38724" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:51:25 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-58f1261b-5b00-4a18-ba1a-1e46409286df tempest-GroupsV314Test-1716709815 None] snapshot: 9fb01e81-fa96-405e-806e-959e53e9b198, volume: 7eea2c16-06a4-4f71-85d7-18b544a38724, {{(pid=81771) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 22 17:51:25 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-58f1261b-5b00-4a18-ba1a-1e46409286df tempest-GroupsV314Test-1716709815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:51:25 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-58f1261b-5b00-4a18-ba1a-1e46409286df tempest-GroupsV314Test-1716709815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:51:25 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-58f1261b-5b00-4a18-ba1a-1e46409286df tempest-GroupsV314Test-1716709815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:51:25 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-58f1261b-5b00-4a18-ba1a-1e46409286df tempest-GroupsV314Test-1716709815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:51:25 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-58f1261b-5b00-4a18-ba1a-1e46409286df tempest-GroupsV314Test-1716709815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:51:25 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc675fbc-d799-4e57-abd4-63243a78bc39]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:51:25 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-58f1261b-5b00-4a18-ba1a-1e46409286df tempest-GroupsV314Test-1716709815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b406e226-fea3-474c-ac0b-de22c6f77255.9fb01e81-fa96-405e-806e-959e53e9b198 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:51:25 devstack sudo[84192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b406e226-fea3-474c-ac0b-de22c6f77255.9fb01e81-fa96-405e-806e-959e53e9b198 Apr 22 17:51:25 devstack sudo[84192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:51:26 devstack sudo[84192]: pam_unix(sudo:session): session closed for user root Apr 22 17:51:26 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-58f1261b-5b00-4a18-ba1a-1e46409286df tempest-GroupsV314Test-1716709815 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b406e226-fea3-474c-ac0b-de22c6f77255.9fb01e81-fa96-405e-806e-959e53e9b198" returned: 0 in 0.664s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:51:26 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-58f1261b-5b00-4a18-ba1a-1e46409286df tempest-GroupsV314Test-1716709815 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b406e226-fea3-474c-ac0b-de22c6f77255(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81771) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 22 17:51:26 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-58f1261b-5b00-4a18-ba1a-1e46409286df tempest-GroupsV314Test-1716709815 None] will copy from snapshot at /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b406e226-fea3-474c-ac0b-de22c6f77255 {{(pid=81771) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 22 17:51:26 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-58f1261b-5b00-4a18-ba1a-1e46409286df tempest-GroupsV314Test-1716709815 None] Creating direct copy from snapshot {{(pid=81771) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 22 17:51:26 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[822aa14f-7ec9-4961-9392-bce8b5a9634d]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:51:26 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-58f1261b-5b00-4a18-ba1a-1e46409286df tempest-GroupsV314Test-1716709815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b406e226-fea3-474c-ac0b-de22c6f77255 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:51:26 devstack sudo[84198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b406e226-fea3-474c-ac0b-de22c6f77255 Apr 22 17:51:26 devstack sudo[84198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:51:26 devstack sudo[84198]: pam_unix(sudo:session): session closed for user root Apr 22 17:51:26 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-58f1261b-5b00-4a18-ba1a-1e46409286df tempest-GroupsV314Test-1716709815 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b406e226-fea3-474c-ac0b-de22c6f77255" returned: 0 in 0.669s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:51:26 devstack cinder-volume[81771]: DEBUG cinder.utils [None req-58f1261b-5b00-4a18-ba1a-1e46409286df tempest-GroupsV314Test-1716709815 None] Path /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7eea2c16-06a4-4f71-85d7-18b544a38724 not found in is_blk_device check {{(pid=81771) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 22 17:51:26 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-58f1261b-5b00-4a18-ba1a-1e46409286df tempest-GroupsV314Test-1716709815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b406e226-fea3-474c-ac0b-de22c6f77255 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7eea2c16-06a4-4f71-85d7-18b544a38724 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:51:26 devstack sudo[84203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b406e226-fea3-474c-ac0b-de22c6f77255 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7eea2c16-06a4-4f71-85d7-18b544a38724 Apr 22 17:51:26 devstack sudo[84203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:51:29 devstack cinder-volume[81771]: DEBUG oslo_service.periodic_task [None req-1a7bdab5-8190-4e00-a2e2-843e5894ab49 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81771) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 22 17:51:29 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-1a7bdab5-8190-4e00-a2e2-843e5894ab49 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:51:29 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-1a7bdab5-8190-4e00-a2e2-843e5894ab49 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:51:29 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-1a7bdab5-8190-4e00-a2e2-843e5894ab49 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:51:29 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-1a7bdab5-8190-4e00-a2e2-843e5894ab49 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:51:29 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-1a7bdab5-8190-4e00-a2e2-843e5894ab49 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:51:29 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-1a7bdab5-8190-4e00-a2e2-843e5894ab49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:51:29 devstack sudo[84237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 Apr 22 17:51:29 devstack sudo[84237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:51:31 devstack sudo[84237]: pam_unix(sudo:session): session closed for user root Apr 22 17:51:31 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-1a7bdab5-8190-4e00-a2e2-843e5894ab49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33" returned: 0 in 1.984s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:51:31 devstack cinder-volume[81771]: DEBUG cinder.manager [None req-1a7bdab5-8190-4e00-a2e2-843e5894ab49 None None] Notifying Schedulers of capabilities ... {{(pid=81771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 17:51:33 devstack sudo[84203]: pam_unix(sudo:session): session closed for user root Apr 22 17:51:33 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-58f1261b-5b00-4a18-ba1a-1e46409286df tempest-GroupsV314Test-1716709815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b406e226-fea3-474c-ac0b-de22c6f77255 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7eea2c16-06a4-4f71-85d7-18b544a38724" returned: 0 in 6.211s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:51:33 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[a350d779-c31a-4790-b442-ebef2b01f4dd]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:51:33 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-58f1261b-5b00-4a18-ba1a-1e46409286df tempest-GroupsV314Test-1716709815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b406e226-fea3-474c-ac0b-de22c6f77255 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:51:33 devstack sudo[84240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b406e226-fea3-474c-ac0b-de22c6f77255 Apr 22 17:51:33 devstack sudo[84240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:51:33 devstack sudo[84240]: pam_unix(sudo:session): session closed for user root Apr 22 17:51:33 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-58f1261b-5b00-4a18-ba1a-1e46409286df tempest-GroupsV314Test-1716709815 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b406e226-fea3-474c-ac0b-de22c6f77255" returned: 0 in 0.782s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:51:33 devstack cinder-volume[81771]: DEBUG cinder.image.image_utils [None req-58f1261b-5b00-4a18-ba1a-1e46409286df tempest-GroupsV314Test-1716709815 None] Image conversion details: src /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b406e226-fea3-474c-ac0b-de22c6f77255, size 1024.00 MB, duration 6.21 sec, destination /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7eea2c16-06a4-4f71-85d7-18b544a38724 {{(pid=81771) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 22 17:51:33 devstack cinder-volume[81771]: INFO cinder.image.image_utils [None req-58f1261b-5b00-4a18-ba1a-1e46409286df tempest-GroupsV314Test-1716709815 None] Converted 1024.00 MB image at 164.85 MB/s Apr 22 17:51:33 devstack cinder-volume[81771]: WARNING cinder.volume.drivers.remotefs [None req-58f1261b-5b00-4a18-ba1a-1e46409286df tempest-GroupsV314Test-1716709815 None] /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7eea2c16-06a4-4f71-85d7-18b544a38724 is being set with open permissions: ugo+rw: NotImplementedError Apr 22 17:51:33 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-58f1261b-5b00-4a18-ba1a-1e46409286df tempest-GroupsV314Test-1716709815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7eea2c16-06a4-4f71-85d7-18b544a38724 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:51:33 devstack sudo[84245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7eea2c16-06a4-4f71-85d7-18b544a38724 Apr 22 17:51:33 devstack sudo[84245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:51:34 devstack sudo[84245]: pam_unix(sudo:session): session closed for user root Apr 22 17:51:34 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-58f1261b-5b00-4a18-ba1a-1e46409286df tempest-GroupsV314Test-1716709815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7eea2c16-06a4-4f71-85d7-18b544a38724" returned: 0 in 0.526s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:51:34 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-58f1261b-5b00-4a18-ba1a-1e46409286df tempest-GroupsV314Test-1716709815 None] Lock "cinder-quobyte-7eea2c16-06a4-4f71-85d7-18b544a38724" released by "_copy_volume_from_snapshot" :: held 8.943s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:51:34 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-58f1261b-5b00-4a18-ba1a-1e46409286df tempest-GroupsV314Test-1716709815 None] Acquiring lock "cinder-quobyte-9fb01e81-fa96-405e-806e-959e53e9b198" by "_delete_snapshot" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:51:34 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-58f1261b-5b00-4a18-ba1a-1e46409286df tempest-GroupsV314Test-1716709815 None] Lock "cinder-quobyte-9fb01e81-fa96-405e-806e-959e53e9b198" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:51:34 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-58f1261b-5b00-4a18-ba1a-1e46409286df tempest-GroupsV314Test-1716709815 None] Deleting offline snapshot 9fb01e81-fa96-405e-806e-959e53e9b198 of volume b406e226-fea3-474c-ac0b-de22c6f77255 {{(pid=81771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 22 17:51:34 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-58f1261b-5b00-4a18-ba1a-1e46409286df tempest-GroupsV314Test-1716709815 None] snapshot_file for this snap is: volume-b406e226-fea3-474c-ac0b-de22c6f77255.9fb01e81-fa96-405e-806e-959e53e9b198 {{(pid=81771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 22 17:51:34 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[65341bf4-e13f-4d74-bf26-beab13389d1d]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:51:34 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-58f1261b-5b00-4a18-ba1a-1e46409286df tempest-GroupsV314Test-1716709815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b406e226-fea3-474c-ac0b-de22c6f77255.9fb01e81-fa96-405e-806e-959e53e9b198 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:51:34 devstack sudo[84248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b406e226-fea3-474c-ac0b-de22c6f77255.9fb01e81-fa96-405e-806e-959e53e9b198 Apr 22 17:51:34 devstack sudo[84248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:51:35 devstack sudo[84248]: pam_unix(sudo:session): session closed for user root Apr 22 17:51:35 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-58f1261b-5b00-4a18-ba1a-1e46409286df tempest-GroupsV314Test-1716709815 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b406e226-fea3-474c-ac0b-de22c6f77255.9fb01e81-fa96-405e-806e-959e53e9b198" returned: 0 in 0.607s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:51:35 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-58f1261b-5b00-4a18-ba1a-1e46409286df tempest-GroupsV314Test-1716709815 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b406e226-fea3-474c-ac0b-de22c6f77255(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81771) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 22 17:51:35 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f99f3bd-f138-4aec-a083-da23a285a917]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:51:35 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-58f1261b-5b00-4a18-ba1a-1e46409286df tempest-GroupsV314Test-1716709815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b406e226-fea3-474c-ac0b-de22c6f77255 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:51:35 devstack sudo[84253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b406e226-fea3-474c-ac0b-de22c6f77255 Apr 22 17:51:35 devstack sudo[84253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:51:35 devstack cinder-volume[81771]: DEBUG dbcounter [-] [81771] Writing DB stats cinder:SELECT=35,cinder:UPDATE=42,cinder:DELETE=3,cinder:INSERT=6 {{(pid=81771) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 22 17:51:35 devstack sudo[84253]: pam_unix(sudo:session): session closed for user root Apr 22 17:51:35 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-58f1261b-5b00-4a18-ba1a-1e46409286df tempest-GroupsV314Test-1716709815 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b406e226-fea3-474c-ac0b-de22c6f77255" returned: 0 in 0.662s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:51:35 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-58f1261b-5b00-4a18-ba1a-1e46409286df tempest-GroupsV314Test-1716709815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b406e226-fea3-474c-ac0b-de22c6f77255.9fb01e81-fa96-405e-806e-959e53e9b198 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:51:35 devstack sudo[84258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b406e226-fea3-474c-ac0b-de22c6f77255.9fb01e81-fa96-405e-806e-959e53e9b198 Apr 22 17:51:35 devstack sudo[84258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:51:36 devstack sudo[84258]: pam_unix(sudo:session): session closed for user root Apr 22 17:51:36 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-58f1261b-5b00-4a18-ba1a-1e46409286df tempest-GroupsV314Test-1716709815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b406e226-fea3-474c-ac0b-de22c6f77255.9fb01e81-fa96-405e-806e-959e53e9b198" returned: 0 in 0.653s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:51:36 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-58f1261b-5b00-4a18-ba1a-1e46409286df tempest-GroupsV314Test-1716709815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b406e226-fea3-474c-ac0b-de22c6f77255.9fb01e81-fa96-405e-806e-959e53e9b198 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:51:36 devstack sudo[84265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b406e226-fea3-474c-ac0b-de22c6f77255.9fb01e81-fa96-405e-806e-959e53e9b198 Apr 22 17:51:36 devstack sudo[84265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:51:36 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-58f1261b-5b00-4a18-ba1a-1e46409286df tempest-GroupsV314Test-1716709815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b406e226-fea3-474c-ac0b-de22c6f77255.9fb01e81-fa96-405e-806e-959e53e9b198" returned: 0 in 0.583s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:51:36 devstack sudo[84265]: pam_unix(sudo:session): session closed for user root Apr 22 17:51:37 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-58f1261b-5b00-4a18-ba1a-1e46409286df tempest-GroupsV314Test-1716709815 None] Lock "cinder-quobyte-9fb01e81-fa96-405e-806e-959e53e9b198" released by "_delete_snapshot" :: held 2.643s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:51:37 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-58f1261b-5b00-4a18-ba1a-1e46409286df tempest-GroupsV314Test-1716709815 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.091s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:51:37 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [req-62ed0f07-90be-4329-afe9-94925acd78b4 req-0c420b59-4e83-42fa-b2a2-195d98969159 tempest-ServerBootFromVolumeStableRescueTest-800024217 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 14.517s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:51:37 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b3f8655-c380-49c2-96a7-3d8f985fc4ee]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:51:37 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [req-62ed0f07-90be-4329-afe9-94925acd78b4 req-0c420b59-4e83-42fa-b2a2-195d98969159 tempest-ServerBootFromVolumeStableRescueTest-800024217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a7107516-205a-44b0-b159-4965c9ded840 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:51:37 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-58f1261b-5b00-4a18-ba1a-1e46409286df tempest-GroupsV314Test-1716709815 None] Create group from source-group-d7ecc7bc-8726-4c2d-9f75-b1a095a56971 completed successfully. Apr 22 17:51:37 devstack sudo[84269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a7107516-205a-44b0-b159-4965c9ded840 Apr 22 17:51:37 devstack sudo[84269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:51:37 devstack sudo[84269]: pam_unix(sudo:session): session closed for user root Apr 22 17:51:37 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [req-62ed0f07-90be-4329-afe9-94925acd78b4 req-0c420b59-4e83-42fa-b2a2-195d98969159 tempest-ServerBootFromVolumeStableRescueTest-800024217 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a7107516-205a-44b0-b159-4965c9ded840" returned: 0 in 0.759s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:51:37 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [req-62ed0f07-90be-4329-afe9-94925acd78b4 req-0c420b59-4e83-42fa-b2a2-195d98969159 tempest-ServerBootFromVolumeStableRescueTest-800024217 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.786s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:51:37 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-12efc747-03b4-4b2b-a668-da72d9c57e36 tempest-VolumesTestJSON-1695673024 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.497s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:51:37 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-12efc747-03b4-4b2b-a668-da72d9c57e36 tempest-VolumesTestJSON-1695673024 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:51:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2011106422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32cc268c-7af8-4379-9f84-885cd58daaec,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7d5ce4afb9ca42a49e483d5897339651',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:51:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:51:25Z,use_quota=True,user_id='766cf71afddf4e778bf637fbd23ee19e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)}" {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 17:51:37 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-12efc747-03b4-4b2b-a668-da72d9c57e36 tempest-VolumesTestJSON-1695673024 None] Creating volume 32cc268c-7af8-4379-9f84-885cd58daaec {{(pid=81771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 17:51:37 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-12efc747-03b4-4b2b-a668-da72d9c57e36 tempest-VolumesTestJSON-1695673024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:51:37 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-12efc747-03b4-4b2b-a668-da72d9c57e36 tempest-VolumesTestJSON-1695673024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:51:37 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-12efc747-03b4-4b2b-a668-da72d9c57e36 tempest-VolumesTestJSON-1695673024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:51:37 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-12efc747-03b4-4b2b-a668-da72d9c57e36 tempest-VolumesTestJSON-1695673024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:51:37 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-12efc747-03b4-4b2b-a668-da72d9c57e36 tempest-VolumesTestJSON-1695673024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:51:37 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-12efc747-03b4-4b2b-a668-da72d9c57e36 tempest-VolumesTestJSON-1695673024 None] Selected osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 as target Quobyte volume. {{(pid=81771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 17:51:37 devstack cinder-volume[81771]: INFO cinder.volume.drivers.remotefs [None req-12efc747-03b4-4b2b-a668-da72d9c57e36 tempest-VolumesTestJSON-1695673024 None] casted to osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 Apr 22 17:51:37 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-12efc747-03b4-4b2b-a668-da72d9c57e36 tempest-VolumesTestJSON-1695673024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-32cc268c-7af8-4379-9f84-885cd58daaec 1073741824 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:51:37 devstack sudo[84274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-32cc268c-7af8-4379-9f84-885cd58daaec 1073741824 Apr 22 17:51:37 devstack sudo[84274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:51:37 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [req-62ed0f07-90be-4329-afe9-94925acd78b4 req-0c420b59-4e83-42fa-b2a2-195d98969159 tempest-ServerBootFromVolumeStableRescueTest-800024217 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93', 'name': 'volume-a7107516-205a-44b0-b159-4965c9ded840', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9af4eda2-f7a1-46c1-9723-3a441c24d971', 'enforce_multipath': True} {{(pid=81771) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 22 17:51:38 devstack cinder-volume[81771]: INFO cinder.volume.manager [req-62ed0f07-90be-4329-afe9-94925acd78b4 req-0c420b59-4e83-42fa-b2a2-195d98969159 tempest-ServerBootFromVolumeStableRescueTest-800024217 None] attachment_update completed successfully. Apr 22 17:51:38 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-cfddc68d-c1f4-457d-ad6f-24d1f7729735 tempest-GroupsV314Test-1716709815 None] Acquiring lock "cinder-quobyte-7eea2c16-06a4-4f71-85d7-18b544a38724" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:51:38 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-cfddc68d-c1f4-457d-ad6f-24d1f7729735 tempest-GroupsV314Test-1716709815 None] Lock "cinder-quobyte-7eea2c16-06a4-4f71-85d7-18b544a38724" acquired by "delete_volume" :: waited 0.016s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:51:38 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ffca5d0-047e-48d6-8989-e2ccf7c7ca7b]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:51:38 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-cfddc68d-c1f4-457d-ad6f-24d1f7729735 tempest-GroupsV314Test-1716709815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7eea2c16-06a4-4f71-85d7-18b544a38724 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:51:38 devstack sudo[84276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7eea2c16-06a4-4f71-85d7-18b544a38724 Apr 22 17:51:38 devstack sudo[84276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:51:38 devstack sudo[84274]: pam_unix(sudo:session): session closed for user root Apr 22 17:51:38 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-12efc747-03b4-4b2b-a668-da72d9c57e36 tempest-VolumesTestJSON-1695673024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-32cc268c-7af8-4379-9f84-885cd58daaec 1073741824" returned: 0 in 0.904s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:51:38 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-12efc747-03b4-4b2b-a668-da72d9c57e36 tempest-VolumesTestJSON-1695673024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-32cc268c-7af8-4379-9f84-885cd58daaec {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:51:38 devstack sudo[84284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-32cc268c-7af8-4379-9f84-885cd58daaec Apr 22 17:51:38 devstack sudo[84284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:51:38 devstack sudo[84276]: pam_unix(sudo:session): session closed for user root Apr 22 17:51:38 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-cfddc68d-c1f4-457d-ad6f-24d1f7729735 tempest-GroupsV314Test-1716709815 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7eea2c16-06a4-4f71-85d7-18b544a38724" returned: 0 in 0.774s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:51:38 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-cfddc68d-c1f4-457d-ad6f-24d1f7729735 tempest-GroupsV314Test-1716709815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7eea2c16-06a4-4f71-85d7-18b544a38724 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:51:38 devstack sudo[84286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7eea2c16-06a4-4f71-85d7-18b544a38724 Apr 22 17:51:38 devstack sudo[84286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:51:39 devstack sudo[84284]: pam_unix(sudo:session): session closed for user root Apr 22 17:51:39 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-12efc747-03b4-4b2b-a668-da72d9c57e36 tempest-VolumesTestJSON-1695673024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-32cc268c-7af8-4379-9f84-885cd58daaec" returned: 0 in 0.599s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:51:39 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-12efc747-03b4-4b2b-a668-da72d9c57e36 tempest-VolumesTestJSON-1695673024 None] <== create_volume: return (1555ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'} {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 17:51:39 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-12efc747-03b4-4b2b-a668-da72d9c57e36 tempest-VolumesTestJSON-1695673024 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.560s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:51:39 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-12efc747-03b4-4b2b-a668-da72d9c57e36 tempest-VolumesTestJSON-1695673024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b74747ac-ed16-488e-8376-0c17ad21da01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32cc268c-7af8-4379-9f84-885cd58daaec', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:51:39 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-12efc747-03b4-4b2b-a668-da72d9c57e36 tempest-VolumesTestJSON-1695673024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87cb0981-393b-43eb-b61e-097fe70dc23d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:51:39 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-12efc747-03b4-4b2b-a668-da72d9c57e36 tempest-VolumesTestJSON-1695673024 None] Volume volume-32cc268c-7af8-4379-9f84-885cd58daaec (32cc268c-7af8-4379-9f84-885cd58daaec): created successfully Apr 22 17:51:39 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-12efc747-03b4-4b2b-a668-da72d9c57e36 tempest-VolumesTestJSON-1695673024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87cb0981-393b-43eb-b61e-097fe70dc23d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:51:39 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-12efc747-03b4-4b2b-a668-da72d9c57e36 tempest-VolumesTestJSON-1695673024 None] Flow 'volume_create_manager' (fd911d26-c82c-477b-a3ba-f3138b794ec0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:51:39 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-12efc747-03b4-4b2b-a668-da72d9c57e36 tempest-VolumesTestJSON-1695673024 None] Created volume successfully. Apr 22 17:51:39 devstack sudo[84286]: pam_unix(sudo:session): session closed for user root Apr 22 17:51:39 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-cfddc68d-c1f4-457d-ad6f-24d1f7729735 tempest-GroupsV314Test-1716709815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7eea2c16-06a4-4f71-85d7-18b544a38724" returned: 0 in 0.643s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:51:39 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-cfddc68d-c1f4-457d-ad6f-24d1f7729735 tempest-GroupsV314Test-1716709815 None] Lock "cinder-quobyte-7eea2c16-06a4-4f71-85d7-18b544a38724" released by "delete_volume" :: held 1.459s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:51:39 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-cfddc68d-c1f4-457d-ad6f-24d1f7729735 tempest-GroupsV314Test-1716709815 None] Created reservations ['5ca7ba19-f58f-435e-8dc3-8487e479b84a'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 17:51:39 devstack cinder-volume[81771]: WARNING cinder.quota [None req-cfddc68d-c1f4-457d-ad6f-24d1f7729735 tempest-GroupsV314Test-1716709815 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-2028943420 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-2028943420, it is now deprecated. Please use the default quota class for default quota. Apr 22 17:51:39 devstack cinder-volume[81771]: WARNING cinder.quota [None req-cfddc68d-c1f4-457d-ad6f-24d1f7729735 tempest-GroupsV314Test-1716709815 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-2028943420 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-2028943420, it is now deprecated. Please use the default quota class for default quota. Apr 22 17:51:39 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-cfddc68d-c1f4-457d-ad6f-24d1f7729735 tempest-GroupsV314Test-1716709815 None] Created reservations ['29a768db-64ae-45a1-8086-7993416d0e86', '44b82856-eaa2-4e98-baad-7c2a4a1936a0', '7320b6dc-3298-471a-bd25-10a6f26390d9', '97d91903-8aa6-4986-a24d-01e652371209'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 17:51:39 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-cfddc68d-c1f4-457d-ad6f-24d1f7729735 tempest-GroupsV314Test-1716709815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:51:39 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-cfddc68d-c1f4-457d-ad6f-24d1f7729735 tempest-GroupsV314Test-1716709815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:51:39 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-cfddc68d-c1f4-457d-ad6f-24d1f7729735 tempest-GroupsV314Test-1716709815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:51:39 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-cfddc68d-c1f4-457d-ad6f-24d1f7729735 tempest-GroupsV314Test-1716709815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:51:39 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-cfddc68d-c1f4-457d-ad6f-24d1f7729735 tempest-GroupsV314Test-1716709815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:51:39 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-cfddc68d-c1f4-457d-ad6f-24d1f7729735 tempest-GroupsV314Test-1716709815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:51:39 devstack sudo[84290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 Apr 22 17:51:39 devstack sudo[84290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:51:40 devstack cinder-volume[81771]: DEBUG cinder.volume.flows.manager.create_volume [None req-772843f7-04a3-4ea3-99a5-d493a765c437 tempest-VolumesTestJSON-1695673024 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 17:51:40 devstack sudo[84290]: pam_unix(sudo:session): session closed for user root Apr 22 17:51:40 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-772843f7-04a3-4ea3-99a5-d493a765c437 tempest-VolumesTestJSON-1695673024 None] Flow 'volume_create_manager' (79993efc-bbd0-4b1b-8f5c-06b584714dfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:51:40 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-772843f7-04a3-4ea3-99a5-d493a765c437 tempest-VolumesTestJSON-1695673024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b6a5e73-930b-466d-b94a-849f915ca9a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:51:40 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-772843f7-04a3-4ea3-99a5-d493a765c437 tempest-VolumesTestJSON-1695673024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b6a5e73-930b-466d-b94a-849f915ca9a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:51:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1180608848',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ab5eb44-e8f6-45f9-b471-45a4bc6ffe2a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7d5ce4afb9ca42a49e483d5897339651',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:51:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:51:40Z,use_quota=True,user_id='766cf71afddf4e778bf637fbd23ee19e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:51:40 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-772843f7-04a3-4ea3-99a5-d493a765c437 tempest-VolumesTestJSON-1695673024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86e3af76-3ba9-4065-9e9c-5d1a84dcf88c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:51:40 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-772843f7-04a3-4ea3-99a5-d493a765c437 tempest-VolumesTestJSON-1695673024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86e3af76-3ba9-4065-9e9c-5d1a84dcf88c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:51:40 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-772843f7-04a3-4ea3-99a5-d493a765c437 tempest-VolumesTestJSON-1695673024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eaf6a62b-fa1a-48ba-a492-7961acf81cb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:51:40 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-772843f7-04a3-4ea3-99a5-d493a765c437 tempest-VolumesTestJSON-1695673024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eaf6a62b-fa1a-48ba-a492-7961acf81cb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ab5eb44-e8f6-45f9-b471-45a4bc6ffe2a', 'volume_name': 'volume-0ab5eb44-e8f6-45f9-b471-45a4bc6ffe2a', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:51:40 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-772843f7-04a3-4ea3-99a5-d493a765c437 tempest-VolumesTestJSON-1695673024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3863580b-a24c-4f40-b761-eee0264155a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:51:40 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-772843f7-04a3-4ea3-99a5-d493a765c437 tempest-VolumesTestJSON-1695673024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3863580b-a24c-4f40-b761-eee0264155a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:51:40 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-772843f7-04a3-4ea3-99a5-d493a765c437 tempest-VolumesTestJSON-1695673024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dade213-7cef-4084-bf21-26345ccd010b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:51:40 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-772843f7-04a3-4ea3-99a5-d493a765c437 tempest-VolumesTestJSON-1695673024 None] Volume 0ab5eb44-e8f6-45f9-b471-45a4bc6ffe2a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ab5eb44-e8f6-45f9-b471-45a4bc6ffe2a', 'volume_size': 1} Apr 22 17:51:40 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-772843f7-04a3-4ea3-99a5-d493a765c437 tempest-VolumesTestJSON-1695673024 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:51:40 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-772843f7-04a3-4ea3-99a5-d493a765c437 tempest-VolumesTestJSON-1695673024 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:51:40 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-772843f7-04a3-4ea3-99a5-d493a765c437 tempest-VolumesTestJSON-1695673024 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:51:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1180608848',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ab5eb44-e8f6-45f9-b471-45a4bc6ffe2a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7d5ce4afb9ca42a49e483d5897339651',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:51:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:51:40Z,use_quota=True,user_id='766cf71afddf4e778bf637fbd23ee19e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)}" {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 17:51:40 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-772843f7-04a3-4ea3-99a5-d493a765c437 tempest-VolumesTestJSON-1695673024 None] Creating volume 0ab5eb44-e8f6-45f9-b471-45a4bc6ffe2a {{(pid=81771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 17:51:40 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-772843f7-04a3-4ea3-99a5-d493a765c437 tempest-VolumesTestJSON-1695673024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:51:40 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-772843f7-04a3-4ea3-99a5-d493a765c437 tempest-VolumesTestJSON-1695673024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:51:40 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-772843f7-04a3-4ea3-99a5-d493a765c437 tempest-VolumesTestJSON-1695673024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:51:40 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-772843f7-04a3-4ea3-99a5-d493a765c437 tempest-VolumesTestJSON-1695673024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:51:40 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-772843f7-04a3-4ea3-99a5-d493a765c437 tempest-VolumesTestJSON-1695673024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:51:40 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-772843f7-04a3-4ea3-99a5-d493a765c437 tempest-VolumesTestJSON-1695673024 None] Selected osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 as target Quobyte volume. {{(pid=81771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 17:51:40 devstack cinder-volume[81771]: INFO cinder.volume.drivers.remotefs [None req-772843f7-04a3-4ea3-99a5-d493a765c437 tempest-VolumesTestJSON-1695673024 None] casted to osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 Apr 22 17:51:40 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-772843f7-04a3-4ea3-99a5-d493a765c437 tempest-VolumesTestJSON-1695673024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-0ab5eb44-e8f6-45f9-b471-45a4bc6ffe2a 1073741824 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:51:40 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-cfddc68d-c1f4-457d-ad6f-24d1f7729735 tempest-GroupsV314Test-1716709815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33" returned: 0 in 0.841s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:51:40 devstack cinder-volume[81771]: DEBUG cinder.manager [None req-cfddc68d-c1f4-457d-ad6f-24d1f7729735 tempest-GroupsV314Test-1716709815 None] Notifying Schedulers of capabilities ... {{(pid=81771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 17:51:40 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-cfddc68d-c1f4-457d-ad6f-24d1f7729735 tempest-GroupsV314Test-1716709815 None] Delete group completed successfully. Apr 22 17:51:40 devstack sudo[84360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-0ab5eb44-e8f6-45f9-b471-45a4bc6ffe2a 1073741824 Apr 22 17:51:40 devstack sudo[84360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:51:40 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-a82a3430-8afa-4bd5-93bf-aec41d26c856 tempest-GroupsV314Test-1716709815 None] Acquiring lock "cinder-quobyte-b406e226-fea3-474c-ac0b-de22c6f77255" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:51:40 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-a82a3430-8afa-4bd5-93bf-aec41d26c856 tempest-GroupsV314Test-1716709815 None] Lock "cinder-quobyte-b406e226-fea3-474c-ac0b-de22c6f77255" acquired by "delete_volume" :: waited 0.027s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:51:40 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d52414f-7fdc-464d-87d3-bfd38162464b]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:51:40 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-a82a3430-8afa-4bd5-93bf-aec41d26c856 tempest-GroupsV314Test-1716709815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b406e226-fea3-474c-ac0b-de22c6f77255 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:51:41 devstack sudo[84362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b406e226-fea3-474c-ac0b-de22c6f77255 Apr 22 17:51:41 devstack sudo[84362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:51:41 devstack sudo[84360]: pam_unix(sudo:session): session closed for user root Apr 22 17:51:41 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-772843f7-04a3-4ea3-99a5-d493a765c437 tempest-VolumesTestJSON-1695673024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-0ab5eb44-e8f6-45f9-b471-45a4bc6ffe2a 1073741824" returned: 0 in 0.875s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:51:41 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-772843f7-04a3-4ea3-99a5-d493a765c437 tempest-VolumesTestJSON-1695673024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-0ab5eb44-e8f6-45f9-b471-45a4bc6ffe2a {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:51:41 devstack sudo[84373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-0ab5eb44-e8f6-45f9-b471-45a4bc6ffe2a Apr 22 17:51:41 devstack sudo[84373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:51:41 devstack sudo[84362]: pam_unix(sudo:session): session closed for user root Apr 22 17:51:41 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-a82a3430-8afa-4bd5-93bf-aec41d26c856 tempest-GroupsV314Test-1716709815 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b406e226-fea3-474c-ac0b-de22c6f77255" returned: 0 in 0.854s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:51:41 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-a82a3430-8afa-4bd5-93bf-aec41d26c856 tempest-GroupsV314Test-1716709815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b406e226-fea3-474c-ac0b-de22c6f77255 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:51:41 devstack sudo[84376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b406e226-fea3-474c-ac0b-de22c6f77255 Apr 22 17:51:41 devstack sudo[84376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:51:42 devstack sudo[84373]: pam_unix(sudo:session): session closed for user root Apr 22 17:51:42 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-772843f7-04a3-4ea3-99a5-d493a765c437 tempest-VolumesTestJSON-1695673024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-0ab5eb44-e8f6-45f9-b471-45a4bc6ffe2a" returned: 0 in 0.590s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:51:42 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-772843f7-04a3-4ea3-99a5-d493a765c437 tempest-VolumesTestJSON-1695673024 None] <== create_volume: return (1579ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'} {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 17:51:42 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-772843f7-04a3-4ea3-99a5-d493a765c437 tempest-VolumesTestJSON-1695673024 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.582s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:51:42 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-772843f7-04a3-4ea3-99a5-d493a765c437 tempest-VolumesTestJSON-1695673024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dade213-7cef-4084-bf21-26345ccd010b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ab5eb44-e8f6-45f9-b471-45a4bc6ffe2a', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:51:42 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-772843f7-04a3-4ea3-99a5-d493a765c437 tempest-VolumesTestJSON-1695673024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05ee2d82-7a3b-4d31-b040-f3a15ce165e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:51:42 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-772843f7-04a3-4ea3-99a5-d493a765c437 tempest-VolumesTestJSON-1695673024 None] Volume volume-0ab5eb44-e8f6-45f9-b471-45a4bc6ffe2a (0ab5eb44-e8f6-45f9-b471-45a4bc6ffe2a): created successfully Apr 22 17:51:42 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-772843f7-04a3-4ea3-99a5-d493a765c437 tempest-VolumesTestJSON-1695673024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05ee2d82-7a3b-4d31-b040-f3a15ce165e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:51:42 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-772843f7-04a3-4ea3-99a5-d493a765c437 tempest-VolumesTestJSON-1695673024 None] Flow 'volume_create_manager' (79993efc-bbd0-4b1b-8f5c-06b584714dfe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:51:42 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-772843f7-04a3-4ea3-99a5-d493a765c437 tempest-VolumesTestJSON-1695673024 None] Created volume successfully. Apr 22 17:51:42 devstack sudo[84376]: pam_unix(sudo:session): session closed for user root Apr 22 17:51:42 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-a82a3430-8afa-4bd5-93bf-aec41d26c856 tempest-GroupsV314Test-1716709815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b406e226-fea3-474c-ac0b-de22c6f77255" returned: 0 in 0.567s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:51:42 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-a82a3430-8afa-4bd5-93bf-aec41d26c856 tempest-GroupsV314Test-1716709815 None] Lock "cinder-quobyte-b406e226-fea3-474c-ac0b-de22c6f77255" released by "delete_volume" :: held 1.509s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:51:42 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-a82a3430-8afa-4bd5-93bf-aec41d26c856 tempest-GroupsV314Test-1716709815 None] Created reservations ['49146678-8770-4125-bd22-e3b5754460c6'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 17:51:42 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-a82a3430-8afa-4bd5-93bf-aec41d26c856 tempest-GroupsV314Test-1716709815 None] Created reservations ['8eebe807-0e98-4332-8709-020dcdec5d22', '32b914a2-d22a-48e9-8f96-af5a69b9620b', '69dc5b6f-85c0-4074-951a-6f006c70bbc1', 'c73fec86-ec7b-46eb-94af-de1949a20ce9'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 17:51:42 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-a82a3430-8afa-4bd5-93bf-aec41d26c856 tempest-GroupsV314Test-1716709815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:51:42 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-a82a3430-8afa-4bd5-93bf-aec41d26c856 tempest-GroupsV314Test-1716709815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:51:42 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-a82a3430-8afa-4bd5-93bf-aec41d26c856 tempest-GroupsV314Test-1716709815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:51:42 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-a82a3430-8afa-4bd5-93bf-aec41d26c856 tempest-GroupsV314Test-1716709815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:51:42 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-a82a3430-8afa-4bd5-93bf-aec41d26c856 tempest-GroupsV314Test-1716709815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:51:42 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-a82a3430-8afa-4bd5-93bf-aec41d26c856 tempest-GroupsV314Test-1716709815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:51:42 devstack sudo[84380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 Apr 22 17:51:42 devstack sudo[84380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:51:43 devstack sudo[84380]: pam_unix(sudo:session): session closed for user root Apr 22 17:51:43 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-a82a3430-8afa-4bd5-93bf-aec41d26c856 tempest-GroupsV314Test-1716709815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33" returned: 0 in 0.614s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:51:43 devstack cinder-volume[81771]: DEBUG cinder.manager [None req-a82a3430-8afa-4bd5-93bf-aec41d26c856 tempest-GroupsV314Test-1716709815 None] Notifying Schedulers of capabilities ... {{(pid=81771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 17:51:43 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-a82a3430-8afa-4bd5-93bf-aec41d26c856 tempest-GroupsV314Test-1716709815 None] Delete group completed successfully. Apr 22 17:51:43 devstack cinder-volume[81771]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b77e5ba-cecb-4552-8178-38ebd58f2ecf tempest-VolumesTestJSON-1695673024 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 17:51:43 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-4b77e5ba-cecb-4552-8178-38ebd58f2ecf tempest-VolumesTestJSON-1695673024 None] Flow 'volume_create_manager' (50e2d3d7-b81d-4c5a-ac18-f74916af40a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:51:43 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-4b77e5ba-cecb-4552-8178-38ebd58f2ecf tempest-VolumesTestJSON-1695673024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (877adb3d-a0aa-45ea-9c40-4b04de35c61d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:51:43 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-4b77e5ba-cecb-4552-8178-38ebd58f2ecf tempest-VolumesTestJSON-1695673024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (877adb3d-a0aa-45ea-9c40-4b04de35c61d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:51:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1900205317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2202c63b-a611-4549-bf6e-1ad8b5b736ef,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7d5ce4afb9ca42a49e483d5897339651',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:51:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:51:43Z,use_quota=True,user_id='766cf71afddf4e778bf637fbd23ee19e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:51:43 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-4b77e5ba-cecb-4552-8178-38ebd58f2ecf tempest-VolumesTestJSON-1695673024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e65fbb5-8c5d-4769-a589-dbcf748b2589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:51:43 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-4b77e5ba-cecb-4552-8178-38ebd58f2ecf tempest-VolumesTestJSON-1695673024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e65fbb5-8c5d-4769-a589-dbcf748b2589) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:51:43 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-4b77e5ba-cecb-4552-8178-38ebd58f2ecf tempest-VolumesTestJSON-1695673024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69b13313-6a93-49e7-b24d-2350209205a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:51:43 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-4b77e5ba-cecb-4552-8178-38ebd58f2ecf tempest-VolumesTestJSON-1695673024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69b13313-6a93-49e7-b24d-2350209205a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2202c63b-a611-4549-bf6e-1ad8b5b736ef', 'volume_name': 'volume-2202c63b-a611-4549-bf6e-1ad8b5b736ef', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:51:43 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-4b77e5ba-cecb-4552-8178-38ebd58f2ecf tempest-VolumesTestJSON-1695673024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60fd137e-b3fb-4510-a680-68acd54c4360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:51:43 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-4b77e5ba-cecb-4552-8178-38ebd58f2ecf tempest-VolumesTestJSON-1695673024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60fd137e-b3fb-4510-a680-68acd54c4360) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:51:43 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-4b77e5ba-cecb-4552-8178-38ebd58f2ecf tempest-VolumesTestJSON-1695673024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (380c6bc0-754a-43e0-8ec3-0c0ebed81dcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:51:43 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-4b77e5ba-cecb-4552-8178-38ebd58f2ecf tempest-VolumesTestJSON-1695673024 None] Volume 2202c63b-a611-4549-bf6e-1ad8b5b736ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2202c63b-a611-4549-bf6e-1ad8b5b736ef', 'volume_size': 1} Apr 22 17:51:43 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-4b77e5ba-cecb-4552-8178-38ebd58f2ecf tempest-VolumesTestJSON-1695673024 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:51:43 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-4b77e5ba-cecb-4552-8178-38ebd58f2ecf tempest-VolumesTestJSON-1695673024 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:51:43 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-4b77e5ba-cecb-4552-8178-38ebd58f2ecf tempest-VolumesTestJSON-1695673024 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:51:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1900205317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2202c63b-a611-4549-bf6e-1ad8b5b736ef,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7d5ce4afb9ca42a49e483d5897339651',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:51:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:51:43Z,use_quota=True,user_id='766cf71afddf4e778bf637fbd23ee19e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)}" {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 17:51:43 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-4b77e5ba-cecb-4552-8178-38ebd58f2ecf tempest-VolumesTestJSON-1695673024 None] Creating volume 2202c63b-a611-4549-bf6e-1ad8b5b736ef {{(pid=81771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 17:51:43 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-4b77e5ba-cecb-4552-8178-38ebd58f2ecf tempest-VolumesTestJSON-1695673024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:51:43 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-4b77e5ba-cecb-4552-8178-38ebd58f2ecf tempest-VolumesTestJSON-1695673024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:51:43 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-4b77e5ba-cecb-4552-8178-38ebd58f2ecf tempest-VolumesTestJSON-1695673024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:51:43 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-4b77e5ba-cecb-4552-8178-38ebd58f2ecf tempest-VolumesTestJSON-1695673024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:51:43 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-4b77e5ba-cecb-4552-8178-38ebd58f2ecf tempest-VolumesTestJSON-1695673024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:51:43 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-4b77e5ba-cecb-4552-8178-38ebd58f2ecf tempest-VolumesTestJSON-1695673024 None] Selected osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 as target Quobyte volume. {{(pid=81771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 17:51:43 devstack cinder-volume[81771]: INFO cinder.volume.drivers.remotefs [None req-4b77e5ba-cecb-4552-8178-38ebd58f2ecf tempest-VolumesTestJSON-1695673024 None] casted to osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 Apr 22 17:51:43 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-4b77e5ba-cecb-4552-8178-38ebd58f2ecf tempest-VolumesTestJSON-1695673024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-2202c63b-a611-4549-bf6e-1ad8b5b736ef 1073741824 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:51:43 devstack sudo[84706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-2202c63b-a611-4549-bf6e-1ad8b5b736ef 1073741824 Apr 22 17:51:43 devstack sudo[84706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:51:44 devstack sudo[84706]: pam_unix(sudo:session): session closed for user root Apr 22 17:51:44 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-4b77e5ba-cecb-4552-8178-38ebd58f2ecf tempest-VolumesTestJSON-1695673024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-2202c63b-a611-4549-bf6e-1ad8b5b736ef 1073741824" returned: 0 in 0.925s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:51:44 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-4b77e5ba-cecb-4552-8178-38ebd58f2ecf tempest-VolumesTestJSON-1695673024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-2202c63b-a611-4549-bf6e-1ad8b5b736ef {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:51:44 devstack sudo[84723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-2202c63b-a611-4549-bf6e-1ad8b5b736ef Apr 22 17:51:44 devstack sudo[84723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:51:45 devstack sudo[84723]: pam_unix(sudo:session): session closed for user root Apr 22 17:51:45 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-4b77e5ba-cecb-4552-8178-38ebd58f2ecf tempest-VolumesTestJSON-1695673024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-2202c63b-a611-4549-bf6e-1ad8b5b736ef" returned: 0 in 0.675s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:51:45 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-4b77e5ba-cecb-4552-8178-38ebd58f2ecf tempest-VolumesTestJSON-1695673024 None] <== create_volume: return (1676ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'} {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 17:51:45 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-4b77e5ba-cecb-4552-8178-38ebd58f2ecf tempest-VolumesTestJSON-1695673024 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.686s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:51:45 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-4b77e5ba-cecb-4552-8178-38ebd58f2ecf tempest-VolumesTestJSON-1695673024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (380c6bc0-754a-43e0-8ec3-0c0ebed81dcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2202c63b-a611-4549-bf6e-1ad8b5b736ef', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:51:45 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-4b77e5ba-cecb-4552-8178-38ebd58f2ecf tempest-VolumesTestJSON-1695673024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0eed59e9-8c04-4741-a0fc-62d9211d0d0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:51:45 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-4b77e5ba-cecb-4552-8178-38ebd58f2ecf tempest-VolumesTestJSON-1695673024 None] Volume volume-2202c63b-a611-4549-bf6e-1ad8b5b736ef (2202c63b-a611-4549-bf6e-1ad8b5b736ef): created successfully Apr 22 17:51:45 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-4b77e5ba-cecb-4552-8178-38ebd58f2ecf tempest-VolumesTestJSON-1695673024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0eed59e9-8c04-4741-a0fc-62d9211d0d0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:51:45 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-4b77e5ba-cecb-4552-8178-38ebd58f2ecf tempest-VolumesTestJSON-1695673024 None] Flow 'volume_create_manager' (50e2d3d7-b81d-4c5a-ac18-f74916af40a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:51:45 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-4b77e5ba-cecb-4552-8178-38ebd58f2ecf tempest-VolumesTestJSON-1695673024 None] Created volume successfully. Apr 22 17:51:47 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-f47dd122-8e97-4996-b03d-763a8d42025d tempest-VolumesTestJSON-1695673024 None] Acquiring lock "cinder-2202c63b-a611-4549-bf6e-1ad8b5b736ef-delete_volume" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:51:47 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-f47dd122-8e97-4996-b03d-763a8d42025d tempest-VolumesTestJSON-1695673024 None] Lock "cinder-2202c63b-a611-4549-bf6e-1ad8b5b736ef-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:51:47 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-f47dd122-8e97-4996-b03d-763a8d42025d tempest-VolumesTestJSON-1695673024 None] Acquiring lock "cinder-quobyte-2202c63b-a611-4549-bf6e-1ad8b5b736ef" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:51:47 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-f47dd122-8e97-4996-b03d-763a8d42025d tempest-VolumesTestJSON-1695673024 None] Lock "cinder-quobyte-2202c63b-a611-4549-bf6e-1ad8b5b736ef" acquired by "delete_volume" :: waited 0.021s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:51:47 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[bceb0c87-5c7b-46e9-a18a-74d63ae1f1b1]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:51:47 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-f47dd122-8e97-4996-b03d-763a8d42025d tempest-VolumesTestJSON-1695673024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-2202c63b-a611-4549-bf6e-1ad8b5b736ef {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:51:47 devstack sudo[84759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-2202c63b-a611-4549-bf6e-1ad8b5b736ef Apr 22 17:51:47 devstack sudo[84759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:51:48 devstack sudo[84759]: pam_unix(sudo:session): session closed for user root Apr 22 17:51:48 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-f47dd122-8e97-4996-b03d-763a8d42025d tempest-VolumesTestJSON-1695673024 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-2202c63b-a611-4549-bf6e-1ad8b5b736ef" returned: 0 in 0.769s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:51:48 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-f47dd122-8e97-4996-b03d-763a8d42025d tempest-VolumesTestJSON-1695673024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-2202c63b-a611-4549-bf6e-1ad8b5b736ef {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:51:48 devstack sudo[84765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-2202c63b-a611-4549-bf6e-1ad8b5b736ef Apr 22 17:51:48 devstack sudo[84765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:51:48 devstack sudo[84765]: pam_unix(sudo:session): session closed for user root Apr 22 17:51:48 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-f47dd122-8e97-4996-b03d-763a8d42025d tempest-VolumesTestJSON-1695673024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-2202c63b-a611-4549-bf6e-1ad8b5b736ef" returned: 0 in 0.848s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:51:48 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-f47dd122-8e97-4996-b03d-763a8d42025d tempest-VolumesTestJSON-1695673024 None] Lock "cinder-quobyte-2202c63b-a611-4549-bf6e-1ad8b5b736ef" released by "delete_volume" :: held 1.682s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:51:49 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-f47dd122-8e97-4996-b03d-763a8d42025d tempest-VolumesTestJSON-1695673024 None] Created reservations ['3eca2bd4-4e44-4502-9e65-4391990c6555', '4d2e9470-3883-4a91-ba0f-a8aab4972a7a', '8a95f00e-d281-4f65-8ddc-2140d561a7dc', '0cc32c47-7466-48bd-a836-17be51b69d9a'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 17:51:49 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-f47dd122-8e97-4996-b03d-763a8d42025d tempest-VolumesTestJSON-1695673024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:51:49 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-f47dd122-8e97-4996-b03d-763a8d42025d tempest-VolumesTestJSON-1695673024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:51:49 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-f47dd122-8e97-4996-b03d-763a8d42025d tempest-VolumesTestJSON-1695673024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:51:49 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-f47dd122-8e97-4996-b03d-763a8d42025d tempest-VolumesTestJSON-1695673024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:51:49 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-f47dd122-8e97-4996-b03d-763a8d42025d tempest-VolumesTestJSON-1695673024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:51:49 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-f47dd122-8e97-4996-b03d-763a8d42025d tempest-VolumesTestJSON-1695673024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:51:49 devstack sudo[84770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 Apr 22 17:51:49 devstack sudo[84770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:51:49 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-5fcad8ac-60de-4d91-ada6-36634f57aaea tempest-VolumesTestJSON-1695673024 None] Acquiring lock "cinder-0ab5eb44-e8f6-45f9-b471-45a4bc6ffe2a-delete_volume" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:51:49 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-5fcad8ac-60de-4d91-ada6-36634f57aaea tempest-VolumesTestJSON-1695673024 None] Lock "cinder-0ab5eb44-e8f6-45f9-b471-45a4bc6ffe2a-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:51:49 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-5fcad8ac-60de-4d91-ada6-36634f57aaea tempest-VolumesTestJSON-1695673024 None] Acquiring lock "cinder-quobyte-0ab5eb44-e8f6-45f9-b471-45a4bc6ffe2a" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:51:49 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-5fcad8ac-60de-4d91-ada6-36634f57aaea tempest-VolumesTestJSON-1695673024 None] Lock "cinder-quobyte-0ab5eb44-e8f6-45f9-b471-45a4bc6ffe2a" acquired by "delete_volume" :: waited 0.024s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:51:49 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d49929b-d61f-4827-9cb7-e1fb7630326d]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:51:49 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-5fcad8ac-60de-4d91-ada6-36634f57aaea tempest-VolumesTestJSON-1695673024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-0ab5eb44-e8f6-45f9-b471-45a4bc6ffe2a {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:51:50 devstack sudo[84778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-0ab5eb44-e8f6-45f9-b471-45a4bc6ffe2a Apr 22 17:51:50 devstack sudo[84778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:51:50 devstack sudo[84770]: pam_unix(sudo:session): session closed for user root Apr 22 17:51:50 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-f47dd122-8e97-4996-b03d-763a8d42025d tempest-VolumesTestJSON-1695673024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33" returned: 0 in 1.394s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:51:50 devstack cinder-volume[81771]: DEBUG cinder.manager [None req-f47dd122-8e97-4996-b03d-763a8d42025d tempest-VolumesTestJSON-1695673024 None] Notifying Schedulers of capabilities ... {{(pid=81771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 17:51:50 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-f47dd122-8e97-4996-b03d-763a8d42025d tempest-VolumesTestJSON-1695673024 None] Deleted volume successfully. Apr 22 17:51:50 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-f47dd122-8e97-4996-b03d-763a8d42025d tempest-VolumesTestJSON-1695673024 None] Lock "cinder-2202c63b-a611-4549-bf6e-1ad8b5b736ef-delete_volume" released by "delete_volume" :: held 3.438s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:51:50 devstack sudo[84778]: pam_unix(sudo:session): session closed for user root Apr 22 17:51:50 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-5fcad8ac-60de-4d91-ada6-36634f57aaea tempest-VolumesTestJSON-1695673024 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-0ab5eb44-e8f6-45f9-b471-45a4bc6ffe2a" returned: 0 in 1.077s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:51:50 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-5fcad8ac-60de-4d91-ada6-36634f57aaea tempest-VolumesTestJSON-1695673024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-0ab5eb44-e8f6-45f9-b471-45a4bc6ffe2a {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:51:50 devstack sudo[84801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-0ab5eb44-e8f6-45f9-b471-45a4bc6ffe2a Apr 22 17:51:50 devstack sudo[84801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:51:51 devstack sudo[84801]: pam_unix(sudo:session): session closed for user root Apr 22 17:51:51 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-5fcad8ac-60de-4d91-ada6-36634f57aaea tempest-VolumesTestJSON-1695673024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-0ab5eb44-e8f6-45f9-b471-45a4bc6ffe2a" returned: 0 in 0.607s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:51:51 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-5fcad8ac-60de-4d91-ada6-36634f57aaea tempest-VolumesTestJSON-1695673024 None] Lock "cinder-quobyte-0ab5eb44-e8f6-45f9-b471-45a4bc6ffe2a" released by "delete_volume" :: held 1.748s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:51:51 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-5fcad8ac-60de-4d91-ada6-36634f57aaea tempest-VolumesTestJSON-1695673024 None] Created reservations ['787f4f3f-d381-4692-bb1b-d9300a411632', 'f9cf6a9f-cdee-4d9a-a79b-d1dacdb1028a', 'b70e67b7-20ea-4a09-818a-1ee0ddde4b49', 'b5346bd6-e7cb-4fdf-af3f-30c8629264a5'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 17:51:51 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-5fcad8ac-60de-4d91-ada6-36634f57aaea tempest-VolumesTestJSON-1695673024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:51:51 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-5fcad8ac-60de-4d91-ada6-36634f57aaea tempest-VolumesTestJSON-1695673024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:51:51 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-5fcad8ac-60de-4d91-ada6-36634f57aaea tempest-VolumesTestJSON-1695673024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:51:51 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-5fcad8ac-60de-4d91-ada6-36634f57aaea tempest-VolumesTestJSON-1695673024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:51:51 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-5fcad8ac-60de-4d91-ada6-36634f57aaea tempest-VolumesTestJSON-1695673024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:51:51 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-5fcad8ac-60de-4d91-ada6-36634f57aaea tempest-VolumesTestJSON-1695673024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:51:51 devstack sudo[84806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 Apr 22 17:51:51 devstack sudo[84806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:51:52 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-94c7bed0-b9dd-486f-b4d8-62063113cae6 tempest-VolumesTestJSON-1695673024 None] Acquiring lock "cinder-32cc268c-7af8-4379-9f84-885cd58daaec-delete_volume" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:51:52 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-94c7bed0-b9dd-486f-b4d8-62063113cae6 tempest-VolumesTestJSON-1695673024 None] Lock "cinder-32cc268c-7af8-4379-9f84-885cd58daaec-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:51:52 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-94c7bed0-b9dd-486f-b4d8-62063113cae6 tempest-VolumesTestJSON-1695673024 None] Acquiring lock "cinder-quobyte-32cc268c-7af8-4379-9f84-885cd58daaec" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:51:52 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-94c7bed0-b9dd-486f-b4d8-62063113cae6 tempest-VolumesTestJSON-1695673024 None] Lock "cinder-quobyte-32cc268c-7af8-4379-9f84-885cd58daaec" acquired by "delete_volume" :: waited 0.018s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:51:52 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c06ce7d-59fe-4f9f-a812-7f24fe67af6c]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:51:52 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-94c7bed0-b9dd-486f-b4d8-62063113cae6 tempest-VolumesTestJSON-1695673024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-32cc268c-7af8-4379-9f84-885cd58daaec {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:51:52 devstack sudo[84808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-32cc268c-7af8-4379-9f84-885cd58daaec Apr 22 17:51:52 devstack sudo[84808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:51:52 devstack sudo[84806]: pam_unix(sudo:session): session closed for user root Apr 22 17:51:52 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-5fcad8ac-60de-4d91-ada6-36634f57aaea tempest-VolumesTestJSON-1695673024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33" returned: 0 in 0.690s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:51:52 devstack cinder-volume[81771]: DEBUG cinder.manager [None req-5fcad8ac-60de-4d91-ada6-36634f57aaea tempest-VolumesTestJSON-1695673024 None] Notifying Schedulers of capabilities ... {{(pid=81771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 17:51:52 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-5fcad8ac-60de-4d91-ada6-36634f57aaea tempest-VolumesTestJSON-1695673024 None] Deleted volume successfully. Apr 22 17:51:52 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-5fcad8ac-60de-4d91-ada6-36634f57aaea tempest-VolumesTestJSON-1695673024 None] Lock "cinder-0ab5eb44-e8f6-45f9-b471-45a4bc6ffe2a-delete_volume" released by "delete_volume" :: held 2.817s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:51:52 devstack cinder-volume[81771]: DEBUG cinder.volume.flows.manager.create_volume [None req-c794ef19-f42c-4524-ab10-02b6a0b2ea73 tempest-VolumeQuotasAdminTestJSON-854747580 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 17:51:52 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-c794ef19-f42c-4524-ab10-02b6a0b2ea73 tempest-VolumeQuotasAdminTestJSON-854747580 None] Flow 'volume_create_manager' (5e4b5b5a-7c90-4dc4-bbfd-2b3c32dc7ba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:51:52 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-c794ef19-f42c-4524-ab10-02b6a0b2ea73 tempest-VolumeQuotasAdminTestJSON-854747580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c654f4a7-94d9-40f6-8927-b401fe518535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:51:52 devstack sudo[84808]: pam_unix(sudo:session): session closed for user root Apr 22 17:51:52 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-94c7bed0-b9dd-486f-b4d8-62063113cae6 tempest-VolumesTestJSON-1695673024 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-32cc268c-7af8-4379-9f84-885cd58daaec" returned: 0 in 0.660s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:51:52 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-94c7bed0-b9dd-486f-b4d8-62063113cae6 tempest-VolumesTestJSON-1695673024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-32cc268c-7af8-4379-9f84-885cd58daaec {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:51:52 devstack sudo[84814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-32cc268c-7af8-4379-9f84-885cd58daaec Apr 22 17:51:52 devstack sudo[84814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:51:52 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-c794ef19-f42c-4524-ab10-02b6a0b2ea73 tempest-VolumeQuotasAdminTestJSON-854747580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c654f4a7-94d9-40f6-8927-b401fe518535) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:51:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-97486293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=669e7091-d755-4a89-8871-a82f140503c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6aadbfe412b6410ab762be97d8693aee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:51:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:51:53Z,use_quota=True,user_id='bcda776347654e2c8e93762847c59ba5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:51:52 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-c794ef19-f42c-4524-ab10-02b6a0b2ea73 tempest-VolumeQuotasAdminTestJSON-854747580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b1e2d01-33d4-4195-a46d-5f34c6bb482a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:51:52 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-c794ef19-f42c-4524-ab10-02b6a0b2ea73 tempest-VolumeQuotasAdminTestJSON-854747580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b1e2d01-33d4-4195-a46d-5f34c6bb482a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:51:52 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-c794ef19-f42c-4524-ab10-02b6a0b2ea73 tempest-VolumeQuotasAdminTestJSON-854747580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39f3fdd7-ea3e-4de5-9e7c-e9be54d33bf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:51:52 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-c794ef19-f42c-4524-ab10-02b6a0b2ea73 tempest-VolumeQuotasAdminTestJSON-854747580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39f3fdd7-ea3e-4de5-9e7c-e9be54d33bf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '669e7091-d755-4a89-8871-a82f140503c5', 'volume_name': 'volume-669e7091-d755-4a89-8871-a82f140503c5', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:51:52 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-c794ef19-f42c-4524-ab10-02b6a0b2ea73 tempest-VolumeQuotasAdminTestJSON-854747580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (068947c9-84dc-4689-916f-3af55ab41740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:51:52 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-c794ef19-f42c-4524-ab10-02b6a0b2ea73 tempest-VolumeQuotasAdminTestJSON-854747580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (068947c9-84dc-4689-916f-3af55ab41740) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:51:52 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-c794ef19-f42c-4524-ab10-02b6a0b2ea73 tempest-VolumeQuotasAdminTestJSON-854747580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (437f8eb0-44d2-4a51-98fa-86e3efe412e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:51:52 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-c794ef19-f42c-4524-ab10-02b6a0b2ea73 tempest-VolumeQuotasAdminTestJSON-854747580 None] Volume 669e7091-d755-4a89-8871-a82f140503c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-669e7091-d755-4a89-8871-a82f140503c5', 'volume_size': 1} Apr 22 17:51:52 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-c794ef19-f42c-4524-ab10-02b6a0b2ea73 tempest-VolumeQuotasAdminTestJSON-854747580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:51:52 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-c794ef19-f42c-4524-ab10-02b6a0b2ea73 tempest-VolumeQuotasAdminTestJSON-854747580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:51:52 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-c794ef19-f42c-4524-ab10-02b6a0b2ea73 tempest-VolumeQuotasAdminTestJSON-854747580 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:51:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-97486293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=669e7091-d755-4a89-8871-a82f140503c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6aadbfe412b6410ab762be97d8693aee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:51:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:51:53Z,use_quota=True,user_id='bcda776347654e2c8e93762847c59ba5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)}" {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 17:51:52 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-c794ef19-f42c-4524-ab10-02b6a0b2ea73 tempest-VolumeQuotasAdminTestJSON-854747580 None] Creating volume 669e7091-d755-4a89-8871-a82f140503c5 {{(pid=81771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 17:51:52 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-c794ef19-f42c-4524-ab10-02b6a0b2ea73 tempest-VolumeQuotasAdminTestJSON-854747580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:51:52 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-c794ef19-f42c-4524-ab10-02b6a0b2ea73 tempest-VolumeQuotasAdminTestJSON-854747580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:51:52 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-c794ef19-f42c-4524-ab10-02b6a0b2ea73 tempest-VolumeQuotasAdminTestJSON-854747580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:51:52 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-c794ef19-f42c-4524-ab10-02b6a0b2ea73 tempest-VolumeQuotasAdminTestJSON-854747580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:51:52 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-c794ef19-f42c-4524-ab10-02b6a0b2ea73 tempest-VolumeQuotasAdminTestJSON-854747580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:51:52 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-c794ef19-f42c-4524-ab10-02b6a0b2ea73 tempest-VolumeQuotasAdminTestJSON-854747580 None] Selected osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 as target Quobyte volume. {{(pid=81771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 17:51:52 devstack cinder-volume[81771]: INFO cinder.volume.drivers.remotefs [None req-c794ef19-f42c-4524-ab10-02b6a0b2ea73 tempest-VolumeQuotasAdminTestJSON-854747580 None] casted to osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 Apr 22 17:51:52 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-c794ef19-f42c-4524-ab10-02b6a0b2ea73 tempest-VolumeQuotasAdminTestJSON-854747580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-669e7091-d755-4a89-8871-a82f140503c5 1073741824 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:51:52 devstack sudo[84816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-669e7091-d755-4a89-8871-a82f140503c5 1073741824 Apr 22 17:51:52 devstack sudo[84816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:51:53 devstack sudo[84814]: pam_unix(sudo:session): session closed for user root Apr 22 17:51:53 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-94c7bed0-b9dd-486f-b4d8-62063113cae6 tempest-VolumesTestJSON-1695673024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-32cc268c-7af8-4379-9f84-885cd58daaec" returned: 0 in 0.521s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:51:53 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-94c7bed0-b9dd-486f-b4d8-62063113cae6 tempest-VolumesTestJSON-1695673024 None] Lock "cinder-quobyte-32cc268c-7af8-4379-9f84-885cd58daaec" released by "delete_volume" :: held 1.249s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:51:53 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-94c7bed0-b9dd-486f-b4d8-62063113cae6 tempest-VolumesTestJSON-1695673024 None] Created reservations ['886f03c6-38ef-4b76-919e-673df99115b6', '018097c0-5cf4-496b-8461-a0956b544edc', 'ea44ca42-955e-4044-a16b-542f1ed8721e', 'a65f2016-fe60-4007-b4d0-3f24c9a85303'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 17:51:53 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-94c7bed0-b9dd-486f-b4d8-62063113cae6 tempest-VolumesTestJSON-1695673024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:51:53 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-94c7bed0-b9dd-486f-b4d8-62063113cae6 tempest-VolumesTestJSON-1695673024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:51:53 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-94c7bed0-b9dd-486f-b4d8-62063113cae6 tempest-VolumesTestJSON-1695673024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:51:53 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-94c7bed0-b9dd-486f-b4d8-62063113cae6 tempest-VolumesTestJSON-1695673024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:51:53 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-94c7bed0-b9dd-486f-b4d8-62063113cae6 tempest-VolumesTestJSON-1695673024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:51:53 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-94c7bed0-b9dd-486f-b4d8-62063113cae6 tempest-VolumesTestJSON-1695673024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:51:53 devstack sudo[84822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 Apr 22 17:51:53 devstack sudo[84822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:51:53 devstack sudo[84816]: pam_unix(sudo:session): session closed for user root Apr 22 17:51:53 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-c794ef19-f42c-4524-ab10-02b6a0b2ea73 tempest-VolumeQuotasAdminTestJSON-854747580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-669e7091-d755-4a89-8871-a82f140503c5 1073741824" returned: 0 in 0.795s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:51:53 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-c794ef19-f42c-4524-ab10-02b6a0b2ea73 tempest-VolumeQuotasAdminTestJSON-854747580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-669e7091-d755-4a89-8871-a82f140503c5 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:51:53 devstack sudo[84824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-669e7091-d755-4a89-8871-a82f140503c5 Apr 22 17:51:53 devstack sudo[84824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:51:54 devstack sudo[84822]: pam_unix(sudo:session): session closed for user root Apr 22 17:51:54 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-94c7bed0-b9dd-486f-b4d8-62063113cae6 tempest-VolumesTestJSON-1695673024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33" returned: 0 in 0.613s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:51:54 devstack cinder-volume[81771]: DEBUG cinder.manager [None req-94c7bed0-b9dd-486f-b4d8-62063113cae6 tempest-VolumesTestJSON-1695673024 None] Notifying Schedulers of capabilities ... {{(pid=81771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 17:51:54 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-94c7bed0-b9dd-486f-b4d8-62063113cae6 tempest-VolumesTestJSON-1695673024 None] Deleted volume successfully. Apr 22 17:51:54 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-94c7bed0-b9dd-486f-b4d8-62063113cae6 tempest-VolumesTestJSON-1695673024 None] Lock "cinder-32cc268c-7af8-4379-9f84-885cd58daaec-delete_volume" released by "delete_volume" :: held 2.121s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:51:54 devstack sudo[84824]: pam_unix(sudo:session): session closed for user root Apr 22 17:51:54 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-c794ef19-f42c-4524-ab10-02b6a0b2ea73 tempest-VolumeQuotasAdminTestJSON-854747580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-669e7091-d755-4a89-8871-a82f140503c5" returned: 0 in 0.611s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:51:54 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-c794ef19-f42c-4524-ab10-02b6a0b2ea73 tempest-VolumeQuotasAdminTestJSON-854747580 None] <== create_volume: return (1450ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'} {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 17:51:54 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-c794ef19-f42c-4524-ab10-02b6a0b2ea73 tempest-VolumeQuotasAdminTestJSON-854747580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.454s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:51:54 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-c794ef19-f42c-4524-ab10-02b6a0b2ea73 tempest-VolumeQuotasAdminTestJSON-854747580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (437f8eb0-44d2-4a51-98fa-86e3efe412e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-669e7091-d755-4a89-8871-a82f140503c5', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:51:54 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-c794ef19-f42c-4524-ab10-02b6a0b2ea73 tempest-VolumeQuotasAdminTestJSON-854747580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b695c56-43de-4314-bc14-1484bbac960c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:51:54 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-c794ef19-f42c-4524-ab10-02b6a0b2ea73 tempest-VolumeQuotasAdminTestJSON-854747580 None] Volume volume-669e7091-d755-4a89-8871-a82f140503c5 (669e7091-d755-4a89-8871-a82f140503c5): created successfully Apr 22 17:51:54 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-c794ef19-f42c-4524-ab10-02b6a0b2ea73 tempest-VolumeQuotasAdminTestJSON-854747580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b695c56-43de-4314-bc14-1484bbac960c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:51:54 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-c794ef19-f42c-4524-ab10-02b6a0b2ea73 tempest-VolumeQuotasAdminTestJSON-854747580 None] Flow 'volume_create_manager' (5e4b5b5a-7c90-4dc4-bbfd-2b3c32dc7ba0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:51:54 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-c794ef19-f42c-4524-ab10-02b6a0b2ea73 tempest-VolumeQuotasAdminTestJSON-854747580 None] Created volume successfully. Apr 22 17:51:55 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-20d03eab-cfd7-4c58-98eb-6ebabf84344d tempest-VolumeQuotasAdminTestJSON-854747580 None] Acquiring lock "cinder-669e7091-d755-4a89-8871-a82f140503c5-delete_volume" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:51:55 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-20d03eab-cfd7-4c58-98eb-6ebabf84344d tempest-VolumeQuotasAdminTestJSON-854747580 None] Lock "cinder-669e7091-d755-4a89-8871-a82f140503c5-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:51:55 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-20d03eab-cfd7-4c58-98eb-6ebabf84344d tempest-VolumeQuotasAdminTestJSON-854747580 None] Acquiring lock "cinder-quobyte-669e7091-d755-4a89-8871-a82f140503c5" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:51:55 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-20d03eab-cfd7-4c58-98eb-6ebabf84344d tempest-VolumeQuotasAdminTestJSON-854747580 None] Lock "cinder-quobyte-669e7091-d755-4a89-8871-a82f140503c5" acquired by "delete_volume" :: waited 0.023s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:51:55 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffa9b59b-349b-4780-aa8a-28ab715d34fb]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:51:55 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-20d03eab-cfd7-4c58-98eb-6ebabf84344d tempest-VolumeQuotasAdminTestJSON-854747580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-669e7091-d755-4a89-8871-a82f140503c5 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:51:55 devstack sudo[84902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-669e7091-d755-4a89-8871-a82f140503c5 Apr 22 17:51:55 devstack sudo[84902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:51:56 devstack sudo[84902]: pam_unix(sudo:session): session closed for user root Apr 22 17:51:56 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-20d03eab-cfd7-4c58-98eb-6ebabf84344d tempest-VolumeQuotasAdminTestJSON-854747580 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-669e7091-d755-4a89-8871-a82f140503c5" returned: 0 in 0.720s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:51:56 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-20d03eab-cfd7-4c58-98eb-6ebabf84344d tempest-VolumeQuotasAdminTestJSON-854747580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-669e7091-d755-4a89-8871-a82f140503c5 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:51:56 devstack sudo[84907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-669e7091-d755-4a89-8871-a82f140503c5 Apr 22 17:51:56 devstack sudo[84907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:51:56 devstack sudo[84907]: pam_unix(sudo:session): session closed for user root Apr 22 17:51:56 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-20d03eab-cfd7-4c58-98eb-6ebabf84344d tempest-VolumeQuotasAdminTestJSON-854747580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-669e7091-d755-4a89-8871-a82f140503c5" returned: 0 in 0.830s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:51:56 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-20d03eab-cfd7-4c58-98eb-6ebabf84344d tempest-VolumeQuotasAdminTestJSON-854747580 None] Lock "cinder-quobyte-669e7091-d755-4a89-8871-a82f140503c5" released by "delete_volume" :: held 1.599s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:51:56 devstack cinder-volume[81771]: DEBUG dbcounter [-] [81771] Writing DB stats cinder:UPDATE=88,cinder:SELECT=80,cinder:INSERT=29,cinder:DELETE=4 {{(pid=81771) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 22 17:51:56 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-20d03eab-cfd7-4c58-98eb-6ebabf84344d tempest-VolumeQuotasAdminTestJSON-854747580 None] Created reservations ['1e05d8e0-3e85-4093-8ebf-033447323422', '10a84ab9-2414-49c0-b27a-0b659f2d0180', '428b9787-35c7-4ac7-8bfc-cc4d01828320', '4dc55946-0c9b-4f1a-adaf-a86dcc55a5e4'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 17:51:57 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-20d03eab-cfd7-4c58-98eb-6ebabf84344d tempest-VolumeQuotasAdminTestJSON-854747580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:51:57 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-20d03eab-cfd7-4c58-98eb-6ebabf84344d tempest-VolumeQuotasAdminTestJSON-854747580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:51:57 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-20d03eab-cfd7-4c58-98eb-6ebabf84344d tempest-VolumeQuotasAdminTestJSON-854747580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:51:57 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-20d03eab-cfd7-4c58-98eb-6ebabf84344d tempest-VolumeQuotasAdminTestJSON-854747580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:51:57 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-20d03eab-cfd7-4c58-98eb-6ebabf84344d tempest-VolumeQuotasAdminTestJSON-854747580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:51:57 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-20d03eab-cfd7-4c58-98eb-6ebabf84344d tempest-VolumeQuotasAdminTestJSON-854747580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:51:57 devstack sudo[84934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 Apr 22 17:51:57 devstack sudo[84934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:51:57 devstack sudo[84934]: pam_unix(sudo:session): session closed for user root Apr 22 17:51:57 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-20d03eab-cfd7-4c58-98eb-6ebabf84344d tempest-VolumeQuotasAdminTestJSON-854747580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33" returned: 0 in 0.784s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:51:57 devstack cinder-volume[81771]: DEBUG cinder.manager [None req-20d03eab-cfd7-4c58-98eb-6ebabf84344d tempest-VolumeQuotasAdminTestJSON-854747580 None] Notifying Schedulers of capabilities ... {{(pid=81771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 17:51:57 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-20d03eab-cfd7-4c58-98eb-6ebabf84344d tempest-VolumeQuotasAdminTestJSON-854747580 None] Deleted volume successfully. Apr 22 17:51:57 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-20d03eab-cfd7-4c58-98eb-6ebabf84344d tempest-VolumeQuotasAdminTestJSON-854747580 None] Lock "cinder-669e7091-d755-4a89-8871-a82f140503c5-delete_volume" released by "delete_volume" :: held 2.741s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:51:58 devstack cinder-volume[81771]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6a76bc5-5832-4575-9ef7-07b13a847f86 tempest-VolumeQuotasAdminTestJSON-854747580 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 17:51:58 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-f6a76bc5-5832-4575-9ef7-07b13a847f86 tempest-VolumeQuotasAdminTestJSON-854747580 None] Flow 'volume_create_manager' (a7c36799-05f0-426f-aa51-d3dff9eb9e0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:51:58 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-f6a76bc5-5832-4575-9ef7-07b13a847f86 tempest-VolumeQuotasAdminTestJSON-854747580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0be5d1bc-5812-47cf-b8e1-ac651ecaf025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:51:58 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-f6a76bc5-5832-4575-9ef7-07b13a847f86 tempest-VolumeQuotasAdminTestJSON-854747580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0be5d1bc-5812-47cf-b8e1-ac651ecaf025) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:51:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-106410469',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48100bc3-35a3-4ff6-ac8e-f4a8ff178cd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6aadbfe412b6410ab762be97d8693aee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:51:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:51:58Z,use_quota=True,user_id='bcda776347654e2c8e93762847c59ba5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:51:58 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-f6a76bc5-5832-4575-9ef7-07b13a847f86 tempest-VolumeQuotasAdminTestJSON-854747580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d1ef19c-0824-416e-9f06-92c25c83abad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:51:58 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-f6a76bc5-5832-4575-9ef7-07b13a847f86 tempest-VolumeQuotasAdminTestJSON-854747580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d1ef19c-0824-416e-9f06-92c25c83abad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:51:58 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-f6a76bc5-5832-4575-9ef7-07b13a847f86 tempest-VolumeQuotasAdminTestJSON-854747580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4ba15cf-598c-4c6e-bab1-f5184dbec6d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:51:58 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-f6a76bc5-5832-4575-9ef7-07b13a847f86 tempest-VolumeQuotasAdminTestJSON-854747580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4ba15cf-598c-4c6e-bab1-f5184dbec6d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48100bc3-35a3-4ff6-ac8e-f4a8ff178cd0', 'volume_name': 'volume-48100bc3-35a3-4ff6-ac8e-f4a8ff178cd0', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:51:58 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-f6a76bc5-5832-4575-9ef7-07b13a847f86 tempest-VolumeQuotasAdminTestJSON-854747580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e0edf8c-732d-48bf-bc2a-41b1d77c7961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:51:58 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-f6a76bc5-5832-4575-9ef7-07b13a847f86 tempest-VolumeQuotasAdminTestJSON-854747580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e0edf8c-732d-48bf-bc2a-41b1d77c7961) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:51:58 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-f6a76bc5-5832-4575-9ef7-07b13a847f86 tempest-VolumeQuotasAdminTestJSON-854747580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d12f3d78-55ba-492c-81ea-53890497d53c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:51:58 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-f6a76bc5-5832-4575-9ef7-07b13a847f86 tempest-VolumeQuotasAdminTestJSON-854747580 None] Volume 48100bc3-35a3-4ff6-ac8e-f4a8ff178cd0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48100bc3-35a3-4ff6-ac8e-f4a8ff178cd0', 'volume_size': 1} Apr 22 17:51:58 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-f6a76bc5-5832-4575-9ef7-07b13a847f86 tempest-VolumeQuotasAdminTestJSON-854747580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:51:58 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-f6a76bc5-5832-4575-9ef7-07b13a847f86 tempest-VolumeQuotasAdminTestJSON-854747580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:51:58 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-f6a76bc5-5832-4575-9ef7-07b13a847f86 tempest-VolumeQuotasAdminTestJSON-854747580 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:51:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-106410469',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48100bc3-35a3-4ff6-ac8e-f4a8ff178cd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6aadbfe412b6410ab762be97d8693aee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:51:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:51:58Z,use_quota=True,user_id='bcda776347654e2c8e93762847c59ba5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)}" {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 17:51:58 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-f6a76bc5-5832-4575-9ef7-07b13a847f86 tempest-VolumeQuotasAdminTestJSON-854747580 None] Creating volume 48100bc3-35a3-4ff6-ac8e-f4a8ff178cd0 {{(pid=81771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 17:51:58 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-f6a76bc5-5832-4575-9ef7-07b13a847f86 tempest-VolumeQuotasAdminTestJSON-854747580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:51:58 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-f6a76bc5-5832-4575-9ef7-07b13a847f86 tempest-VolumeQuotasAdminTestJSON-854747580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:51:58 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-f6a76bc5-5832-4575-9ef7-07b13a847f86 tempest-VolumeQuotasAdminTestJSON-854747580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:51:58 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-f6a76bc5-5832-4575-9ef7-07b13a847f86 tempest-VolumeQuotasAdminTestJSON-854747580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:51:58 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-f6a76bc5-5832-4575-9ef7-07b13a847f86 tempest-VolumeQuotasAdminTestJSON-854747580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:51:58 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-f6a76bc5-5832-4575-9ef7-07b13a847f86 tempest-VolumeQuotasAdminTestJSON-854747580 None] Selected osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 as target Quobyte volume. {{(pid=81771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 17:51:58 devstack cinder-volume[81771]: INFO cinder.volume.drivers.remotefs [None req-f6a76bc5-5832-4575-9ef7-07b13a847f86 tempest-VolumeQuotasAdminTestJSON-854747580 None] casted to osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 Apr 22 17:51:58 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-f6a76bc5-5832-4575-9ef7-07b13a847f86 tempest-VolumeQuotasAdminTestJSON-854747580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-48100bc3-35a3-4ff6-ac8e-f4a8ff178cd0 1073741824 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:51:58 devstack sudo[84985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-48100bc3-35a3-4ff6-ac8e-f4a8ff178cd0 1073741824 Apr 22 17:51:58 devstack sudo[84985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:51:59 devstack sudo[84985]: pam_unix(sudo:session): session closed for user root Apr 22 17:51:59 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-f6a76bc5-5832-4575-9ef7-07b13a847f86 tempest-VolumeQuotasAdminTestJSON-854747580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-48100bc3-35a3-4ff6-ac8e-f4a8ff178cd0 1073741824" returned: 0 in 1.014s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:51:59 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-f6a76bc5-5832-4575-9ef7-07b13a847f86 tempest-VolumeQuotasAdminTestJSON-854747580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-48100bc3-35a3-4ff6-ac8e-f4a8ff178cd0 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:51:59 devstack sudo[84992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-48100bc3-35a3-4ff6-ac8e-f4a8ff178cd0 Apr 22 17:51:59 devstack sudo[84992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:52:00 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-2df80502-7bb9-4811-b8b1-9d7e8e6dd731 tempest-GroupSnapshotsTest-38718681 None] Group tempest-GroupSnapshotsTest-Group-1544708068: creating Apr 22 17:52:00 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-2df80502-7bb9-4811-b8b1-9d7e8e6dd731 tempest-GroupSnapshotsTest-38718681 None] Group tempest-GroupSnapshotsTest-Group-1544708068: created successfully Apr 22 17:52:00 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-2df80502-7bb9-4811-b8b1-9d7e8e6dd731 tempest-GroupSnapshotsTest-38718681 None] Create group completed successfully. Apr 22 17:52:00 devstack sudo[84992]: pam_unix(sudo:session): session closed for user root Apr 22 17:52:00 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-f6a76bc5-5832-4575-9ef7-07b13a847f86 tempest-VolumeQuotasAdminTestJSON-854747580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-48100bc3-35a3-4ff6-ac8e-f4a8ff178cd0" returned: 0 in 0.742s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:52:00 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-f6a76bc5-5832-4575-9ef7-07b13a847f86 tempest-VolumeQuotasAdminTestJSON-854747580 None] <== create_volume: return (1836ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'} {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 17:52:00 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-f6a76bc5-5832-4575-9ef7-07b13a847f86 tempest-VolumeQuotasAdminTestJSON-854747580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.839s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:52:00 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-f6a76bc5-5832-4575-9ef7-07b13a847f86 tempest-VolumeQuotasAdminTestJSON-854747580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d12f3d78-55ba-492c-81ea-53890497d53c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48100bc3-35a3-4ff6-ac8e-f4a8ff178cd0', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:52:00 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-f6a76bc5-5832-4575-9ef7-07b13a847f86 tempest-VolumeQuotasAdminTestJSON-854747580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f93bf6aa-f29e-47dc-833f-5ac3ceadb725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:52:00 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-f6a76bc5-5832-4575-9ef7-07b13a847f86 tempest-VolumeQuotasAdminTestJSON-854747580 None] Volume volume-48100bc3-35a3-4ff6-ac8e-f4a8ff178cd0 (48100bc3-35a3-4ff6-ac8e-f4a8ff178cd0): created successfully Apr 22 17:52:00 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-f6a76bc5-5832-4575-9ef7-07b13a847f86 tempest-VolumeQuotasAdminTestJSON-854747580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f93bf6aa-f29e-47dc-833f-5ac3ceadb725) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:52:00 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-f6a76bc5-5832-4575-9ef7-07b13a847f86 tempest-VolumeQuotasAdminTestJSON-854747580 None] Flow 'volume_create_manager' (a7c36799-05f0-426f-aa51-d3dff9eb9e0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:52:00 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-f6a76bc5-5832-4575-9ef7-07b13a847f86 tempest-VolumeQuotasAdminTestJSON-854747580 None] Created volume successfully. Apr 22 17:52:01 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-aa23b17a-22d1-4500-9b1c-1543c3b7509f tempest-VolumeQuotasAdminTestJSON-1932720152 None] Transfer volume completed successfully. Apr 22 17:52:02 devstack cinder-volume[81771]: DEBUG cinder.volume.flows.manager.create_volume [None req-169e0829-09c7-42d0-a3ae-6e03312bc560 tempest-GroupSnapshotsTest-38718681 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 17:52:02 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-169e0829-09c7-42d0-a3ae-6e03312bc560 tempest-GroupSnapshotsTest-38718681 None] Flow 'volume_create_manager' (2ebe6492-d291-4e02-a972-d62e48fa734d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:52:02 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-169e0829-09c7-42d0-a3ae-6e03312bc560 tempest-GroupSnapshotsTest-38718681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da7dd50e-0bf6-4579-8dd8-8842a17012c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:52:02 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-169e0829-09c7-42d0-a3ae-6e03312bc560 tempest-GroupSnapshotsTest-38718681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da7dd50e-0bf6-4579-8dd8-8842a17012c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:52:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-199064451',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=20f60822-f138-46e1-93ed-894ef9b29714,host='devstack@QuobyteHD#QuobyteHD',id=f0af2eb8-2a16-45d9-acd3-89c6acf4b106,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aea1384afd7849769b4b8ff2d3c8f873',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:52:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:52:02Z,use_quota=True,user_id='d11940f42c1645e8818355c2e86db8d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b47ad858-e8bb-43ca-b7cf-7ae55cf6832a),volume_type_id=b47ad858-e8bb-43ca-b7cf-7ae55cf6832a)' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:52:02 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-169e0829-09c7-42d0-a3ae-6e03312bc560 tempest-GroupSnapshotsTest-38718681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e84fe837-e0b5-4249-b84a-b63014334e3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:52:02 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-169e0829-09c7-42d0-a3ae-6e03312bc560 tempest-GroupSnapshotsTest-38718681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e84fe837-e0b5-4249-b84a-b63014334e3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:52:02 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-169e0829-09c7-42d0-a3ae-6e03312bc560 tempest-GroupSnapshotsTest-38718681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a3b4b45-3ecd-445e-9e90-762c9e839e53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:52:02 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-169e0829-09c7-42d0-a3ae-6e03312bc560 tempest-GroupSnapshotsTest-38718681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a3b4b45-3ecd-445e-9e90-762c9e839e53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0af2eb8-2a16-45d9-acd3-89c6acf4b106', 'volume_name': 'volume-f0af2eb8-2a16-45d9-acd3-89c6acf4b106', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:52:02 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-169e0829-09c7-42d0-a3ae-6e03312bc560 tempest-GroupSnapshotsTest-38718681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c83a164c-efdb-417f-b28a-54098b7a501e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:52:02 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-169e0829-09c7-42d0-a3ae-6e03312bc560 tempest-GroupSnapshotsTest-38718681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c83a164c-efdb-417f-b28a-54098b7a501e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:52:02 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-169e0829-09c7-42d0-a3ae-6e03312bc560 tempest-GroupSnapshotsTest-38718681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04b58784-0bf9-45b6-809a-48f891b3a584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:52:02 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-169e0829-09c7-42d0-a3ae-6e03312bc560 tempest-GroupSnapshotsTest-38718681 None] Volume f0af2eb8-2a16-45d9-acd3-89c6acf4b106: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0af2eb8-2a16-45d9-acd3-89c6acf4b106', 'volume_size': 1} Apr 22 17:52:02 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-169e0829-09c7-42d0-a3ae-6e03312bc560 tempest-GroupSnapshotsTest-38718681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:52:02 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-169e0829-09c7-42d0-a3ae-6e03312bc560 tempest-GroupSnapshotsTest-38718681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:52:02 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-169e0829-09c7-42d0-a3ae-6e03312bc560 tempest-GroupSnapshotsTest-38718681 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=20f60822-f138-46e1-93ed-894ef9b29714,created_at=2026-04-22T15:52:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-199064451',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=20f60822-f138-46e1-93ed-894ef9b29714,host='devstack@QuobyteHD#QuobyteHD',id=f0af2eb8-2a16-45d9-acd3-89c6acf4b106,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aea1384afd7849769b4b8ff2d3c8f873',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:52:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:52:02Z,use_quota=True,user_id='d11940f42c1645e8818355c2e86db8d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b47ad858-e8bb-43ca-b7cf-7ae55cf6832a),volume_type_id=b47ad858-e8bb-43ca-b7cf-7ae55cf6832a)}" {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 17:52:02 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-169e0829-09c7-42d0-a3ae-6e03312bc560 tempest-GroupSnapshotsTest-38718681 None] Creating volume f0af2eb8-2a16-45d9-acd3-89c6acf4b106 {{(pid=81771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 17:52:02 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-169e0829-09c7-42d0-a3ae-6e03312bc560 tempest-GroupSnapshotsTest-38718681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:52:02 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-169e0829-09c7-42d0-a3ae-6e03312bc560 tempest-GroupSnapshotsTest-38718681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:52:02 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-169e0829-09c7-42d0-a3ae-6e03312bc560 tempest-GroupSnapshotsTest-38718681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:52:02 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-169e0829-09c7-42d0-a3ae-6e03312bc560 tempest-GroupSnapshotsTest-38718681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:52:02 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-169e0829-09c7-42d0-a3ae-6e03312bc560 tempest-GroupSnapshotsTest-38718681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:52:02 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-169e0829-09c7-42d0-a3ae-6e03312bc560 tempest-GroupSnapshotsTest-38718681 None] Selected osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 as target Quobyte volume. {{(pid=81771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 17:52:02 devstack cinder-volume[81771]: INFO cinder.volume.drivers.remotefs [None req-169e0829-09c7-42d0-a3ae-6e03312bc560 tempest-GroupSnapshotsTest-38718681 None] casted to osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 Apr 22 17:52:02 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-169e0829-09c7-42d0-a3ae-6e03312bc560 tempest-GroupSnapshotsTest-38718681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-f0af2eb8-2a16-45d9-acd3-89c6acf4b106 1073741824 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:52:02 devstack sudo[85029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-f0af2eb8-2a16-45d9-acd3-89c6acf4b106 1073741824 Apr 22 17:52:02 devstack sudo[85029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:52:02 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-99069e28-6034-4566-8b11-8f1977d19e1f tempest-VolumeQuotasAdminTestJSON-124457721 None] Acquiring lock "cinder-48100bc3-35a3-4ff6-ac8e-f4a8ff178cd0-delete_volume" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:52:02 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-99069e28-6034-4566-8b11-8f1977d19e1f tempest-VolumeQuotasAdminTestJSON-124457721 None] Lock "cinder-48100bc3-35a3-4ff6-ac8e-f4a8ff178cd0-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:52:03 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-99069e28-6034-4566-8b11-8f1977d19e1f tempest-VolumeQuotasAdminTestJSON-124457721 None] Acquiring lock "cinder-quobyte-48100bc3-35a3-4ff6-ac8e-f4a8ff178cd0" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:52:03 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-99069e28-6034-4566-8b11-8f1977d19e1f tempest-VolumeQuotasAdminTestJSON-124457721 None] Lock "cinder-quobyte-48100bc3-35a3-4ff6-ac8e-f4a8ff178cd0" acquired by "delete_volume" :: waited 0.038s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:52:03 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2132b53-a699-4f34-a769-fc37ff7374fd]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:52:03 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-99069e28-6034-4566-8b11-8f1977d19e1f tempest-VolumeQuotasAdminTestJSON-124457721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-48100bc3-35a3-4ff6-ac8e-f4a8ff178cd0 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:52:03 devstack sudo[85046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-48100bc3-35a3-4ff6-ac8e-f4a8ff178cd0 Apr 22 17:52:03 devstack sudo[85046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:52:03 devstack sudo[85029]: pam_unix(sudo:session): session closed for user root Apr 22 17:52:03 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-169e0829-09c7-42d0-a3ae-6e03312bc560 tempest-GroupSnapshotsTest-38718681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-f0af2eb8-2a16-45d9-acd3-89c6acf4b106 1073741824" returned: 0 in 1.388s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:52:03 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-169e0829-09c7-42d0-a3ae-6e03312bc560 tempest-GroupSnapshotsTest-38718681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-f0af2eb8-2a16-45d9-acd3-89c6acf4b106 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:52:03 devstack sudo[85064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-f0af2eb8-2a16-45d9-acd3-89c6acf4b106 Apr 22 17:52:03 devstack sudo[85064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:52:05 devstack sudo[85046]: pam_unix(sudo:session): session closed for user root Apr 22 17:52:05 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-99069e28-6034-4566-8b11-8f1977d19e1f tempest-VolumeQuotasAdminTestJSON-124457721 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-48100bc3-35a3-4ff6-ac8e-f4a8ff178cd0" returned: 0 in 1.933s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:52:05 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-99069e28-6034-4566-8b11-8f1977d19e1f tempest-VolumeQuotasAdminTestJSON-124457721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-48100bc3-35a3-4ff6-ac8e-f4a8ff178cd0 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:52:05 devstack sudo[85088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-48100bc3-35a3-4ff6-ac8e-f4a8ff178cd0 Apr 22 17:52:05 devstack sudo[85088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:52:05 devstack sudo[85064]: pam_unix(sudo:session): session closed for user root Apr 22 17:52:05 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-169e0829-09c7-42d0-a3ae-6e03312bc560 tempest-GroupSnapshotsTest-38718681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-f0af2eb8-2a16-45d9-acd3-89c6acf4b106" returned: 0 in 1.483s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:52:05 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-169e0829-09c7-42d0-a3ae-6e03312bc560 tempest-GroupSnapshotsTest-38718681 None] <== create_volume: return (2978ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'} {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 17:52:05 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-169e0829-09c7-42d0-a3ae-6e03312bc560 tempest-GroupSnapshotsTest-38718681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.980s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:52:05 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-169e0829-09c7-42d0-a3ae-6e03312bc560 tempest-GroupSnapshotsTest-38718681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04b58784-0bf9-45b6-809a-48f891b3a584) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0af2eb8-2a16-45d9-acd3-89c6acf4b106', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:52:05 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-169e0829-09c7-42d0-a3ae-6e03312bc560 tempest-GroupSnapshotsTest-38718681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f464dbfb-2c73-4475-aae0-83e5bc749e2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:52:05 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-169e0829-09c7-42d0-a3ae-6e03312bc560 tempest-GroupSnapshotsTest-38718681 None] Volume volume-f0af2eb8-2a16-45d9-acd3-89c6acf4b106 (f0af2eb8-2a16-45d9-acd3-89c6acf4b106): created successfully Apr 22 17:52:05 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-169e0829-09c7-42d0-a3ae-6e03312bc560 tempest-GroupSnapshotsTest-38718681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f464dbfb-2c73-4475-aae0-83e5bc749e2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:52:05 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-169e0829-09c7-42d0-a3ae-6e03312bc560 tempest-GroupSnapshotsTest-38718681 None] Flow 'volume_create_manager' (2ebe6492-d291-4e02-a972-d62e48fa734d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:52:05 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-169e0829-09c7-42d0-a3ae-6e03312bc560 tempest-GroupSnapshotsTest-38718681 None] Created volume successfully. Apr 22 17:52:05 devstack sudo[85088]: pam_unix(sudo:session): session closed for user root Apr 22 17:52:05 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-99069e28-6034-4566-8b11-8f1977d19e1f tempest-VolumeQuotasAdminTestJSON-124457721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-48100bc3-35a3-4ff6-ac8e-f4a8ff178cd0" returned: 0 in 0.829s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:52:05 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-99069e28-6034-4566-8b11-8f1977d19e1f tempest-VolumeQuotasAdminTestJSON-124457721 None] Lock "cinder-quobyte-48100bc3-35a3-4ff6-ac8e-f4a8ff178cd0" released by "delete_volume" :: held 2.824s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:52:05 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-99069e28-6034-4566-8b11-8f1977d19e1f tempest-VolumeQuotasAdminTestJSON-124457721 None] Created reservations ['1523de1d-7eee-495b-8761-2d9eae3658ba', 'f1bf23db-1b5e-4cfd-aac4-73a5bcb4ffcf', '541786ca-9843-4923-a4a5-fc081bba19ab', '5cde88e8-f4ff-4ac1-96cd-246b66ce8ae6'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 17:52:06 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-99069e28-6034-4566-8b11-8f1977d19e1f tempest-VolumeQuotasAdminTestJSON-124457721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:52:06 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-99069e28-6034-4566-8b11-8f1977d19e1f tempest-VolumeQuotasAdminTestJSON-124457721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:52:06 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-99069e28-6034-4566-8b11-8f1977d19e1f tempest-VolumeQuotasAdminTestJSON-124457721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:52:06 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-99069e28-6034-4566-8b11-8f1977d19e1f tempest-VolumeQuotasAdminTestJSON-124457721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:52:06 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-99069e28-6034-4566-8b11-8f1977d19e1f tempest-VolumeQuotasAdminTestJSON-124457721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:52:06 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-99069e28-6034-4566-8b11-8f1977d19e1f tempest-VolumeQuotasAdminTestJSON-124457721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:52:06 devstack sudo[85093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 Apr 22 17:52:06 devstack sudo[85093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:52:06 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-eb8f03af-67b8-47d1-b8e4-1c49fb13d872 tempest-GroupSnapshotsTest-38718681 None] GroupSnapshot 6f02a121-563f-4e89-910b-ac3ee66de513: creating. Apr 22 17:52:06 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-eb8f03af-67b8-47d1-b8e4-1c49fb13d872 tempest-GroupSnapshotsTest-38718681 None] Group snapshot 6f02a121-563f-4e89-910b-ac3ee66de513: creating. {{(pid=81771) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 22 17:52:06 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-eb8f03af-67b8-47d1-b8e4-1c49fb13d872 tempest-GroupSnapshotsTest-38718681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:52:06 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-eb8f03af-67b8-47d1-b8e4-1c49fb13d872 tempest-GroupSnapshotsTest-38718681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:52:06 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-eb8f03af-67b8-47d1-b8e4-1c49fb13d872 tempest-GroupSnapshotsTest-38718681 None] Creating offline snapshot e981ba00-2a9d-4887-ad63-8f00fd6d2810 of volume f0af2eb8-2a16-45d9-acd3-89c6acf4b106 {{(pid=81771) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 22 17:52:06 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[506e36dc-f9e7-42d3-9eb2-f7dbb8b799a9]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:52:06 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-eb8f03af-67b8-47d1-b8e4-1c49fb13d872 tempest-GroupSnapshotsTest-38718681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-f0af2eb8-2a16-45d9-acd3-89c6acf4b106 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:52:07 devstack sudo[85096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-f0af2eb8-2a16-45d9-acd3-89c6acf4b106 Apr 22 17:52:07 devstack sudo[85096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:52:07 devstack sudo[85093]: pam_unix(sudo:session): session closed for user root Apr 22 17:52:07 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-99069e28-6034-4566-8b11-8f1977d19e1f tempest-VolumeQuotasAdminTestJSON-124457721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33" returned: 0 in 1.599s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:52:07 devstack cinder-volume[81771]: DEBUG cinder.manager [None req-99069e28-6034-4566-8b11-8f1977d19e1f tempest-VolumeQuotasAdminTestJSON-124457721 None] Notifying Schedulers of capabilities ... {{(pid=81771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 17:52:07 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-99069e28-6034-4566-8b11-8f1977d19e1f tempest-VolumeQuotasAdminTestJSON-124457721 None] Deleted volume successfully. Apr 22 17:52:07 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-99069e28-6034-4566-8b11-8f1977d19e1f tempest-VolumeQuotasAdminTestJSON-124457721 None] Lock "cinder-48100bc3-35a3-4ff6-ac8e-f4a8ff178cd0-delete_volume" released by "delete_volume" :: held 4.885s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:52:08 devstack sudo[85096]: pam_unix(sudo:session): session closed for user root Apr 22 17:52:08 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-eb8f03af-67b8-47d1-b8e4-1c49fb13d872 tempest-GroupSnapshotsTest-38718681 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-f0af2eb8-2a16-45d9-acd3-89c6acf4b106" returned: 0 in 1.558s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:52:08 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-eb8f03af-67b8-47d1-b8e4-1c49fb13d872 tempest-GroupSnapshotsTest-38718681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-f0af2eb8-2a16-45d9-acd3-89c6acf4b106,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-f0af2eb8-2a16-45d9-acd3-89c6acf4b106.e981ba00-2a9d-4887-ad63-8f00fd6d2810 1G {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:52:08 devstack sudo[85114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-f0af2eb8-2a16-45d9-acd3-89c6acf4b106,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-f0af2eb8-2a16-45d9-acd3-89c6acf4b106.e981ba00-2a9d-4887-ad63-8f00fd6d2810 1G Apr 22 17:52:08 devstack sudo[85114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:52:09 devstack sudo[85114]: pam_unix(sudo:session): session closed for user root Apr 22 17:52:09 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-eb8f03af-67b8-47d1-b8e4-1c49fb13d872 tempest-GroupSnapshotsTest-38718681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-f0af2eb8-2a16-45d9-acd3-89c6acf4b106,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-f0af2eb8-2a16-45d9-acd3-89c6acf4b106.e981ba00-2a9d-4887-ad63-8f00fd6d2810 1G" returned: 0 in 1.734s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:52:09 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-eb8f03af-67b8-47d1-b8e4-1c49fb13d872 tempest-GroupSnapshotsTest-38718681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0af2eb8-2a16-45d9-acd3-89c6acf4b106 -F qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-f0af2eb8-2a16-45d9-acd3-89c6acf4b106.e981ba00-2a9d-4887-ad63-8f00fd6d2810 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:52:09 devstack sudo[85119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0af2eb8-2a16-45d9-acd3-89c6acf4b106 -F qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-f0af2eb8-2a16-45d9-acd3-89c6acf4b106.e981ba00-2a9d-4887-ad63-8f00fd6d2810 Apr 22 17:52:09 devstack sudo[85119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:52:11 devstack sudo[85119]: pam_unix(sudo:session): session closed for user root Apr 22 17:52:11 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-eb8f03af-67b8-47d1-b8e4-1c49fb13d872 tempest-GroupSnapshotsTest-38718681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0af2eb8-2a16-45d9-acd3-89c6acf4b106 -F qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-f0af2eb8-2a16-45d9-acd3-89c6acf4b106.e981ba00-2a9d-4887-ad63-8f00fd6d2810" returned: 0 in 1.640s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:52:11 devstack cinder-volume[81771]: WARNING cinder.volume.drivers.remotefs [None req-eb8f03af-67b8-47d1-b8e4-1c49fb13d872 tempest-GroupSnapshotsTest-38718681 None] /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-f0af2eb8-2a16-45d9-acd3-89c6acf4b106.e981ba00-2a9d-4887-ad63-8f00fd6d2810 is being set with open permissions: ugo+rw: NotImplementedError Apr 22 17:52:11 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-eb8f03af-67b8-47d1-b8e4-1c49fb13d872 tempest-GroupSnapshotsTest-38718681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-f0af2eb8-2a16-45d9-acd3-89c6acf4b106.e981ba00-2a9d-4887-ad63-8f00fd6d2810 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:52:11 devstack sudo[85163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-f0af2eb8-2a16-45d9-acd3-89c6acf4b106.e981ba00-2a9d-4887-ad63-8f00fd6d2810 Apr 22 17:52:11 devstack sudo[85163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:52:12 devstack sudo[85163]: pam_unix(sudo:session): session closed for user root Apr 22 17:52:12 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-eb8f03af-67b8-47d1-b8e4-1c49fb13d872 tempest-GroupSnapshotsTest-38718681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-f0af2eb8-2a16-45d9-acd3-89c6acf4b106.e981ba00-2a9d-4887-ad63-8f00fd6d2810" returned: 0 in 0.977s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:52:12 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-eb8f03af-67b8-47d1-b8e4-1c49fb13d872 tempest-GroupSnapshotsTest-38718681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-f0af2eb8-2a16-45d9-acd3-89c6acf4b106.info {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:52:12 devstack sudo[85195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-f0af2eb8-2a16-45d9-acd3-89c6acf4b106.info Apr 22 17:52:12 devstack sudo[85195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:52:13 devstack sudo[85195]: pam_unix(sudo:session): session closed for user root Apr 22 17:52:13 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-eb8f03af-67b8-47d1-b8e4-1c49fb13d872 tempest-GroupSnapshotsTest-38718681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-f0af2eb8-2a16-45d9-acd3-89c6acf4b106.info" returned: 0 in 0.696s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:52:13 devstack cinder-volume[81771]: WARNING cinder.volume.drivers.remotefs [None req-eb8f03af-67b8-47d1-b8e4-1c49fb13d872 tempest-GroupSnapshotsTest-38718681 None] /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-f0af2eb8-2a16-45d9-acd3-89c6acf4b106.info is being set with open permissions: ugo+rw: NotImplementedError Apr 22 17:52:13 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-eb8f03af-67b8-47d1-b8e4-1c49fb13d872 tempest-GroupSnapshotsTest-38718681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-f0af2eb8-2a16-45d9-acd3-89c6acf4b106.info {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:52:13 devstack sudo[85208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-f0af2eb8-2a16-45d9-acd3-89c6acf4b106.info Apr 22 17:52:13 devstack sudo[85208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:52:13 devstack sudo[85208]: pam_unix(sudo:session): session closed for user root Apr 22 17:52:13 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-eb8f03af-67b8-47d1-b8e4-1c49fb13d872 tempest-GroupSnapshotsTest-38718681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-f0af2eb8-2a16-45d9-acd3-89c6acf4b106.info" returned: 0 in 0.613s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:52:13 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-eb8f03af-67b8-47d1-b8e4-1c49fb13d872 tempest-GroupSnapshotsTest-38718681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 7.429s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:52:14 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-eb8f03af-67b8-47d1-b8e4-1c49fb13d872 tempest-GroupSnapshotsTest-38718681 None] group_snapshot 6f02a121-563f-4e89-910b-ac3ee66de513: created successfully Apr 22 17:52:16 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-c23e03ff-b645-4081-a04c-5857b258dc62 tempest-GroupSnapshotsTest-38718681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:52:16 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-c23e03ff-b645-4081-a04c-5857b258dc62 tempest-GroupSnapshotsTest-38718681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:52:16 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-c23e03ff-b645-4081-a04c-5857b258dc62 tempest-GroupSnapshotsTest-38718681 None] Acquiring lock "cinder-quobyte-e981ba00-2a9d-4887-ad63-8f00fd6d2810-d40a9d67-3a8f-4856-b67c-440e2b9ee353" by "_create_volume_from_snapshot" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:52:16 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-c23e03ff-b645-4081-a04c-5857b258dc62 tempest-GroupSnapshotsTest-38718681 None] Lock "cinder-quobyte-e981ba00-2a9d-4887-ad63-8f00fd6d2810-d40a9d67-3a8f-4856-b67c-440e2b9ee353" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:52:16 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-c23e03ff-b645-4081-a04c-5857b258dc62 tempest-GroupSnapshotsTest-38718681 None] Creating volume d40a9d67-3a8f-4856-b67c-440e2b9ee353 from snapshot e981ba00-2a9d-4887-ad63-8f00fd6d2810 {{(pid=81771) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 22 17:52:16 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-c23e03ff-b645-4081-a04c-5857b258dc62 tempest-GroupSnapshotsTest-38718681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:52:16 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-c23e03ff-b645-4081-a04c-5857b258dc62 tempest-GroupSnapshotsTest-38718681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:52:16 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-c23e03ff-b645-4081-a04c-5857b258dc62 tempest-GroupSnapshotsTest-38718681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:52:16 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-c23e03ff-b645-4081-a04c-5857b258dc62 tempest-GroupSnapshotsTest-38718681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:52:16 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-c23e03ff-b645-4081-a04c-5857b258dc62 tempest-GroupSnapshotsTest-38718681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:52:16 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-c23e03ff-b645-4081-a04c-5857b258dc62 tempest-GroupSnapshotsTest-38718681 None] Selected osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 as target Quobyte volume. {{(pid=81771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 17:52:16 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-c23e03ff-b645-4081-a04c-5857b258dc62 tempest-GroupSnapshotsTest-38718681 None] Acquiring lock "cinder-quobyte-d40a9d67-3a8f-4856-b67c-440e2b9ee353" by "_copy_volume_from_snapshot" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:52:16 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-c23e03ff-b645-4081-a04c-5857b258dc62 tempest-GroupSnapshotsTest-38718681 None] Lock "cinder-quobyte-d40a9d67-3a8f-4856-b67c-440e2b9ee353" acquired by "_copy_volume_from_snapshot" :: waited 0.036s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:52:16 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-c23e03ff-b645-4081-a04c-5857b258dc62 tempest-GroupSnapshotsTest-38718681 None] snapshot: e981ba00-2a9d-4887-ad63-8f00fd6d2810, volume: d40a9d67-3a8f-4856-b67c-440e2b9ee353, {{(pid=81771) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 22 17:52:16 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-c23e03ff-b645-4081-a04c-5857b258dc62 tempest-GroupSnapshotsTest-38718681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:52:16 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-c23e03ff-b645-4081-a04c-5857b258dc62 tempest-GroupSnapshotsTest-38718681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:52:16 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-c23e03ff-b645-4081-a04c-5857b258dc62 tempest-GroupSnapshotsTest-38718681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:52:16 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-c23e03ff-b645-4081-a04c-5857b258dc62 tempest-GroupSnapshotsTest-38718681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:52:16 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-c23e03ff-b645-4081-a04c-5857b258dc62 tempest-GroupSnapshotsTest-38718681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:52:16 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[d862f1ef-4a53-4eda-8043-34d12e4664ad]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:52:16 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-c23e03ff-b645-4081-a04c-5857b258dc62 tempest-GroupSnapshotsTest-38718681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-f0af2eb8-2a16-45d9-acd3-89c6acf4b106.e981ba00-2a9d-4887-ad63-8f00fd6d2810 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:52:16 devstack sudo[85244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-f0af2eb8-2a16-45d9-acd3-89c6acf4b106.e981ba00-2a9d-4887-ad63-8f00fd6d2810 Apr 22 17:52:16 devstack sudo[85244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:52:17 devstack sudo[85244]: pam_unix(sudo:session): session closed for user root Apr 22 17:52:17 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-c23e03ff-b645-4081-a04c-5857b258dc62 tempest-GroupSnapshotsTest-38718681 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-f0af2eb8-2a16-45d9-acd3-89c6acf4b106.e981ba00-2a9d-4887-ad63-8f00fd6d2810" returned: 0 in 0.784s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:52:17 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-c23e03ff-b645-4081-a04c-5857b258dc62 tempest-GroupSnapshotsTest-38718681 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f0af2eb8-2a16-45d9-acd3-89c6acf4b106(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81771) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 22 17:52:17 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-c23e03ff-b645-4081-a04c-5857b258dc62 tempest-GroupSnapshotsTest-38718681 None] will copy from snapshot at /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-f0af2eb8-2a16-45d9-acd3-89c6acf4b106 {{(pid=81771) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 22 17:52:17 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-c23e03ff-b645-4081-a04c-5857b258dc62 tempest-GroupSnapshotsTest-38718681 None] Creating direct copy from snapshot {{(pid=81771) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 22 17:52:17 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[35db7c68-1f77-4a62-bcaa-7120fcfc9d6f]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:52:17 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-c23e03ff-b645-4081-a04c-5857b258dc62 tempest-GroupSnapshotsTest-38718681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-f0af2eb8-2a16-45d9-acd3-89c6acf4b106 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:52:17 devstack sudo[85258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-f0af2eb8-2a16-45d9-acd3-89c6acf4b106 Apr 22 17:52:17 devstack sudo[85258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:52:18 devstack sudo[85258]: pam_unix(sudo:session): session closed for user root Apr 22 17:52:18 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-c23e03ff-b645-4081-a04c-5857b258dc62 tempest-GroupSnapshotsTest-38718681 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-f0af2eb8-2a16-45d9-acd3-89c6acf4b106" returned: 0 in 0.694s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:52:18 devstack cinder-volume[81771]: DEBUG cinder.utils [None req-c23e03ff-b645-4081-a04c-5857b258dc62 tempest-GroupSnapshotsTest-38718681 None] Path /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-d40a9d67-3a8f-4856-b67c-440e2b9ee353 not found in is_blk_device check {{(pid=81771) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 22 17:52:18 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-c23e03ff-b645-4081-a04c-5857b258dc62 tempest-GroupSnapshotsTest-38718681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-f0af2eb8-2a16-45d9-acd3-89c6acf4b106 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-d40a9d67-3a8f-4856-b67c-440e2b9ee353 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:52:18 devstack sudo[85266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-f0af2eb8-2a16-45d9-acd3-89c6acf4b106 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-d40a9d67-3a8f-4856-b67c-440e2b9ee353 Apr 22 17:52:18 devstack sudo[85266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:52:19 devstack cinder-volume[81771]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa26305e-10aa-486a-938f-a573d205c0b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1088142384 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 17:52:19 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-aa26305e-10aa-486a-938f-a573d205c0b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1088142384 None] Flow 'volume_create_manager' (f1b1df75-1402-43d1-88df-6c0defb88bc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:52:19 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-aa26305e-10aa-486a-938f-a573d205c0b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1088142384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d29b2d4c-4898-4363-aacd-13d911f41573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:52:19 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-aa26305e-10aa-486a-938f-a573d205c0b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1088142384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d29b2d4c-4898-4363-aacd-13d911f41573) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:52:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-2073694875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de0fd422-4b8c-4974-9fb4-7154f55d36c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c4d3574ee5a45928a495529a7d45f10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:52:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:52:19Z,use_quota=True,user_id='cf82c8cbb14547e49247cabf128546c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:52:19 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-aa26305e-10aa-486a-938f-a573d205c0b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1088142384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8e51381-7d3e-4d28-959f-d1f3b033100a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:52:19 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-aa26305e-10aa-486a-938f-a573d205c0b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1088142384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8e51381-7d3e-4d28-959f-d1f3b033100a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:52:19 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-aa26305e-10aa-486a-938f-a573d205c0b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1088142384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d45a426b-43d0-49d1-9358-04141fc47b1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:52:19 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-aa26305e-10aa-486a-938f-a573d205c0b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1088142384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d45a426b-43d0-49d1-9358-04141fc47b1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de0fd422-4b8c-4974-9fb4-7154f55d36c7', 'volume_name': 'volume-de0fd422-4b8c-4974-9fb4-7154f55d36c7', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:52:19 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-aa26305e-10aa-486a-938f-a573d205c0b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1088142384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d657c52-5ca8-4d64-9640-6178e6889724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:52:19 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-aa26305e-10aa-486a-938f-a573d205c0b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1088142384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d657c52-5ca8-4d64-9640-6178e6889724) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:52:19 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-aa26305e-10aa-486a-938f-a573d205c0b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1088142384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1ab6069-8c90-4bcb-a46c-b7d9b9269474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:52:19 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-aa26305e-10aa-486a-938f-a573d205c0b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1088142384 None] Volume de0fd422-4b8c-4974-9fb4-7154f55d36c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de0fd422-4b8c-4974-9fb4-7154f55d36c7', 'volume_size': 1} Apr 22 17:52:19 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-aa26305e-10aa-486a-938f-a573d205c0b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1088142384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:52:27 devstack sudo[85266]: pam_unix(sudo:session): session closed for user root Apr 22 17:52:27 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-c23e03ff-b645-4081-a04c-5857b258dc62 tempest-GroupSnapshotsTest-38718681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-f0af2eb8-2a16-45d9-acd3-89c6acf4b106 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-d40a9d67-3a8f-4856-b67c-440e2b9ee353" returned: 0 in 9.409s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:52:27 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b1957e2-45c6-4d49-a520-608b39825236]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:52:27 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-c23e03ff-b645-4081-a04c-5857b258dc62 tempest-GroupSnapshotsTest-38718681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-f0af2eb8-2a16-45d9-acd3-89c6acf4b106 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:52:27 devstack sudo[85370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-f0af2eb8-2a16-45d9-acd3-89c6acf4b106 Apr 22 17:52:27 devstack sudo[85370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:52:28 devstack sudo[85370]: pam_unix(sudo:session): session closed for user root Apr 22 17:52:28 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-c23e03ff-b645-4081-a04c-5857b258dc62 tempest-GroupSnapshotsTest-38718681 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-f0af2eb8-2a16-45d9-acd3-89c6acf4b106" returned: 0 in 0.885s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:52:28 devstack cinder-volume[81771]: DEBUG cinder.image.image_utils [None req-c23e03ff-b645-4081-a04c-5857b258dc62 tempest-GroupSnapshotsTest-38718681 None] Image conversion details: src /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-f0af2eb8-2a16-45d9-acd3-89c6acf4b106, size 1024.00 MB, duration 9.41 sec, destination /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-d40a9d67-3a8f-4856-b67c-440e2b9ee353 {{(pid=81771) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 22 17:52:28 devstack cinder-volume[81771]: INFO cinder.image.image_utils [None req-c23e03ff-b645-4081-a04c-5857b258dc62 tempest-GroupSnapshotsTest-38718681 None] Converted 1024.00 MB image at 108.82 MB/s Apr 22 17:52:28 devstack cinder-volume[81771]: WARNING cinder.volume.drivers.remotefs [None req-c23e03ff-b645-4081-a04c-5857b258dc62 tempest-GroupSnapshotsTest-38718681 None] /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-d40a9d67-3a8f-4856-b67c-440e2b9ee353 is being set with open permissions: ugo+rw: NotImplementedError Apr 22 17:52:28 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-c23e03ff-b645-4081-a04c-5857b258dc62 tempest-GroupSnapshotsTest-38718681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-d40a9d67-3a8f-4856-b67c-440e2b9ee353 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:52:28 devstack sudo[85379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-d40a9d67-3a8f-4856-b67c-440e2b9ee353 Apr 22 17:52:28 devstack sudo[85379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:52:28 devstack sudo[85379]: pam_unix(sudo:session): session closed for user root Apr 22 17:52:28 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-c23e03ff-b645-4081-a04c-5857b258dc62 tempest-GroupSnapshotsTest-38718681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-d40a9d67-3a8f-4856-b67c-440e2b9ee353" returned: 0 in 0.558s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:52:28 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-c23e03ff-b645-4081-a04c-5857b258dc62 tempest-GroupSnapshotsTest-38718681 None] Lock "cinder-quobyte-d40a9d67-3a8f-4856-b67c-440e2b9ee353" released by "_copy_volume_from_snapshot" :: held 12.470s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:52:28 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-c23e03ff-b645-4081-a04c-5857b258dc62 tempest-GroupSnapshotsTest-38718681 None] Lock "cinder-quobyte-e981ba00-2a9d-4887-ad63-8f00fd6d2810-d40a9d67-3a8f-4856-b67c-440e2b9ee353" released by "_create_volume_from_snapshot" :: held 12.524s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:52:28 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-c23e03ff-b645-4081-a04c-5857b258dc62 tempest-GroupSnapshotsTest-38718681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.544s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:52:28 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-aa26305e-10aa-486a-938f-a573d205c0b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1088142384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.331s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:52:28 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-aa26305e-10aa-486a-938f-a573d205c0b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1088142384 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:52:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-2073694875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de0fd422-4b8c-4974-9fb4-7154f55d36c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c4d3574ee5a45928a495529a7d45f10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:52:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:52:19Z,use_quota=True,user_id='cf82c8cbb14547e49247cabf128546c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)}" {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 17:52:28 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-aa26305e-10aa-486a-938f-a573d205c0b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1088142384 None] Creating volume de0fd422-4b8c-4974-9fb4-7154f55d36c7 {{(pid=81771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 17:52:28 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-aa26305e-10aa-486a-938f-a573d205c0b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1088142384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:52:28 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-aa26305e-10aa-486a-938f-a573d205c0b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1088142384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:52:28 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-aa26305e-10aa-486a-938f-a573d205c0b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1088142384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:52:28 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-aa26305e-10aa-486a-938f-a573d205c0b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1088142384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:52:28 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-aa26305e-10aa-486a-938f-a573d205c0b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1088142384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:52:28 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-aa26305e-10aa-486a-938f-a573d205c0b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1088142384 None] Selected osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 as target Quobyte volume. {{(pid=81771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 17:52:28 devstack cinder-volume[81771]: INFO cinder.volume.drivers.remotefs [None req-aa26305e-10aa-486a-938f-a573d205c0b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1088142384 None] casted to osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 Apr 22 17:52:28 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-aa26305e-10aa-486a-938f-a573d205c0b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1088142384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-de0fd422-4b8c-4974-9fb4-7154f55d36c7 1073741824 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:52:28 devstack sudo[85383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-de0fd422-4b8c-4974-9fb4-7154f55d36c7 1073741824 Apr 22 17:52:28 devstack sudo[85383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:52:29 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-c23e03ff-b645-4081-a04c-5857b258dc62 tempest-GroupSnapshotsTest-38718681 None] Create group from source-snapshot-6f02a121-563f-4e89-910b-ac3ee66de513 completed successfully. Apr 22 17:52:29 devstack sudo[85383]: pam_unix(sudo:session): session closed for user root Apr 22 17:52:29 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-aa26305e-10aa-486a-938f-a573d205c0b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1088142384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-de0fd422-4b8c-4974-9fb4-7154f55d36c7 1073741824" returned: 0 in 0.680s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:52:29 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-aa26305e-10aa-486a-938f-a573d205c0b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1088142384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-de0fd422-4b8c-4974-9fb4-7154f55d36c7 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:52:29 devstack sudo[85395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-de0fd422-4b8c-4974-9fb4-7154f55d36c7 Apr 22 17:52:29 devstack sudo[85395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:52:29 devstack cinder-volume[81771]: DEBUG oslo_service.periodic_task [None req-1a7bdab5-8190-4e00-a2e2-843e5894ab49 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81771) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 22 17:52:29 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-1a7bdab5-8190-4e00-a2e2-843e5894ab49 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:52:29 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-1a7bdab5-8190-4e00-a2e2-843e5894ab49 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:52:29 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-1a7bdab5-8190-4e00-a2e2-843e5894ab49 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:52:29 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-1a7bdab5-8190-4e00-a2e2-843e5894ab49 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:52:29 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-1a7bdab5-8190-4e00-a2e2-843e5894ab49 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:52:29 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-1a7bdab5-8190-4e00-a2e2-843e5894ab49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:52:29 devstack sudo[85397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 Apr 22 17:52:29 devstack sudo[85397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:52:30 devstack sudo[85395]: pam_unix(sudo:session): session closed for user root Apr 22 17:52:30 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-aa26305e-10aa-486a-938f-a573d205c0b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1088142384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-de0fd422-4b8c-4974-9fb4-7154f55d36c7" returned: 0 in 0.530s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:52:30 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-aa26305e-10aa-486a-938f-a573d205c0b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1088142384 None] <== create_volume: return (1280ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'} {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 17:52:30 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-aa26305e-10aa-486a-938f-a573d205c0b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1088142384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.283s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:52:30 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-aa26305e-10aa-486a-938f-a573d205c0b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1088142384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1ab6069-8c90-4bcb-a46c-b7d9b9269474) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de0fd422-4b8c-4974-9fb4-7154f55d36c7', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:52:30 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-aa26305e-10aa-486a-938f-a573d205c0b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1088142384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e9b9abd-0ff1-4f3c-9a28-491d44403f1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:52:30 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-aa26305e-10aa-486a-938f-a573d205c0b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1088142384 None] Volume volume-de0fd422-4b8c-4974-9fb4-7154f55d36c7 (de0fd422-4b8c-4974-9fb4-7154f55d36c7): created successfully Apr 22 17:52:30 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-aa26305e-10aa-486a-938f-a573d205c0b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1088142384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e9b9abd-0ff1-4f3c-9a28-491d44403f1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:52:30 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-aa26305e-10aa-486a-938f-a573d205c0b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1088142384 None] Flow 'volume_create_manager' (f1b1df75-1402-43d1-88df-6c0defb88bc2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:52:30 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-aa26305e-10aa-486a-938f-a573d205c0b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1088142384 None] Created volume successfully. Apr 22 17:52:30 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-276e4406-19b5-497c-8fae-d3adcfc689c7 tempest-GroupSnapshotsTest-38718681 None] Acquiring lock "cinder-quobyte-d40a9d67-3a8f-4856-b67c-440e2b9ee353" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:52:30 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-276e4406-19b5-497c-8fae-d3adcfc689c7 tempest-GroupSnapshotsTest-38718681 None] Lock "cinder-quobyte-d40a9d67-3a8f-4856-b67c-440e2b9ee353" acquired by "delete_volume" :: waited 0.018s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:52:30 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[05bf49de-2b05-4324-9462-242bd4e28637]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:52:30 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-276e4406-19b5-497c-8fae-d3adcfc689c7 tempest-GroupSnapshotsTest-38718681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-d40a9d67-3a8f-4856-b67c-440e2b9ee353 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:52:30 devstack sudo[85401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-d40a9d67-3a8f-4856-b67c-440e2b9ee353 Apr 22 17:52:30 devstack sudo[85401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:52:30 devstack sudo[85397]: pam_unix(sudo:session): session closed for user root Apr 22 17:52:30 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-1a7bdab5-8190-4e00-a2e2-843e5894ab49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33" returned: 0 in 0.597s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:52:30 devstack cinder-volume[81771]: DEBUG cinder.manager [None req-1a7bdab5-8190-4e00-a2e2-843e5894ab49 None None] Notifying Schedulers of capabilities ... {{(pid=81771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 17:52:30 devstack sudo[85401]: pam_unix(sudo:session): session closed for user root Apr 22 17:52:30 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-276e4406-19b5-497c-8fae-d3adcfc689c7 tempest-GroupSnapshotsTest-38718681 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-d40a9d67-3a8f-4856-b67c-440e2b9ee353" returned: 0 in 0.608s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:52:30 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-276e4406-19b5-497c-8fae-d3adcfc689c7 tempest-GroupSnapshotsTest-38718681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-d40a9d67-3a8f-4856-b67c-440e2b9ee353 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:52:31 devstack sudo[85406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-d40a9d67-3a8f-4856-b67c-440e2b9ee353 Apr 22 17:52:31 devstack sudo[85406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:52:31 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-5f7dc7c1-ec69-4251-bb11-2c1f1316133a tempest-VolumeSnapshotQuotasNegativeTestJSON-1088142384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:52:31 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-5f7dc7c1-ec69-4251-bb11-2c1f1316133a tempest-VolumeSnapshotQuotasNegativeTestJSON-1088142384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.009s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:52:31 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-5f7dc7c1-ec69-4251-bb11-2c1f1316133a tempest-VolumeSnapshotQuotasNegativeTestJSON-1088142384 None] Creating offline snapshot 62f5b90f-2bb7-4686-8a54-4e126c135475 of volume de0fd422-4b8c-4974-9fb4-7154f55d36c7 {{(pid=81771) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 22 17:52:31 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[02ceb3c5-81ea-4845-86cf-59afd34f3b59]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:52:31 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-5f7dc7c1-ec69-4251-bb11-2c1f1316133a tempest-VolumeSnapshotQuotasNegativeTestJSON-1088142384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-de0fd422-4b8c-4974-9fb4-7154f55d36c7 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:52:31 devstack sudo[85412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-de0fd422-4b8c-4974-9fb4-7154f55d36c7 Apr 22 17:52:31 devstack sudo[85412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:52:31 devstack sudo[85406]: pam_unix(sudo:session): session closed for user root Apr 22 17:52:31 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-276e4406-19b5-497c-8fae-d3adcfc689c7 tempest-GroupSnapshotsTest-38718681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-d40a9d67-3a8f-4856-b67c-440e2b9ee353" returned: 0 in 0.687s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:52:31 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-276e4406-19b5-497c-8fae-d3adcfc689c7 tempest-GroupSnapshotsTest-38718681 None] Lock "cinder-quobyte-d40a9d67-3a8f-4856-b67c-440e2b9ee353" released by "delete_volume" :: held 1.334s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:52:31 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-276e4406-19b5-497c-8fae-d3adcfc689c7 tempest-GroupSnapshotsTest-38718681 None] Created reservations ['28dfbe6c-0f75-44e9-b631-bcf980b10a2e'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 17:52:31 devstack cinder-volume[81771]: WARNING cinder.quota [None req-276e4406-19b5-497c-8fae-d3adcfc689c7 tempest-GroupSnapshotsTest-38718681 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1319352086 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1319352086, it is now deprecated. Please use the default quota class for default quota. Apr 22 17:52:31 devstack cinder-volume[81771]: WARNING cinder.quota [None req-276e4406-19b5-497c-8fae-d3adcfc689c7 tempest-GroupSnapshotsTest-38718681 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1319352086 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1319352086, it is now deprecated. Please use the default quota class for default quota. Apr 22 17:52:31 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-276e4406-19b5-497c-8fae-d3adcfc689c7 tempest-GroupSnapshotsTest-38718681 None] Created reservations ['eab3a5ae-76f8-4445-aab8-53845e6a1ef8', '868f7a8f-c527-4370-a8a9-f3633304a405', 'f25214fc-fa0b-442a-973d-e4d2f843ecd6', '02c71f24-80c7-4c77-91be-f3be45c208c4'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 17:52:31 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-276e4406-19b5-497c-8fae-d3adcfc689c7 tempest-GroupSnapshotsTest-38718681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:52:31 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-276e4406-19b5-497c-8fae-d3adcfc689c7 tempest-GroupSnapshotsTest-38718681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:52:31 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-276e4406-19b5-497c-8fae-d3adcfc689c7 tempest-GroupSnapshotsTest-38718681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:52:31 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-276e4406-19b5-497c-8fae-d3adcfc689c7 tempest-GroupSnapshotsTest-38718681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:52:31 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-276e4406-19b5-497c-8fae-d3adcfc689c7 tempest-GroupSnapshotsTest-38718681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:52:32 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-276e4406-19b5-497c-8fae-d3adcfc689c7 tempest-GroupSnapshotsTest-38718681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:52:32 devstack sudo[85418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 Apr 22 17:52:32 devstack sudo[85418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:52:32 devstack sudo[85412]: pam_unix(sudo:session): session closed for user root Apr 22 17:52:32 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-5f7dc7c1-ec69-4251-bb11-2c1f1316133a tempest-VolumeSnapshotQuotasNegativeTestJSON-1088142384 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-de0fd422-4b8c-4974-9fb4-7154f55d36c7" returned: 0 in 0.617s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:52:32 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-5f7dc7c1-ec69-4251-bb11-2c1f1316133a tempest-VolumeSnapshotQuotasNegativeTestJSON-1088142384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-de0fd422-4b8c-4974-9fb4-7154f55d36c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-de0fd422-4b8c-4974-9fb4-7154f55d36c7.62f5b90f-2bb7-4686-8a54-4e126c135475 1G {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:52:32 devstack sudo[85420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-de0fd422-4b8c-4974-9fb4-7154f55d36c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-de0fd422-4b8c-4974-9fb4-7154f55d36c7.62f5b90f-2bb7-4686-8a54-4e126c135475 1G Apr 22 17:52:32 devstack sudo[85420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:52:32 devstack sudo[85418]: pam_unix(sudo:session): session closed for user root Apr 22 17:52:32 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-276e4406-19b5-497c-8fae-d3adcfc689c7 tempest-GroupSnapshotsTest-38718681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33" returned: 0 in 0.605s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:52:32 devstack cinder-volume[81771]: DEBUG cinder.manager [None req-276e4406-19b5-497c-8fae-d3adcfc689c7 tempest-GroupSnapshotsTest-38718681 None] Notifying Schedulers of capabilities ... {{(pid=81771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 17:52:32 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-276e4406-19b5-497c-8fae-d3adcfc689c7 tempest-GroupSnapshotsTest-38718681 None] Delete group completed successfully. Apr 22 17:52:32 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-3063a301-f9e6-43c7-84c7-ae1de067826f tempest-GroupSnapshotsTest-38718681 None] group_snapshot 6f02a121-563f-4e89-910b-ac3ee66de513: deleting Apr 22 17:52:32 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-3063a301-f9e6-43c7-84c7-ae1de067826f tempest-GroupSnapshotsTest-38718681 None] group_snapshot 6f02a121-563f-4e89-910b-ac3ee66de513: deleting {{(pid=81771) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 22 17:52:32 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-3063a301-f9e6-43c7-84c7-ae1de067826f tempest-GroupSnapshotsTest-38718681 None] Acquiring lock "cinder-quobyte-f0af2eb8-2a16-45d9-acd3-89c6acf4b106" by "delete_snapshot" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:52:32 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-3063a301-f9e6-43c7-84c7-ae1de067826f tempest-GroupSnapshotsTest-38718681 None] Lock "cinder-quobyte-f0af2eb8-2a16-45d9-acd3-89c6acf4b106" acquired by "delete_snapshot" :: waited 0.022s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:52:32 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-3063a301-f9e6-43c7-84c7-ae1de067826f tempest-GroupSnapshotsTest-38718681 None] Acquiring lock "cinder-quobyte-e981ba00-2a9d-4887-ad63-8f00fd6d2810" by "_delete_snapshot" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:52:32 devstack cinder-volume[81771]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef29ba72-ddda-4b09-b9d0-b16e8936337f tempest-ServersNegativeTestJSON-430081123 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 17:52:32 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-ef29ba72-ddda-4b09-b9d0-b16e8936337f tempest-ServersNegativeTestJSON-430081123 None] Flow 'volume_create_manager' (30ed72ce-4b7e-4800-943f-fe06ba906b62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:52:32 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-ef29ba72-ddda-4b09-b9d0-b16e8936337f tempest-ServersNegativeTestJSON-430081123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (373a05a7-ba64-4483-9193-cda67402fe7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:52:32 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-ef29ba72-ddda-4b09-b9d0-b16e8936337f tempest-ServersNegativeTestJSON-430081123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (373a05a7-ba64-4483-9193-cda67402fe7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:52:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-811262673',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fe88c62-1e79-431d-8092-516cab8682e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='614bb49339dd4c208790cf0bb48435fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:52:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:52:33Z,use_quota=True,user_id='28c4222484d6465c9f445480e1fe5bfd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:52:32 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-ef29ba72-ddda-4b09-b9d0-b16e8936337f tempest-ServersNegativeTestJSON-430081123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28109df0-6493-4f96-8063-3a4e02799bb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:52:32 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-ef29ba72-ddda-4b09-b9d0-b16e8936337f tempest-ServersNegativeTestJSON-430081123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28109df0-6493-4f96-8063-3a4e02799bb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:52:32 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-ef29ba72-ddda-4b09-b9d0-b16e8936337f tempest-ServersNegativeTestJSON-430081123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a295451-a9f5-4037-83c7-e8a147af0ac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:52:32 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-ef29ba72-ddda-4b09-b9d0-b16e8936337f tempest-ServersNegativeTestJSON-430081123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a295451-a9f5-4037-83c7-e8a147af0ac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8fe88c62-1e79-431d-8092-516cab8682e2', 'volume_name': 'volume-8fe88c62-1e79-431d-8092-516cab8682e2', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:52:32 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-ef29ba72-ddda-4b09-b9d0-b16e8936337f tempest-ServersNegativeTestJSON-430081123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (374d5e88-c55d-4ecd-a578-23ed774de003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:52:32 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-ef29ba72-ddda-4b09-b9d0-b16e8936337f tempest-ServersNegativeTestJSON-430081123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (374d5e88-c55d-4ecd-a578-23ed774de003) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:52:32 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-ef29ba72-ddda-4b09-b9d0-b16e8936337f tempest-ServersNegativeTestJSON-430081123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c06515e-ec0d-43fb-9aec-39a329a757c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:52:32 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-ef29ba72-ddda-4b09-b9d0-b16e8936337f tempest-ServersNegativeTestJSON-430081123 None] Volume 8fe88c62-1e79-431d-8092-516cab8682e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8fe88c62-1e79-431d-8092-516cab8682e2', 'volume_size': 1} Apr 22 17:52:32 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-ef29ba72-ddda-4b09-b9d0-b16e8936337f tempest-ServersNegativeTestJSON-430081123 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:52:32 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-3063a301-f9e6-43c7-84c7-ae1de067826f tempest-GroupSnapshotsTest-38718681 None] Lock "cinder-quobyte-e981ba00-2a9d-4887-ad63-8f00fd6d2810" acquired by "_delete_snapshot" :: waited 0.092s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:52:32 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-3063a301-f9e6-43c7-84c7-ae1de067826f tempest-GroupSnapshotsTest-38718681 None] Deleting offline snapshot e981ba00-2a9d-4887-ad63-8f00fd6d2810 of volume f0af2eb8-2a16-45d9-acd3-89c6acf4b106 {{(pid=81771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 22 17:52:32 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-3063a301-f9e6-43c7-84c7-ae1de067826f tempest-GroupSnapshotsTest-38718681 None] snapshot_file for this snap is: volume-f0af2eb8-2a16-45d9-acd3-89c6acf4b106.e981ba00-2a9d-4887-ad63-8f00fd6d2810 {{(pid=81771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 22 17:52:32 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[34bc97fc-8a6d-4a0b-a3f0-f9d446c7e9bb]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:52:32 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-3063a301-f9e6-43c7-84c7-ae1de067826f tempest-GroupSnapshotsTest-38718681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-f0af2eb8-2a16-45d9-acd3-89c6acf4b106.e981ba00-2a9d-4887-ad63-8f00fd6d2810 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:52:33 devstack sudo[85429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-f0af2eb8-2a16-45d9-acd3-89c6acf4b106.e981ba00-2a9d-4887-ad63-8f00fd6d2810 Apr 22 17:52:33 devstack sudo[85429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:52:33 devstack sudo[85420]: pam_unix(sudo:session): session closed for user root Apr 22 17:52:33 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-5f7dc7c1-ec69-4251-bb11-2c1f1316133a tempest-VolumeSnapshotQuotasNegativeTestJSON-1088142384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-de0fd422-4b8c-4974-9fb4-7154f55d36c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-de0fd422-4b8c-4974-9fb4-7154f55d36c7.62f5b90f-2bb7-4686-8a54-4e126c135475 1G" returned: 0 in 0.944s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:52:33 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-5f7dc7c1-ec69-4251-bb11-2c1f1316133a tempest-VolumeSnapshotQuotasNegativeTestJSON-1088142384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de0fd422-4b8c-4974-9fb4-7154f55d36c7 -F qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-de0fd422-4b8c-4974-9fb4-7154f55d36c7.62f5b90f-2bb7-4686-8a54-4e126c135475 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:52:33 devstack sudo[85434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de0fd422-4b8c-4974-9fb4-7154f55d36c7 -F qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-de0fd422-4b8c-4974-9fb4-7154f55d36c7.62f5b90f-2bb7-4686-8a54-4e126c135475 Apr 22 17:52:33 devstack sudo[85434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:52:33 devstack sudo[85429]: pam_unix(sudo:session): session closed for user root Apr 22 17:52:33 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-3063a301-f9e6-43c7-84c7-ae1de067826f tempest-GroupSnapshotsTest-38718681 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-f0af2eb8-2a16-45d9-acd3-89c6acf4b106.e981ba00-2a9d-4887-ad63-8f00fd6d2810" returned: 0 in 0.581s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:52:33 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-3063a301-f9e6-43c7-84c7-ae1de067826f tempest-GroupSnapshotsTest-38718681 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f0af2eb8-2a16-45d9-acd3-89c6acf4b106(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81771) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 22 17:52:33 devstack sudo[85434]: pam_unix(sudo:session): session closed for user root Apr 22 17:52:33 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-5f7dc7c1-ec69-4251-bb11-2c1f1316133a tempest-VolumeSnapshotQuotasNegativeTestJSON-1088142384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de0fd422-4b8c-4974-9fb4-7154f55d36c7 -F qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-de0fd422-4b8c-4974-9fb4-7154f55d36c7.62f5b90f-2bb7-4686-8a54-4e126c135475" returned: 0 in 0.509s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:52:33 devstack cinder-volume[81771]: WARNING cinder.volume.drivers.remotefs [None req-5f7dc7c1-ec69-4251-bb11-2c1f1316133a tempest-VolumeSnapshotQuotasNegativeTestJSON-1088142384 None] /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-de0fd422-4b8c-4974-9fb4-7154f55d36c7.62f5b90f-2bb7-4686-8a54-4e126c135475 is being set with open permissions: ugo+rw Apr 22 17:52:33 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-5f7dc7c1-ec69-4251-bb11-2c1f1316133a tempest-VolumeSnapshotQuotasNegativeTestJSON-1088142384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-de0fd422-4b8c-4974-9fb4-7154f55d36c7.62f5b90f-2bb7-4686-8a54-4e126c135475 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:52:33 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaa6c493-cf60-45ea-b611-9554d2dc66ce]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:52:33 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-3063a301-f9e6-43c7-84c7-ae1de067826f tempest-GroupSnapshotsTest-38718681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-f0af2eb8-2a16-45d9-acd3-89c6acf4b106 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:52:33 devstack sudo[85446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-de0fd422-4b8c-4974-9fb4-7154f55d36c7.62f5b90f-2bb7-4686-8a54-4e126c135475 Apr 22 17:52:33 devstack sudo[85446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:52:33 devstack sudo[85447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-f0af2eb8-2a16-45d9-acd3-89c6acf4b106 Apr 22 17:52:33 devstack sudo[85447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:52:34 devstack sudo[85446]: pam_unix(sudo:session): session closed for user root Apr 22 17:52:34 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-5f7dc7c1-ec69-4251-bb11-2c1f1316133a tempest-VolumeSnapshotQuotasNegativeTestJSON-1088142384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-de0fd422-4b8c-4974-9fb4-7154f55d36c7.62f5b90f-2bb7-4686-8a54-4e126c135475" returned: 0 in 0.658s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:52:34 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-5f7dc7c1-ec69-4251-bb11-2c1f1316133a tempest-VolumeSnapshotQuotasNegativeTestJSON-1088142384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-de0fd422-4b8c-4974-9fb4-7154f55d36c7.info {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:52:34 devstack sudo[85447]: pam_unix(sudo:session): session closed for user root Apr 22 17:52:34 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-3063a301-f9e6-43c7-84c7-ae1de067826f tempest-GroupSnapshotsTest-38718681 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-f0af2eb8-2a16-45d9-acd3-89c6acf4b106" returned: 0 in 0.735s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:52:34 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-3063a301-f9e6-43c7-84c7-ae1de067826f tempest-GroupSnapshotsTest-38718681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-f0af2eb8-2a16-45d9-acd3-89c6acf4b106.e981ba00-2a9d-4887-ad63-8f00fd6d2810 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:52:34 devstack sudo[85474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-de0fd422-4b8c-4974-9fb4-7154f55d36c7.info Apr 22 17:52:34 devstack sudo[85474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:52:34 devstack sudo[85476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-f0af2eb8-2a16-45d9-acd3-89c6acf4b106.e981ba00-2a9d-4887-ad63-8f00fd6d2810 Apr 22 17:52:34 devstack sudo[85476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:52:34 devstack sudo[85474]: pam_unix(sudo:session): session closed for user root Apr 22 17:52:34 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-5f7dc7c1-ec69-4251-bb11-2c1f1316133a tempest-VolumeSnapshotQuotasNegativeTestJSON-1088142384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-de0fd422-4b8c-4974-9fb4-7154f55d36c7.info" returned: 0 in 0.680s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:52:34 devstack cinder-volume[81771]: WARNING cinder.volume.drivers.remotefs [None req-5f7dc7c1-ec69-4251-bb11-2c1f1316133a tempest-VolumeSnapshotQuotasNegativeTestJSON-1088142384 None] /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-de0fd422-4b8c-4974-9fb4-7154f55d36c7.info is being set with open permissions: ugo+rw Apr 22 17:52:34 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-5f7dc7c1-ec69-4251-bb11-2c1f1316133a tempest-VolumeSnapshotQuotasNegativeTestJSON-1088142384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-de0fd422-4b8c-4974-9fb4-7154f55d36c7.info {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:52:34 devstack sudo[85498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-de0fd422-4b8c-4974-9fb4-7154f55d36c7.info Apr 22 17:52:34 devstack sudo[85498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:52:35 devstack sudo[85476]: pam_unix(sudo:session): session closed for user root Apr 22 17:52:35 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-3063a301-f9e6-43c7-84c7-ae1de067826f tempest-GroupSnapshotsTest-38718681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-f0af2eb8-2a16-45d9-acd3-89c6acf4b106.e981ba00-2a9d-4887-ad63-8f00fd6d2810" returned: 0 in 0.803s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:52:35 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-3063a301-f9e6-43c7-84c7-ae1de067826f tempest-GroupSnapshotsTest-38718681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-f0af2eb8-2a16-45d9-acd3-89c6acf4b106.e981ba00-2a9d-4887-ad63-8f00fd6d2810 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:52:35 devstack sudo[85500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-f0af2eb8-2a16-45d9-acd3-89c6acf4b106.e981ba00-2a9d-4887-ad63-8f00fd6d2810 Apr 22 17:52:35 devstack sudo[85500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:52:35 devstack sudo[85498]: pam_unix(sudo:session): session closed for user root Apr 22 17:52:35 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-5f7dc7c1-ec69-4251-bb11-2c1f1316133a tempest-VolumeSnapshotQuotasNegativeTestJSON-1088142384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-de0fd422-4b8c-4974-9fb4-7154f55d36c7.info" returned: 0 in 0.541s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:52:35 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-5f7dc7c1-ec69-4251-bb11-2c1f1316133a tempest-VolumeSnapshotQuotasNegativeTestJSON-1088142384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.087s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:52:35 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-ef29ba72-ddda-4b09-b9d0-b16e8936337f tempest-ServersNegativeTestJSON-430081123 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.622s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:52:35 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-ef29ba72-ddda-4b09-b9d0-b16e8936337f tempest-ServersNegativeTestJSON-430081123 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:52:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-811262673',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fe88c62-1e79-431d-8092-516cab8682e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='614bb49339dd4c208790cf0bb48435fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:52:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:52:33Z,use_quota=True,user_id='28c4222484d6465c9f445480e1fe5bfd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)}" {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 17:52:35 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-ef29ba72-ddda-4b09-b9d0-b16e8936337f tempest-ServersNegativeTestJSON-430081123 None] Creating volume 8fe88c62-1e79-431d-8092-516cab8682e2 {{(pid=81771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 17:52:35 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-ef29ba72-ddda-4b09-b9d0-b16e8936337f tempest-ServersNegativeTestJSON-430081123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:52:35 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-ef29ba72-ddda-4b09-b9d0-b16e8936337f tempest-ServersNegativeTestJSON-430081123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:52:35 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-ef29ba72-ddda-4b09-b9d0-b16e8936337f tempest-ServersNegativeTestJSON-430081123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:52:35 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-ef29ba72-ddda-4b09-b9d0-b16e8936337f tempest-ServersNegativeTestJSON-430081123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:52:35 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-ef29ba72-ddda-4b09-b9d0-b16e8936337f tempest-ServersNegativeTestJSON-430081123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:52:35 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-ef29ba72-ddda-4b09-b9d0-b16e8936337f tempest-ServersNegativeTestJSON-430081123 None] Selected osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 as target Quobyte volume. {{(pid=81771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 17:52:35 devstack cinder-volume[81771]: INFO cinder.volume.drivers.remotefs [None req-ef29ba72-ddda-4b09-b9d0-b16e8936337f tempest-ServersNegativeTestJSON-430081123 None] casted to osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 Apr 22 17:52:35 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-ef29ba72-ddda-4b09-b9d0-b16e8936337f tempest-ServersNegativeTestJSON-430081123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-8fe88c62-1e79-431d-8092-516cab8682e2 1073741824 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:52:35 devstack sudo[85505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-8fe88c62-1e79-431d-8092-516cab8682e2 1073741824 Apr 22 17:52:35 devstack sudo[85505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:52:35 devstack cinder-volume[81771]: DEBUG dbcounter [-] [81771] Writing DB stats cinder:UPDATE=104,cinder:SELECT=86,cinder:INSERT=22,cinder:DELETE=8 {{(pid=81771) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 22 17:52:35 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-5f7dc7c1-ec69-4251-bb11-2c1f1316133a tempest-VolumeSnapshotQuotasNegativeTestJSON-1088142384 None] Create snapshot completed successfully Apr 22 17:52:35 devstack sudo[85500]: pam_unix(sudo:session): session closed for user root Apr 22 17:52:35 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-3063a301-f9e6-43c7-84c7-ae1de067826f tempest-GroupSnapshotsTest-38718681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-f0af2eb8-2a16-45d9-acd3-89c6acf4b106.e981ba00-2a9d-4887-ad63-8f00fd6d2810" returned: 0 in 0.511s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:52:35 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-3063a301-f9e6-43c7-84c7-ae1de067826f tempest-GroupSnapshotsTest-38718681 None] Lock "cinder-quobyte-e981ba00-2a9d-4887-ad63-8f00fd6d2810" released by "_delete_snapshot" :: held 2.749s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:52:35 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-3063a301-f9e6-43c7-84c7-ae1de067826f tempest-GroupSnapshotsTest-38718681 None] Lock "cinder-quobyte-f0af2eb8-2a16-45d9-acd3-89c6acf4b106" released by "delete_snapshot" :: held 2.852s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:52:35 devstack cinder-volume[81771]: WARNING cinder.quota [None req-3063a301-f9e6-43c7-84c7-ae1de067826f tempest-GroupSnapshotsTest-38718681 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1319352086 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1319352086, it is now deprecated. Please use the default quota class for default quota. Apr 22 17:52:35 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-3063a301-f9e6-43c7-84c7-ae1de067826f tempest-GroupSnapshotsTest-38718681 None] Created reservations ['54fca5db-b188-4673-8641-7932671a36b7', '6e92aebe-33e6-4e18-a110-9c6d958eaa35', '2af8f038-2d12-4d44-a918-5eb9db5c7f65', 'b9ec702a-168b-4622-a817-5801f1c81ee2'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 17:52:35 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-3063a301-f9e6-43c7-84c7-ae1de067826f tempest-GroupSnapshotsTest-38718681 None] group_snapshot 6f02a121-563f-4e89-910b-ac3ee66de513: deleted successfully Apr 22 17:52:36 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-6936de48-0ea4-4823-b3d8-bec65cfda03e tempest-VolumeSnapshotQuotasNegativeTestJSON-1088142384 None] Acquiring lock "cinder-62f5b90f-2bb7-4686-8a54-4e126c135475-delete_snapshot" by "delete_snapshot" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:52:36 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-6936de48-0ea4-4823-b3d8-bec65cfda03e tempest-VolumeSnapshotQuotasNegativeTestJSON-1088142384 None] Lock "cinder-62f5b90f-2bb7-4686-8a54-4e126c135475-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:52:36 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-6936de48-0ea4-4823-b3d8-bec65cfda03e tempest-VolumeSnapshotQuotasNegativeTestJSON-1088142384 None] Acquiring lock "cinder-quobyte-de0fd422-4b8c-4974-9fb4-7154f55d36c7" by "delete_snapshot" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:52:36 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-6936de48-0ea4-4823-b3d8-bec65cfda03e tempest-VolumeSnapshotQuotasNegativeTestJSON-1088142384 None] Lock "cinder-quobyte-de0fd422-4b8c-4974-9fb4-7154f55d36c7" acquired by "delete_snapshot" :: waited 0.042s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:52:36 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-6936de48-0ea4-4823-b3d8-bec65cfda03e tempest-VolumeSnapshotQuotasNegativeTestJSON-1088142384 None] Acquiring lock "cinder-quobyte-62f5b90f-2bb7-4686-8a54-4e126c135475" by "_delete_snapshot" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:52:36 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-6936de48-0ea4-4823-b3d8-bec65cfda03e tempest-VolumeSnapshotQuotasNegativeTestJSON-1088142384 None] Lock "cinder-quobyte-62f5b90f-2bb7-4686-8a54-4e126c135475" acquired by "_delete_snapshot" :: waited 0.045s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:52:36 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-6936de48-0ea4-4823-b3d8-bec65cfda03e tempest-VolumeSnapshotQuotasNegativeTestJSON-1088142384 None] Deleting offline snapshot 62f5b90f-2bb7-4686-8a54-4e126c135475 of volume de0fd422-4b8c-4974-9fb4-7154f55d36c7 {{(pid=81771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 22 17:52:36 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-6936de48-0ea4-4823-b3d8-bec65cfda03e tempest-VolumeSnapshotQuotasNegativeTestJSON-1088142384 None] snapshot_file for this snap is: volume-de0fd422-4b8c-4974-9fb4-7154f55d36c7.62f5b90f-2bb7-4686-8a54-4e126c135475 {{(pid=81771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 22 17:52:36 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1645027-dbb5-4e5f-9368-4472a8142bc6]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:52:36 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-6936de48-0ea4-4823-b3d8-bec65cfda03e tempest-VolumeSnapshotQuotasNegativeTestJSON-1088142384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-de0fd422-4b8c-4974-9fb4-7154f55d36c7.62f5b90f-2bb7-4686-8a54-4e126c135475 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:52:36 devstack sudo[85512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-de0fd422-4b8c-4974-9fb4-7154f55d36c7.62f5b90f-2bb7-4686-8a54-4e126c135475 Apr 22 17:52:36 devstack sudo[85512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:52:36 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-bf74b44c-1117-4495-b9a5-551aeac8fcd9 tempest-GroupSnapshotsTest-38718681 None] Acquiring lock "cinder-quobyte-f0af2eb8-2a16-45d9-acd3-89c6acf4b106" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:52:36 devstack sudo[85505]: pam_unix(sudo:session): session closed for user root Apr 22 17:52:36 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-bf74b44c-1117-4495-b9a5-551aeac8fcd9 tempest-GroupSnapshotsTest-38718681 None] Lock "cinder-quobyte-f0af2eb8-2a16-45d9-acd3-89c6acf4b106" acquired by "delete_volume" :: waited 0.042s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:52:36 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-ef29ba72-ddda-4b09-b9d0-b16e8936337f tempest-ServersNegativeTestJSON-430081123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-8fe88c62-1e79-431d-8092-516cab8682e2 1073741824" returned: 0 in 1.267s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:52:36 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[630cd693-6814-422a-9ff3-5bccbc86a5ea]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:52:36 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-bf74b44c-1117-4495-b9a5-551aeac8fcd9 tempest-GroupSnapshotsTest-38718681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-f0af2eb8-2a16-45d9-acd3-89c6acf4b106 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:52:36 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-ef29ba72-ddda-4b09-b9d0-b16e8936337f tempest-ServersNegativeTestJSON-430081123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-8fe88c62-1e79-431d-8092-516cab8682e2 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:52:36 devstack sudo[85515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-8fe88c62-1e79-431d-8092-516cab8682e2 Apr 22 17:52:36 devstack sudo[85515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:52:36 devstack sudo[85514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-f0af2eb8-2a16-45d9-acd3-89c6acf4b106 Apr 22 17:52:36 devstack sudo[85514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:52:37 devstack sudo[85512]: pam_unix(sudo:session): session closed for user root Apr 22 17:52:37 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-6936de48-0ea4-4823-b3d8-bec65cfda03e tempest-VolumeSnapshotQuotasNegativeTestJSON-1088142384 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-de0fd422-4b8c-4974-9fb4-7154f55d36c7.62f5b90f-2bb7-4686-8a54-4e126c135475" returned: 0 in 0.864s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:52:37 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-6936de48-0ea4-4823-b3d8-bec65cfda03e tempest-VolumeSnapshotQuotasNegativeTestJSON-1088142384 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-de0fd422-4b8c-4974-9fb4-7154f55d36c7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81771) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 22 17:52:37 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[327e8a21-4b6c-4f87-8e7c-36faaa41b7b4]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:52:37 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-6936de48-0ea4-4823-b3d8-bec65cfda03e tempest-VolumeSnapshotQuotasNegativeTestJSON-1088142384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-de0fd422-4b8c-4974-9fb4-7154f55d36c7 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:52:37 devstack sudo[85515]: pam_unix(sudo:session): session closed for user root Apr 22 17:52:37 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-ef29ba72-ddda-4b09-b9d0-b16e8936337f tempest-ServersNegativeTestJSON-430081123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-8fe88c62-1e79-431d-8092-516cab8682e2" returned: 0 in 0.570s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:52:37 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-ef29ba72-ddda-4b09-b9d0-b16e8936337f tempest-ServersNegativeTestJSON-430081123 None] <== create_volume: return (1918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'} {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 17:52:37 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-ef29ba72-ddda-4b09-b9d0-b16e8936337f tempest-ServersNegativeTestJSON-430081123 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.922s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:52:37 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-ef29ba72-ddda-4b09-b9d0-b16e8936337f tempest-ServersNegativeTestJSON-430081123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c06515e-ec0d-43fb-9aec-39a329a757c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8fe88c62-1e79-431d-8092-516cab8682e2', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:52:37 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-ef29ba72-ddda-4b09-b9d0-b16e8936337f tempest-ServersNegativeTestJSON-430081123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90f4e72c-2647-476c-a438-f3982f35d5be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:52:37 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-ef29ba72-ddda-4b09-b9d0-b16e8936337f tempest-ServersNegativeTestJSON-430081123 None] Volume volume-8fe88c62-1e79-431d-8092-516cab8682e2 (8fe88c62-1e79-431d-8092-516cab8682e2): created successfully Apr 22 17:52:37 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-ef29ba72-ddda-4b09-b9d0-b16e8936337f tempest-ServersNegativeTestJSON-430081123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90f4e72c-2647-476c-a438-f3982f35d5be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:52:37 devstack sudo[85523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-de0fd422-4b8c-4974-9fb4-7154f55d36c7 Apr 22 17:52:37 devstack sudo[85523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:52:37 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-ef29ba72-ddda-4b09-b9d0-b16e8936337f tempest-ServersNegativeTestJSON-430081123 None] Flow 'volume_create_manager' (30ed72ce-4b7e-4800-943f-fe06ba906b62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:52:37 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-ef29ba72-ddda-4b09-b9d0-b16e8936337f tempest-ServersNegativeTestJSON-430081123 None] Created volume successfully. Apr 22 17:52:37 devstack sudo[85514]: pam_unix(sudo:session): session closed for user root Apr 22 17:52:37 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-bf74b44c-1117-4495-b9a5-551aeac8fcd9 tempest-GroupSnapshotsTest-38718681 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-f0af2eb8-2a16-45d9-acd3-89c6acf4b106" returned: 0 in 0.845s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:52:37 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-bf74b44c-1117-4495-b9a5-551aeac8fcd9 tempest-GroupSnapshotsTest-38718681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-f0af2eb8-2a16-45d9-acd3-89c6acf4b106 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:52:37 devstack sudo[85528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-f0af2eb8-2a16-45d9-acd3-89c6acf4b106 Apr 22 17:52:37 devstack sudo[85528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:52:37 devstack sudo[85523]: pam_unix(sudo:session): session closed for user root Apr 22 17:52:37 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-6936de48-0ea4-4823-b3d8-bec65cfda03e tempest-VolumeSnapshotQuotasNegativeTestJSON-1088142384 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-de0fd422-4b8c-4974-9fb4-7154f55d36c7" returned: 0 in 0.573s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:52:37 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-6936de48-0ea4-4823-b3d8-bec65cfda03e tempest-VolumeSnapshotQuotasNegativeTestJSON-1088142384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-de0fd422-4b8c-4974-9fb4-7154f55d36c7.62f5b90f-2bb7-4686-8a54-4e126c135475 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:52:37 devstack sudo[85533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-de0fd422-4b8c-4974-9fb4-7154f55d36c7.62f5b90f-2bb7-4686-8a54-4e126c135475 Apr 22 17:52:37 devstack sudo[85533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:52:38 devstack sudo[85528]: pam_unix(sudo:session): session closed for user root Apr 22 17:52:38 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-bf74b44c-1117-4495-b9a5-551aeac8fcd9 tempest-GroupSnapshotsTest-38718681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-f0af2eb8-2a16-45d9-acd3-89c6acf4b106" returned: 0 in 0.569s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:52:38 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-bf74b44c-1117-4495-b9a5-551aeac8fcd9 tempest-GroupSnapshotsTest-38718681 None] Lock "cinder-quobyte-f0af2eb8-2a16-45d9-acd3-89c6acf4b106" released by "delete_volume" :: held 1.505s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:52:38 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-bf74b44c-1117-4495-b9a5-551aeac8fcd9 tempest-GroupSnapshotsTest-38718681 None] Created reservations ['3c6d38fb-d1ce-40af-8ce7-82b67bd1ba03'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 17:52:38 devstack cinder-volume[81771]: WARNING cinder.db.sqlalchemy.api [None req-bf74b44c-1117-4495-b9a5-551aeac8fcd9 tempest-GroupSnapshotsTest-38718681 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1319352086'] Apr 22 17:52:38 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-bf74b44c-1117-4495-b9a5-551aeac8fcd9 tempest-GroupSnapshotsTest-38718681 None] Created reservations ['6ccde750-eabf-44dc-a92b-9b5813bd8661', '1c94607c-3249-43b1-b91e-6fa7cfa84fa6', '9d9ba02f-6755-4e9a-b05b-7d7c4ded57c7', '66aca21a-7a2e-4ffd-a3d8-ea15d1db8375'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 17:52:38 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-bf74b44c-1117-4495-b9a5-551aeac8fcd9 tempest-GroupSnapshotsTest-38718681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:52:38 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-bf74b44c-1117-4495-b9a5-551aeac8fcd9 tempest-GroupSnapshotsTest-38718681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:52:38 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-bf74b44c-1117-4495-b9a5-551aeac8fcd9 tempest-GroupSnapshotsTest-38718681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:52:38 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-bf74b44c-1117-4495-b9a5-551aeac8fcd9 tempest-GroupSnapshotsTest-38718681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:52:38 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-bf74b44c-1117-4495-b9a5-551aeac8fcd9 tempest-GroupSnapshotsTest-38718681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:52:38 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-bf74b44c-1117-4495-b9a5-551aeac8fcd9 tempest-GroupSnapshotsTest-38718681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:52:38 devstack sudo[85539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 Apr 22 17:52:38 devstack sudo[85539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:52:38 devstack sudo[85533]: pam_unix(sudo:session): session closed for user root Apr 22 17:52:38 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-6936de48-0ea4-4823-b3d8-bec65cfda03e tempest-VolumeSnapshotQuotasNegativeTestJSON-1088142384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-de0fd422-4b8c-4974-9fb4-7154f55d36c7.62f5b90f-2bb7-4686-8a54-4e126c135475" returned: 0 in 0.815s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:52:38 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-6936de48-0ea4-4823-b3d8-bec65cfda03e tempest-VolumeSnapshotQuotasNegativeTestJSON-1088142384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-de0fd422-4b8c-4974-9fb4-7154f55d36c7.62f5b90f-2bb7-4686-8a54-4e126c135475 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:52:38 devstack sudo[85541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-de0fd422-4b8c-4974-9fb4-7154f55d36c7.62f5b90f-2bb7-4686-8a54-4e126c135475 Apr 22 17:52:38 devstack sudo[85541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:52:39 devstack sudo[85539]: pam_unix(sudo:session): session closed for user root Apr 22 17:52:39 devstack sudo[85541]: pam_unix(sudo:session): session closed for user root Apr 22 17:52:39 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-6936de48-0ea4-4823-b3d8-bec65cfda03e tempest-VolumeSnapshotQuotasNegativeTestJSON-1088142384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-de0fd422-4b8c-4974-9fb4-7154f55d36c7.62f5b90f-2bb7-4686-8a54-4e126c135475" returned: 0 in 0.764s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:52:39 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-bf74b44c-1117-4495-b9a5-551aeac8fcd9 tempest-GroupSnapshotsTest-38718681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33" returned: 0 in 0.965s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:52:39 devstack cinder-volume[81771]: DEBUG cinder.manager [None req-bf74b44c-1117-4495-b9a5-551aeac8fcd9 tempest-GroupSnapshotsTest-38718681 None] Notifying Schedulers of capabilities ... {{(pid=81771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 17:52:39 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-bf74b44c-1117-4495-b9a5-551aeac8fcd9 tempest-GroupSnapshotsTest-38718681 None] Delete group completed successfully. Apr 22 17:52:39 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-6936de48-0ea4-4823-b3d8-bec65cfda03e tempest-VolumeSnapshotQuotasNegativeTestJSON-1088142384 None] Lock "cinder-quobyte-62f5b90f-2bb7-4686-8a54-4e126c135475" released by "_delete_snapshot" :: held 3.220s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:52:39 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-6936de48-0ea4-4823-b3d8-bec65cfda03e tempest-VolumeSnapshotQuotasNegativeTestJSON-1088142384 None] Lock "cinder-quobyte-de0fd422-4b8c-4974-9fb4-7154f55d36c7" released by "delete_snapshot" :: held 3.280s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:52:39 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-6936de48-0ea4-4823-b3d8-bec65cfda03e tempest-VolumeSnapshotQuotasNegativeTestJSON-1088142384 None] Created reservations ['81ea272d-30fc-4483-b9e9-95ade50d4123', '3172d9b4-1e8c-49c9-8306-fe47c6e3035d', 'dd1712e7-9fda-44ca-809b-0871642b5a48', '3eae5f6d-1f3c-488e-95c9-ecbc76ec418e'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 17:52:39 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-9f165ab2-650b-4ddc-971d-197129b55f90 tempest-GroupSnapshotsTest-38718681 None] Group tempest-GroupSnapshotsTest-Group-1077271506: creating Apr 22 17:52:39 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-6936de48-0ea4-4823-b3d8-bec65cfda03e tempest-VolumeSnapshotQuotasNegativeTestJSON-1088142384 None] Delete snapshot completed successfully. Apr 22 17:52:40 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-6936de48-0ea4-4823-b3d8-bec65cfda03e tempest-VolumeSnapshotQuotasNegativeTestJSON-1088142384 None] Lock "cinder-62f5b90f-2bb7-4686-8a54-4e126c135475-delete_snapshot" released by "delete_snapshot" :: held 3.675s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:52:40 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-9f165ab2-650b-4ddc-971d-197129b55f90 tempest-GroupSnapshotsTest-38718681 None] Group tempest-GroupSnapshotsTest-Group-1077271506: created successfully Apr 22 17:52:40 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-9f165ab2-650b-4ddc-971d-197129b55f90 tempest-GroupSnapshotsTest-38718681 None] Create group completed successfully. Apr 22 17:52:40 devstack cinder-volume[81771]: DEBUG cinder.volume.flows.manager.create_volume [None req-8849fc1b-7b5a-4ed9-bcfc-9755e1e15ce3 tempest-ServersNegativeTestJSON-430081123 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 17:52:40 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-8849fc1b-7b5a-4ed9-bcfc-9755e1e15ce3 tempest-ServersNegativeTestJSON-430081123 None] Flow 'volume_create_manager' (81531475-f125-48d2-8b52-dd9a31ab3e4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:52:40 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-8849fc1b-7b5a-4ed9-bcfc-9755e1e15ce3 tempest-ServersNegativeTestJSON-430081123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8c0e410-63fd-4cff-aaa3-23bf80aaf5e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:52:40 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-8849fc1b-7b5a-4ed9-bcfc-9755e1e15ce3 tempest-ServersNegativeTestJSON-430081123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8c0e410-63fd-4cff-aaa3-23bf80aaf5e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:52:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1506321034',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07c5ab89-3ebd-44b1-ad33-d8233e25fa72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='614bb49339dd4c208790cf0bb48435fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:52:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:52:40Z,use_quota=True,user_id='28c4222484d6465c9f445480e1fe5bfd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:52:40 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-8849fc1b-7b5a-4ed9-bcfc-9755e1e15ce3 tempest-ServersNegativeTestJSON-430081123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ab1d372-c482-4599-9711-b15903b99368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:52:40 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-8849fc1b-7b5a-4ed9-bcfc-9755e1e15ce3 tempest-ServersNegativeTestJSON-430081123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ab1d372-c482-4599-9711-b15903b99368) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:52:40 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-8849fc1b-7b5a-4ed9-bcfc-9755e1e15ce3 tempest-ServersNegativeTestJSON-430081123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d00867c6-f69c-438f-bbea-b19052bc9bca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:52:40 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-8849fc1b-7b5a-4ed9-bcfc-9755e1e15ce3 tempest-ServersNegativeTestJSON-430081123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d00867c6-f69c-438f-bbea-b19052bc9bca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07c5ab89-3ebd-44b1-ad33-d8233e25fa72', 'volume_name': 'volume-07c5ab89-3ebd-44b1-ad33-d8233e25fa72', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:52:40 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-8849fc1b-7b5a-4ed9-bcfc-9755e1e15ce3 tempest-ServersNegativeTestJSON-430081123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2363418-e554-4833-82d5-198621389430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:52:40 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-8849fc1b-7b5a-4ed9-bcfc-9755e1e15ce3 tempest-ServersNegativeTestJSON-430081123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2363418-e554-4833-82d5-198621389430) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:52:40 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-8849fc1b-7b5a-4ed9-bcfc-9755e1e15ce3 tempest-ServersNegativeTestJSON-430081123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c66e649-257a-420f-b28b-d76a18645398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:52:40 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-8849fc1b-7b5a-4ed9-bcfc-9755e1e15ce3 tempest-ServersNegativeTestJSON-430081123 None] Volume 07c5ab89-3ebd-44b1-ad33-d8233e25fa72: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07c5ab89-3ebd-44b1-ad33-d8233e25fa72', 'volume_size': 1} Apr 22 17:52:40 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-8849fc1b-7b5a-4ed9-bcfc-9755e1e15ce3 tempest-ServersNegativeTestJSON-430081123 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:52:40 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-8849fc1b-7b5a-4ed9-bcfc-9755e1e15ce3 tempest-ServersNegativeTestJSON-430081123 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:52:40 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-8849fc1b-7b5a-4ed9-bcfc-9755e1e15ce3 tempest-ServersNegativeTestJSON-430081123 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:52:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1506321034',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07c5ab89-3ebd-44b1-ad33-d8233e25fa72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='614bb49339dd4c208790cf0bb48435fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:52:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:52:40Z,use_quota=True,user_id='28c4222484d6465c9f445480e1fe5bfd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)}" {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 17:52:40 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-8849fc1b-7b5a-4ed9-bcfc-9755e1e15ce3 tempest-ServersNegativeTestJSON-430081123 None] Creating volume 07c5ab89-3ebd-44b1-ad33-d8233e25fa72 {{(pid=81771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 17:52:40 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-8849fc1b-7b5a-4ed9-bcfc-9755e1e15ce3 tempest-ServersNegativeTestJSON-430081123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:52:40 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-8849fc1b-7b5a-4ed9-bcfc-9755e1e15ce3 tempest-ServersNegativeTestJSON-430081123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:52:40 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-8849fc1b-7b5a-4ed9-bcfc-9755e1e15ce3 tempest-ServersNegativeTestJSON-430081123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:52:40 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-8849fc1b-7b5a-4ed9-bcfc-9755e1e15ce3 tempest-ServersNegativeTestJSON-430081123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:52:40 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-8849fc1b-7b5a-4ed9-bcfc-9755e1e15ce3 tempest-ServersNegativeTestJSON-430081123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:52:40 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-8849fc1b-7b5a-4ed9-bcfc-9755e1e15ce3 tempest-ServersNegativeTestJSON-430081123 None] Selected osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 as target Quobyte volume. {{(pid=81771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 17:52:40 devstack cinder-volume[81771]: INFO cinder.volume.drivers.remotefs [None req-8849fc1b-7b5a-4ed9-bcfc-9755e1e15ce3 tempest-ServersNegativeTestJSON-430081123 None] casted to osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 Apr 22 17:52:40 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-8849fc1b-7b5a-4ed9-bcfc-9755e1e15ce3 tempest-ServersNegativeTestJSON-430081123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-07c5ab89-3ebd-44b1-ad33-d8233e25fa72 1073741824 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:52:40 devstack sudo[85546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-07c5ab89-3ebd-44b1-ad33-d8233e25fa72 1073741824 Apr 22 17:52:40 devstack sudo[85546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:52:40 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-7c2310ef-ed6e-4fc8-a7c4-7edf97f40e1b tempest-VolumeSnapshotQuotasNegativeTestJSON-1088142384 None] Acquiring lock "cinder-de0fd422-4b8c-4974-9fb4-7154f55d36c7-delete_volume" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:52:40 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-7c2310ef-ed6e-4fc8-a7c4-7edf97f40e1b tempest-VolumeSnapshotQuotasNegativeTestJSON-1088142384 None] Lock "cinder-de0fd422-4b8c-4974-9fb4-7154f55d36c7-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:52:40 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-7c2310ef-ed6e-4fc8-a7c4-7edf97f40e1b tempest-VolumeSnapshotQuotasNegativeTestJSON-1088142384 None] Acquiring lock "cinder-quobyte-de0fd422-4b8c-4974-9fb4-7154f55d36c7" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:52:40 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-7c2310ef-ed6e-4fc8-a7c4-7edf97f40e1b tempest-VolumeSnapshotQuotasNegativeTestJSON-1088142384 None] Lock "cinder-quobyte-de0fd422-4b8c-4974-9fb4-7154f55d36c7" acquired by "delete_volume" :: waited 0.027s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:52:40 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f3998ab-844a-49e2-a14e-42789a6871a5]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:52:40 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-7c2310ef-ed6e-4fc8-a7c4-7edf97f40e1b tempest-VolumeSnapshotQuotasNegativeTestJSON-1088142384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-de0fd422-4b8c-4974-9fb4-7154f55d36c7 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:52:40 devstack sudo[85546]: pam_unix(sudo:session): session closed for user root Apr 22 17:52:40 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-8849fc1b-7b5a-4ed9-bcfc-9755e1e15ce3 tempest-ServersNegativeTestJSON-430081123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-07c5ab89-3ebd-44b1-ad33-d8233e25fa72 1073741824" returned: 0 in 0.711s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:52:41 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-8849fc1b-7b5a-4ed9-bcfc-9755e1e15ce3 tempest-ServersNegativeTestJSON-430081123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-07c5ab89-3ebd-44b1-ad33-d8233e25fa72 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:52:41 devstack sudo[85551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-de0fd422-4b8c-4974-9fb4-7154f55d36c7 Apr 22 17:52:41 devstack sudo[85551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:52:41 devstack sudo[85552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-07c5ab89-3ebd-44b1-ad33-d8233e25fa72 Apr 22 17:52:41 devstack sudo[85552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:52:41 devstack sudo[85552]: pam_unix(sudo:session): session closed for user root Apr 22 17:52:41 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-8849fc1b-7b5a-4ed9-bcfc-9755e1e15ce3 tempest-ServersNegativeTestJSON-430081123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-07c5ab89-3ebd-44b1-ad33-d8233e25fa72" returned: 0 in 0.673s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:52:41 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-8849fc1b-7b5a-4ed9-bcfc-9755e1e15ce3 tempest-ServersNegativeTestJSON-430081123 None] <== create_volume: return (1439ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'} {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 17:52:41 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-8849fc1b-7b5a-4ed9-bcfc-9755e1e15ce3 tempest-ServersNegativeTestJSON-430081123 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.442s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:52:41 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-8849fc1b-7b5a-4ed9-bcfc-9755e1e15ce3 tempest-ServersNegativeTestJSON-430081123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c66e649-257a-420f-b28b-d76a18645398) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07c5ab89-3ebd-44b1-ad33-d8233e25fa72', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:52:41 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-8849fc1b-7b5a-4ed9-bcfc-9755e1e15ce3 tempest-ServersNegativeTestJSON-430081123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (007d4bc6-e6ae-4985-8975-7a0a46c6299b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:52:41 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-8849fc1b-7b5a-4ed9-bcfc-9755e1e15ce3 tempest-ServersNegativeTestJSON-430081123 None] Volume volume-07c5ab89-3ebd-44b1-ad33-d8233e25fa72 (07c5ab89-3ebd-44b1-ad33-d8233e25fa72): created successfully Apr 22 17:52:41 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-8849fc1b-7b5a-4ed9-bcfc-9755e1e15ce3 tempest-ServersNegativeTestJSON-430081123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (007d4bc6-e6ae-4985-8975-7a0a46c6299b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:52:41 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-8849fc1b-7b5a-4ed9-bcfc-9755e1e15ce3 tempest-ServersNegativeTestJSON-430081123 None] Flow 'volume_create_manager' (81531475-f125-48d2-8b52-dd9a31ab3e4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:52:41 devstack cinder-volume[81771]: DEBUG cinder.volume.flows.manager.create_volume [None req-b449f4e5-cfee-4efd-b8a2-c9cd22e9a90c tempest-GroupSnapshotsTest-38718681 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 17:52:41 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-b449f4e5-cfee-4efd-b8a2-c9cd22e9a90c tempest-GroupSnapshotsTest-38718681 None] Flow 'volume_create_manager' (a26bf0fc-4f41-4339-aae6-b0424484b43e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:52:41 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-b449f4e5-cfee-4efd-b8a2-c9cd22e9a90c tempest-GroupSnapshotsTest-38718681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dac512a-2763-458c-a775-be33c3f618c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:52:41 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-8849fc1b-7b5a-4ed9-bcfc-9755e1e15ce3 tempest-ServersNegativeTestJSON-430081123 None] Created volume successfully. Apr 22 17:52:41 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-b449f4e5-cfee-4efd-b8a2-c9cd22e9a90c tempest-GroupSnapshotsTest-38718681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dac512a-2763-458c-a775-be33c3f618c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:52:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1810920799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b59d2843-499f-4211-adf4-ca37d5b56d68,host='devstack@QuobyteHD#QuobyteHD',id=d74685c0-3558-4643-ae25-2c195bbbd356,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aea1384afd7849769b4b8ff2d3c8f873',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:52:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:52:42Z,use_quota=True,user_id='d11940f42c1645e8818355c2e86db8d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01338e21-b4c1-4a03-b2f4-17410fc3dc20),volume_type_id=01338e21-b4c1-4a03-b2f4-17410fc3dc20)' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:52:41 devstack sudo[85551]: pam_unix(sudo:session): session closed for user root Apr 22 17:52:41 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-b449f4e5-cfee-4efd-b8a2-c9cd22e9a90c tempest-GroupSnapshotsTest-38718681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (018288f5-9dd1-4e7e-9353-9d4cdb686faa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:52:41 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-b449f4e5-cfee-4efd-b8a2-c9cd22e9a90c tempest-GroupSnapshotsTest-38718681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (018288f5-9dd1-4e7e-9353-9d4cdb686faa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:52:41 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-b449f4e5-cfee-4efd-b8a2-c9cd22e9a90c tempest-GroupSnapshotsTest-38718681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbf8b5aa-bb1b-4666-8dd0-f813e132216c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:52:41 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-b449f4e5-cfee-4efd-b8a2-c9cd22e9a90c tempest-GroupSnapshotsTest-38718681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbf8b5aa-bb1b-4666-8dd0-f813e132216c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd74685c0-3558-4643-ae25-2c195bbbd356', 'volume_name': 'volume-d74685c0-3558-4643-ae25-2c195bbbd356', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:52:41 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-b449f4e5-cfee-4efd-b8a2-c9cd22e9a90c tempest-GroupSnapshotsTest-38718681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (417f1553-7e7c-4021-8d6c-bad8e9dc6e14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:52:41 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-b449f4e5-cfee-4efd-b8a2-c9cd22e9a90c tempest-GroupSnapshotsTest-38718681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (417f1553-7e7c-4021-8d6c-bad8e9dc6e14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:52:41 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-b449f4e5-cfee-4efd-b8a2-c9cd22e9a90c tempest-GroupSnapshotsTest-38718681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55194f71-1e06-4391-8614-8c4404e7d4c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:52:41 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-b449f4e5-cfee-4efd-b8a2-c9cd22e9a90c tempest-GroupSnapshotsTest-38718681 None] Volume d74685c0-3558-4643-ae25-2c195bbbd356: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d74685c0-3558-4643-ae25-2c195bbbd356', 'volume_size': 1} Apr 22 17:52:41 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-b449f4e5-cfee-4efd-b8a2-c9cd22e9a90c tempest-GroupSnapshotsTest-38718681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:52:41 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-b449f4e5-cfee-4efd-b8a2-c9cd22e9a90c tempest-GroupSnapshotsTest-38718681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:52:41 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-b449f4e5-cfee-4efd-b8a2-c9cd22e9a90c tempest-GroupSnapshotsTest-38718681 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b59d2843-499f-4211-adf4-ca37d5b56d68,created_at=2026-04-22T15:52:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1810920799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b59d2843-499f-4211-adf4-ca37d5b56d68,host='devstack@QuobyteHD#QuobyteHD',id=d74685c0-3558-4643-ae25-2c195bbbd356,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aea1384afd7849769b4b8ff2d3c8f873',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:52:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:52:42Z,use_quota=True,user_id='d11940f42c1645e8818355c2e86db8d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01338e21-b4c1-4a03-b2f4-17410fc3dc20),volume_type_id=01338e21-b4c1-4a03-b2f4-17410fc3dc20)}" {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 17:52:41 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-b449f4e5-cfee-4efd-b8a2-c9cd22e9a90c tempest-GroupSnapshotsTest-38718681 None] Creating volume d74685c0-3558-4643-ae25-2c195bbbd356 {{(pid=81771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 17:52:41 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-b449f4e5-cfee-4efd-b8a2-c9cd22e9a90c tempest-GroupSnapshotsTest-38718681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:52:41 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-b449f4e5-cfee-4efd-b8a2-c9cd22e9a90c tempest-GroupSnapshotsTest-38718681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:52:41 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-b449f4e5-cfee-4efd-b8a2-c9cd22e9a90c tempest-GroupSnapshotsTest-38718681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:52:41 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-b449f4e5-cfee-4efd-b8a2-c9cd22e9a90c tempest-GroupSnapshotsTest-38718681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:52:41 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-b449f4e5-cfee-4efd-b8a2-c9cd22e9a90c tempest-GroupSnapshotsTest-38718681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:52:41 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-b449f4e5-cfee-4efd-b8a2-c9cd22e9a90c tempest-GroupSnapshotsTest-38718681 None] Selected osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 as target Quobyte volume. {{(pid=81771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 17:52:41 devstack cinder-volume[81771]: INFO cinder.volume.drivers.remotefs [None req-b449f4e5-cfee-4efd-b8a2-c9cd22e9a90c tempest-GroupSnapshotsTest-38718681 None] casted to osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 Apr 22 17:52:41 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-b449f4e5-cfee-4efd-b8a2-c9cd22e9a90c tempest-GroupSnapshotsTest-38718681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-d74685c0-3558-4643-ae25-2c195bbbd356 1073741824 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:52:41 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-7c2310ef-ed6e-4fc8-a7c4-7edf97f40e1b tempest-VolumeSnapshotQuotasNegativeTestJSON-1088142384 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-de0fd422-4b8c-4974-9fb4-7154f55d36c7" returned: 0 in 0.942s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:52:41 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-7c2310ef-ed6e-4fc8-a7c4-7edf97f40e1b tempest-VolumeSnapshotQuotasNegativeTestJSON-1088142384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-de0fd422-4b8c-4974-9fb4-7154f55d36c7 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:52:41 devstack sudo[85559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-d74685c0-3558-4643-ae25-2c195bbbd356 1073741824 Apr 22 17:52:41 devstack sudo[85559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:52:41 devstack sudo[85560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-de0fd422-4b8c-4974-9fb4-7154f55d36c7 Apr 22 17:52:41 devstack sudo[85560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:52:42 devstack sudo[85560]: pam_unix(sudo:session): session closed for user root Apr 22 17:52:42 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-7c2310ef-ed6e-4fc8-a7c4-7edf97f40e1b tempest-VolumeSnapshotQuotasNegativeTestJSON-1088142384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-de0fd422-4b8c-4974-9fb4-7154f55d36c7" returned: 0 in 0.640s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:52:42 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-7c2310ef-ed6e-4fc8-a7c4-7edf97f40e1b tempest-VolumeSnapshotQuotasNegativeTestJSON-1088142384 None] Lock "cinder-quobyte-de0fd422-4b8c-4974-9fb4-7154f55d36c7" released by "delete_volume" :: held 1.673s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:52:42 devstack sudo[85559]: pam_unix(sudo:session): session closed for user root Apr 22 17:52:42 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-b449f4e5-cfee-4efd-b8a2-c9cd22e9a90c tempest-GroupSnapshotsTest-38718681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-d74685c0-3558-4643-ae25-2c195bbbd356 1073741824" returned: 0 in 0.769s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:52:42 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-7c2310ef-ed6e-4fc8-a7c4-7edf97f40e1b tempest-VolumeSnapshotQuotasNegativeTestJSON-1088142384 None] Created reservations ['dcc5d9d6-4679-4673-a64a-2c1c5dc9deb2', 'a5b5c996-6da5-48a4-aabb-27815edb7f15', '30b63509-27fd-4caa-a155-fafba959f86e', '3495f437-c87c-4198-a52a-1505ed7fe938'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 17:52:42 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-b449f4e5-cfee-4efd-b8a2-c9cd22e9a90c tempest-GroupSnapshotsTest-38718681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-d74685c0-3558-4643-ae25-2c195bbbd356 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:52:42 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-7c2310ef-ed6e-4fc8-a7c4-7edf97f40e1b tempest-VolumeSnapshotQuotasNegativeTestJSON-1088142384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:52:42 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-7c2310ef-ed6e-4fc8-a7c4-7edf97f40e1b tempest-VolumeSnapshotQuotasNegativeTestJSON-1088142384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:52:42 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-7c2310ef-ed6e-4fc8-a7c4-7edf97f40e1b tempest-VolumeSnapshotQuotasNegativeTestJSON-1088142384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:52:42 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-7c2310ef-ed6e-4fc8-a7c4-7edf97f40e1b tempest-VolumeSnapshotQuotasNegativeTestJSON-1088142384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:52:42 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-7c2310ef-ed6e-4fc8-a7c4-7edf97f40e1b tempest-VolumeSnapshotQuotasNegativeTestJSON-1088142384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:52:42 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-7c2310ef-ed6e-4fc8-a7c4-7edf97f40e1b tempest-VolumeSnapshotQuotasNegativeTestJSON-1088142384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:52:42 devstack sudo[85569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-d74685c0-3558-4643-ae25-2c195bbbd356 Apr 22 17:52:42 devstack sudo[85569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:52:42 devstack sudo[85571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 Apr 22 17:52:42 devstack sudo[85571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:52:42 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-ea6e00cd-a19d-4e1e-abac-8d384692d0d8 tempest-ServersNegativeTestJSON-430081123 None] Acquiring lock "cinder-07c5ab89-3ebd-44b1-ad33-d8233e25fa72-delete_volume" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:52:42 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-ea6e00cd-a19d-4e1e-abac-8d384692d0d8 tempest-ServersNegativeTestJSON-430081123 None] Lock "cinder-07c5ab89-3ebd-44b1-ad33-d8233e25fa72-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:52:43 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-ea6e00cd-a19d-4e1e-abac-8d384692d0d8 tempest-ServersNegativeTestJSON-430081123 None] Acquiring lock "cinder-quobyte-07c5ab89-3ebd-44b1-ad33-d8233e25fa72" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:52:43 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-ea6e00cd-a19d-4e1e-abac-8d384692d0d8 tempest-ServersNegativeTestJSON-430081123 None] Lock "cinder-quobyte-07c5ab89-3ebd-44b1-ad33-d8233e25fa72" acquired by "delete_volume" :: waited 0.028s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:52:43 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f77f4b0-8c7f-4e26-a309-3e92cab0a95a]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:52:43 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-ea6e00cd-a19d-4e1e-abac-8d384692d0d8 tempest-ServersNegativeTestJSON-430081123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-07c5ab89-3ebd-44b1-ad33-d8233e25fa72 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:52:43 devstack sudo[85576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-07c5ab89-3ebd-44b1-ad33-d8233e25fa72 Apr 22 17:52:43 devstack sudo[85576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:52:44 devstack sudo[85571]: pam_unix(sudo:session): session closed for user root Apr 22 17:52:44 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-7c2310ef-ed6e-4fc8-a7c4-7edf97f40e1b tempest-VolumeSnapshotQuotasNegativeTestJSON-1088142384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33" returned: 0 in 1.154s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:52:44 devstack cinder-volume[81771]: DEBUG cinder.manager [None req-7c2310ef-ed6e-4fc8-a7c4-7edf97f40e1b tempest-VolumeSnapshotQuotasNegativeTestJSON-1088142384 None] Notifying Schedulers of capabilities ... {{(pid=81771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 17:52:44 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-7c2310ef-ed6e-4fc8-a7c4-7edf97f40e1b tempest-VolumeSnapshotQuotasNegativeTestJSON-1088142384 None] Deleted volume successfully. Apr 22 17:52:44 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-7c2310ef-ed6e-4fc8-a7c4-7edf97f40e1b tempest-VolumeSnapshotQuotasNegativeTestJSON-1088142384 None] Lock "cinder-de0fd422-4b8c-4974-9fb4-7154f55d36c7-delete_volume" released by "delete_volume" :: held 3.246s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:52:44 devstack sudo[85569]: pam_unix(sudo:session): session closed for user root Apr 22 17:52:44 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-b449f4e5-cfee-4efd-b8a2-c9cd22e9a90c tempest-GroupSnapshotsTest-38718681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-d74685c0-3558-4643-ae25-2c195bbbd356" returned: 0 in 1.461s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:52:44 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-b449f4e5-cfee-4efd-b8a2-c9cd22e9a90c tempest-GroupSnapshotsTest-38718681 None] <== create_volume: return (2369ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'} {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 17:52:44 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-b449f4e5-cfee-4efd-b8a2-c9cd22e9a90c tempest-GroupSnapshotsTest-38718681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.373s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:52:44 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-b449f4e5-cfee-4efd-b8a2-c9cd22e9a90c tempest-GroupSnapshotsTest-38718681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55194f71-1e06-4391-8614-8c4404e7d4c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d74685c0-3558-4643-ae25-2c195bbbd356', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:52:44 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-b449f4e5-cfee-4efd-b8a2-c9cd22e9a90c tempest-GroupSnapshotsTest-38718681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ace48ef9-db5d-472a-a33d-067194274e94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:52:44 devstack sudo[85576]: pam_unix(sudo:session): session closed for user root Apr 22 17:52:44 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-ea6e00cd-a19d-4e1e-abac-8d384692d0d8 tempest-ServersNegativeTestJSON-430081123 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-07c5ab89-3ebd-44b1-ad33-d8233e25fa72" returned: 0 in 1.208s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:52:44 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-ea6e00cd-a19d-4e1e-abac-8d384692d0d8 tempest-ServersNegativeTestJSON-430081123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-07c5ab89-3ebd-44b1-ad33-d8233e25fa72 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:52:44 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-b449f4e5-cfee-4efd-b8a2-c9cd22e9a90c tempest-GroupSnapshotsTest-38718681 None] Volume volume-d74685c0-3558-4643-ae25-2c195bbbd356 (d74685c0-3558-4643-ae25-2c195bbbd356): created successfully Apr 22 17:52:44 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-b449f4e5-cfee-4efd-b8a2-c9cd22e9a90c tempest-GroupSnapshotsTest-38718681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ace48ef9-db5d-472a-a33d-067194274e94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:52:44 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-b449f4e5-cfee-4efd-b8a2-c9cd22e9a90c tempest-GroupSnapshotsTest-38718681 None] Flow 'volume_create_manager' (a26bf0fc-4f41-4339-aae6-b0424484b43e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:52:44 devstack sudo[85608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-07c5ab89-3ebd-44b1-ad33-d8233e25fa72 Apr 22 17:52:44 devstack sudo[85608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:52:44 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-b449f4e5-cfee-4efd-b8a2-c9cd22e9a90c tempest-GroupSnapshotsTest-38718681 None] Created volume successfully. Apr 22 17:52:45 devstack sudo[85608]: pam_unix(sudo:session): session closed for user root Apr 22 17:52:45 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-ea6e00cd-a19d-4e1e-abac-8d384692d0d8 tempest-ServersNegativeTestJSON-430081123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-07c5ab89-3ebd-44b1-ad33-d8233e25fa72" returned: 0 in 0.946s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:52:45 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-ea6e00cd-a19d-4e1e-abac-8d384692d0d8 tempest-ServersNegativeTestJSON-430081123 None] Lock "cinder-quobyte-07c5ab89-3ebd-44b1-ad33-d8233e25fa72" released by "delete_volume" :: held 2.212s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:52:45 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-ea6e00cd-a19d-4e1e-abac-8d384692d0d8 tempest-ServersNegativeTestJSON-430081123 None] Created reservations ['fa9a5c6a-bf85-4c0f-89c0-5e18902408b8', '8bbefba1-8ee5-43af-8154-bbbb382f26de', '65149191-ad8b-4c9b-9f4e-b497ff97ea0c', '9403ddf4-8b6b-4fb2-acc3-e30d0155b7af'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 17:52:45 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-ea6e00cd-a19d-4e1e-abac-8d384692d0d8 tempest-ServersNegativeTestJSON-430081123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:52:45 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-ea6e00cd-a19d-4e1e-abac-8d384692d0d8 tempest-ServersNegativeTestJSON-430081123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:52:45 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-ea6e00cd-a19d-4e1e-abac-8d384692d0d8 tempest-ServersNegativeTestJSON-430081123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:52:45 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-ea6e00cd-a19d-4e1e-abac-8d384692d0d8 tempest-ServersNegativeTestJSON-430081123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:52:45 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-ea6e00cd-a19d-4e1e-abac-8d384692d0d8 tempest-ServersNegativeTestJSON-430081123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:52:45 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-ea6e00cd-a19d-4e1e-abac-8d384692d0d8 tempest-ServersNegativeTestJSON-430081123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:52:45 devstack sudo[85628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 Apr 22 17:52:45 devstack sudo[85628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:52:46 devstack sudo[85628]: pam_unix(sudo:session): session closed for user root Apr 22 17:52:46 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-ea6e00cd-a19d-4e1e-abac-8d384692d0d8 tempest-ServersNegativeTestJSON-430081123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33" returned: 0 in 0.926s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:52:46 devstack cinder-volume[81771]: DEBUG cinder.manager [None req-ea6e00cd-a19d-4e1e-abac-8d384692d0d8 tempest-ServersNegativeTestJSON-430081123 None] Notifying Schedulers of capabilities ... {{(pid=81771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 17:52:46 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-ea6e00cd-a19d-4e1e-abac-8d384692d0d8 tempest-ServersNegativeTestJSON-430081123 None] Deleted volume successfully. Apr 22 17:52:46 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-ea6e00cd-a19d-4e1e-abac-8d384692d0d8 tempest-ServersNegativeTestJSON-430081123 None] Lock "cinder-07c5ab89-3ebd-44b1-ad33-d8233e25fa72-delete_volume" released by "delete_volume" :: held 3.508s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:52:46 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-ebba3ad5-3343-4b68-b570-17bb43b5be8d tempest-ServersNegativeTestJSON-430081123 None] Acquiring lock "cinder-8fe88c62-1e79-431d-8092-516cab8682e2-delete_volume" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:52:46 devstack cinder-volume[81771]: DEBUG cinder.volume.flows.manager.create_volume [None req-60e750a6-a37f-4694-8cb9-d067ea67ad5f tempest-GroupSnapshotsTest-38718681 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 17:52:46 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-60e750a6-a37f-4694-8cb9-d067ea67ad5f tempest-GroupSnapshotsTest-38718681 None] Flow 'volume_create_manager' (103b6d9c-fbf9-4771-acb7-eb66a800b9e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:52:46 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-60e750a6-a37f-4694-8cb9-d067ea67ad5f tempest-GroupSnapshotsTest-38718681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02b8940b-2025-4bdd-be05-c5f11147c54e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:52:46 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-60e750a6-a37f-4694-8cb9-d067ea67ad5f tempest-GroupSnapshotsTest-38718681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02b8940b-2025-4bdd-be05-c5f11147c54e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:52:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-91876345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b59d2843-499f-4211-adf4-ca37d5b56d68,host='devstack@QuobyteHD#QuobyteHD',id=b2bc74d7-0c38-4930-a975-8388b7be1d2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aea1384afd7849769b4b8ff2d3c8f873',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:52:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:52:46Z,use_quota=True,user_id='d11940f42c1645e8818355c2e86db8d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01338e21-b4c1-4a03-b2f4-17410fc3dc20),volume_type_id=01338e21-b4c1-4a03-b2f4-17410fc3dc20)' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:52:46 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-60e750a6-a37f-4694-8cb9-d067ea67ad5f tempest-GroupSnapshotsTest-38718681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (babd5d21-381d-4554-8240-c3bc7eb0c84e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:52:46 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-60e750a6-a37f-4694-8cb9-d067ea67ad5f tempest-GroupSnapshotsTest-38718681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (babd5d21-381d-4554-8240-c3bc7eb0c84e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:52:46 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-60e750a6-a37f-4694-8cb9-d067ea67ad5f tempest-GroupSnapshotsTest-38718681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22307047-93cc-43fb-907d-e7ee1e424ea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:52:46 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-60e750a6-a37f-4694-8cb9-d067ea67ad5f tempest-GroupSnapshotsTest-38718681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22307047-93cc-43fb-907d-e7ee1e424ea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2bc74d7-0c38-4930-a975-8388b7be1d2e', 'volume_name': 'volume-b2bc74d7-0c38-4930-a975-8388b7be1d2e', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:52:46 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-60e750a6-a37f-4694-8cb9-d067ea67ad5f tempest-GroupSnapshotsTest-38718681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81bd925c-d0c2-4ea2-a57f-0101542c2cae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:52:46 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-60e750a6-a37f-4694-8cb9-d067ea67ad5f tempest-GroupSnapshotsTest-38718681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81bd925c-d0c2-4ea2-a57f-0101542c2cae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:52:46 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-60e750a6-a37f-4694-8cb9-d067ea67ad5f tempest-GroupSnapshotsTest-38718681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (163be5d7-9e1d-4f0d-bb71-ab16a6e5c876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:52:46 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-60e750a6-a37f-4694-8cb9-d067ea67ad5f tempest-GroupSnapshotsTest-38718681 None] Volume b2bc74d7-0c38-4930-a975-8388b7be1d2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2bc74d7-0c38-4930-a975-8388b7be1d2e', 'volume_size': 1} Apr 22 17:52:46 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-60e750a6-a37f-4694-8cb9-d067ea67ad5f tempest-GroupSnapshotsTest-38718681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:52:46 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-60e750a6-a37f-4694-8cb9-d067ea67ad5f tempest-GroupSnapshotsTest-38718681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:52:46 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-60e750a6-a37f-4694-8cb9-d067ea67ad5f tempest-GroupSnapshotsTest-38718681 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b59d2843-499f-4211-adf4-ca37d5b56d68,created_at=2026-04-22T15:52:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-91876345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b59d2843-499f-4211-adf4-ca37d5b56d68,host='devstack@QuobyteHD#QuobyteHD',id=b2bc74d7-0c38-4930-a975-8388b7be1d2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aea1384afd7849769b4b8ff2d3c8f873',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:52:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:52:46Z,use_quota=True,user_id='d11940f42c1645e8818355c2e86db8d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01338e21-b4c1-4a03-b2f4-17410fc3dc20),volume_type_id=01338e21-b4c1-4a03-b2f4-17410fc3dc20)}" {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 17:52:46 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-60e750a6-a37f-4694-8cb9-d067ea67ad5f tempest-GroupSnapshotsTest-38718681 None] Creating volume b2bc74d7-0c38-4930-a975-8388b7be1d2e {{(pid=81771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 17:52:46 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-60e750a6-a37f-4694-8cb9-d067ea67ad5f tempest-GroupSnapshotsTest-38718681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:52:46 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-60e750a6-a37f-4694-8cb9-d067ea67ad5f tempest-GroupSnapshotsTest-38718681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:52:46 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-60e750a6-a37f-4694-8cb9-d067ea67ad5f tempest-GroupSnapshotsTest-38718681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:52:46 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-60e750a6-a37f-4694-8cb9-d067ea67ad5f tempest-GroupSnapshotsTest-38718681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:52:46 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-60e750a6-a37f-4694-8cb9-d067ea67ad5f tempest-GroupSnapshotsTest-38718681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:52:46 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-60e750a6-a37f-4694-8cb9-d067ea67ad5f tempest-GroupSnapshotsTest-38718681 None] Selected osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 as target Quobyte volume. {{(pid=81771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 17:52:46 devstack cinder-volume[81771]: INFO cinder.volume.drivers.remotefs [None req-60e750a6-a37f-4694-8cb9-d067ea67ad5f tempest-GroupSnapshotsTest-38718681 None] casted to osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 Apr 22 17:52:46 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-60e750a6-a37f-4694-8cb9-d067ea67ad5f tempest-GroupSnapshotsTest-38718681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b2bc74d7-0c38-4930-a975-8388b7be1d2e 1073741824 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:52:46 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-ebba3ad5-3343-4b68-b570-17bb43b5be8d tempest-ServersNegativeTestJSON-430081123 None] Lock "cinder-8fe88c62-1e79-431d-8092-516cab8682e2-delete_volume" acquired by "delete_volume" :: waited 0.224s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:52:46 devstack sudo[85637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b2bc74d7-0c38-4930-a975-8388b7be1d2e 1073741824 Apr 22 17:52:46 devstack sudo[85637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:52:46 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-ebba3ad5-3343-4b68-b570-17bb43b5be8d tempest-ServersNegativeTestJSON-430081123 None] Acquiring lock "cinder-quobyte-8fe88c62-1e79-431d-8092-516cab8682e2" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:52:46 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-ebba3ad5-3343-4b68-b570-17bb43b5be8d tempest-ServersNegativeTestJSON-430081123 None] Lock "cinder-quobyte-8fe88c62-1e79-431d-8092-516cab8682e2" acquired by "delete_volume" :: waited 0.024s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:52:46 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[128a2daf-2c16-4b54-a71e-9279da92f39d]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:52:46 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-ebba3ad5-3343-4b68-b570-17bb43b5be8d tempest-ServersNegativeTestJSON-430081123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-8fe88c62-1e79-431d-8092-516cab8682e2 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:52:47 devstack sudo[85640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-8fe88c62-1e79-431d-8092-516cab8682e2 Apr 22 17:52:47 devstack sudo[85640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:52:47 devstack sudo[85637]: pam_unix(sudo:session): session closed for user root Apr 22 17:52:47 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-60e750a6-a37f-4694-8cb9-d067ea67ad5f tempest-GroupSnapshotsTest-38718681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b2bc74d7-0c38-4930-a975-8388b7be1d2e 1073741824" returned: 0 in 1.128s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:52:47 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-60e750a6-a37f-4694-8cb9-d067ea67ad5f tempest-GroupSnapshotsTest-38718681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b2bc74d7-0c38-4930-a975-8388b7be1d2e {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:52:47 devstack sudo[85640]: pam_unix(sudo:session): session closed for user root Apr 22 17:52:47 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-ebba3ad5-3343-4b68-b570-17bb43b5be8d tempest-ServersNegativeTestJSON-430081123 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-8fe88c62-1e79-431d-8092-516cab8682e2" returned: 0 in 1.068s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:52:48 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-ebba3ad5-3343-4b68-b570-17bb43b5be8d tempest-ServersNegativeTestJSON-430081123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-8fe88c62-1e79-431d-8092-516cab8682e2 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:52:48 devstack sudo[85674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b2bc74d7-0c38-4930-a975-8388b7be1d2e Apr 22 17:52:48 devstack sudo[85674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:52:48 devstack sudo[85675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-8fe88c62-1e79-431d-8092-516cab8682e2 Apr 22 17:52:48 devstack sudo[85675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:52:48 devstack sudo[85674]: pam_unix(sudo:session): session closed for user root Apr 22 17:52:48 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-60e750a6-a37f-4694-8cb9-d067ea67ad5f tempest-GroupSnapshotsTest-38718681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b2bc74d7-0c38-4930-a975-8388b7be1d2e" returned: 0 in 0.565s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:52:48 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-60e750a6-a37f-4694-8cb9-d067ea67ad5f tempest-GroupSnapshotsTest-38718681 None] <== create_volume: return (1746ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'} {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 17:52:48 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-60e750a6-a37f-4694-8cb9-d067ea67ad5f tempest-GroupSnapshotsTest-38718681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.749s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:52:48 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-60e750a6-a37f-4694-8cb9-d067ea67ad5f tempest-GroupSnapshotsTest-38718681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (163be5d7-9e1d-4f0d-bb71-ab16a6e5c876) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2bc74d7-0c38-4930-a975-8388b7be1d2e', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:52:48 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-60e750a6-a37f-4694-8cb9-d067ea67ad5f tempest-GroupSnapshotsTest-38718681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cedb5259-3988-4ee8-9c54-b63c8089ab1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:52:48 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-60e750a6-a37f-4694-8cb9-d067ea67ad5f tempest-GroupSnapshotsTest-38718681 None] Volume volume-b2bc74d7-0c38-4930-a975-8388b7be1d2e (b2bc74d7-0c38-4930-a975-8388b7be1d2e): created successfully Apr 22 17:52:48 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-60e750a6-a37f-4694-8cb9-d067ea67ad5f tempest-GroupSnapshotsTest-38718681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cedb5259-3988-4ee8-9c54-b63c8089ab1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:52:48 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-60e750a6-a37f-4694-8cb9-d067ea67ad5f tempest-GroupSnapshotsTest-38718681 None] Flow 'volume_create_manager' (103b6d9c-fbf9-4771-acb7-eb66a800b9e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:52:48 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-60e750a6-a37f-4694-8cb9-d067ea67ad5f tempest-GroupSnapshotsTest-38718681 None] Created volume successfully. Apr 22 17:52:48 devstack sudo[85675]: pam_unix(sudo:session): session closed for user root Apr 22 17:52:48 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-ebba3ad5-3343-4b68-b570-17bb43b5be8d tempest-ServersNegativeTestJSON-430081123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-8fe88c62-1e79-431d-8092-516cab8682e2" returned: 0 in 0.660s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:52:48 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-ebba3ad5-3343-4b68-b570-17bb43b5be8d tempest-ServersNegativeTestJSON-430081123 None] Lock "cinder-quobyte-8fe88c62-1e79-431d-8092-516cab8682e2" released by "delete_volume" :: held 1.800s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:52:48 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-ebba3ad5-3343-4b68-b570-17bb43b5be8d tempest-ServersNegativeTestJSON-430081123 None] Created reservations ['7e3095a6-bf44-46a2-a550-14bf89e2984e', 'c8b37df9-baba-43c0-818c-5609bd04bffd', '07f87117-ffd1-4cbb-a4e5-e3866dbd51d6', '39ac6a2b-a28f-48f2-9bbc-e3ddfd247361'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 17:52:48 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-ebba3ad5-3343-4b68-b570-17bb43b5be8d tempest-ServersNegativeTestJSON-430081123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:52:48 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-ebba3ad5-3343-4b68-b570-17bb43b5be8d tempest-ServersNegativeTestJSON-430081123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:52:48 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-ebba3ad5-3343-4b68-b570-17bb43b5be8d tempest-ServersNegativeTestJSON-430081123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:52:48 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-ebba3ad5-3343-4b68-b570-17bb43b5be8d tempest-ServersNegativeTestJSON-430081123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:52:48 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-ebba3ad5-3343-4b68-b570-17bb43b5be8d tempest-ServersNegativeTestJSON-430081123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:52:48 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-ebba3ad5-3343-4b68-b570-17bb43b5be8d tempest-ServersNegativeTestJSON-430081123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:52:48 devstack sudo[85680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 Apr 22 17:52:48 devstack sudo[85680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:52:49 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-1c869f63-44ef-4994-ac56-839acaf8ca5b tempest-GroupSnapshotsTest-38718681 None] Update group completed successfully. Apr 22 17:52:49 devstack sudo[85680]: pam_unix(sudo:session): session closed for user root Apr 22 17:52:49 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-ebba3ad5-3343-4b68-b570-17bb43b5be8d tempest-ServersNegativeTestJSON-430081123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33" returned: 0 in 0.816s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:52:49 devstack cinder-volume[81771]: DEBUG cinder.manager [None req-ebba3ad5-3343-4b68-b570-17bb43b5be8d tempest-ServersNegativeTestJSON-430081123 None] Notifying Schedulers of capabilities ... {{(pid=81771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 17:52:49 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-ebba3ad5-3343-4b68-b570-17bb43b5be8d tempest-ServersNegativeTestJSON-430081123 None] Deleted volume successfully. Apr 22 17:52:49 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-ebba3ad5-3343-4b68-b570-17bb43b5be8d tempest-ServersNegativeTestJSON-430081123 None] Lock "cinder-8fe88c62-1e79-431d-8092-516cab8682e2-delete_volume" released by "delete_volume" :: held 2.940s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:52:50 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-a31bae48-fb19-47fe-9fca-158c390a2e1f tempest-GroupSnapshotsTest-38718681 None] Update group completed successfully. Apr 22 17:52:51 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-e125916b-f7dd-4a7c-bb8e-b8ee206ba742 tempest-GroupSnapshotsTest-38718681 None] Update group completed successfully. Apr 22 17:52:51 devstack cinder-volume[81771]: DEBUG cinder.volume.flows.manager.create_volume [None req-adfbf4f3-15d1-47fe-aa3f-4f01323b1fca tempest-VolumeTypesAccessTest-250921684 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 17:52:51 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-adfbf4f3-15d1-47fe-aa3f-4f01323b1fca tempest-VolumeTypesAccessTest-250921684 None] Flow 'volume_create_manager' (a803f55e-36e6-49bf-b912-5f96dc596cb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:52:51 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-adfbf4f3-15d1-47fe-aa3f-4f01323b1fca tempest-VolumeTypesAccessTest-250921684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c5e827d-c807-47f8-acae-8881eefb5396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:52:51 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-adfbf4f3-15d1-47fe-aa3f-4f01323b1fca tempest-VolumeTypesAccessTest-250921684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c5e827d-c807-47f8-acae-8881eefb5396) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:52:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1156487152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7f68b8a-2b62-431b-85f3-367d1f57de27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a508fedc296d4ff9839631498cb4f341',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:52:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:52:52Z,use_quota=True,user_id='f78569b569014e6490d27041e793c510',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1c0bf4b8-9076-4a0b-92ed-7b5f2c1d0ea5),volume_type_id=1c0bf4b8-9076-4a0b-92ed-7b5f2c1d0ea5)' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:52:51 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-adfbf4f3-15d1-47fe-aa3f-4f01323b1fca tempest-VolumeTypesAccessTest-250921684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0df75f3a-0c00-47a3-ad36-d2a08aff7013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:52:51 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-adfbf4f3-15d1-47fe-aa3f-4f01323b1fca tempest-VolumeTypesAccessTest-250921684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0df75f3a-0c00-47a3-ad36-d2a08aff7013) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:52:51 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-adfbf4f3-15d1-47fe-aa3f-4f01323b1fca tempest-VolumeTypesAccessTest-250921684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b721254a-dfee-420d-9b95-a9a605e56260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:52:51 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-adfbf4f3-15d1-47fe-aa3f-4f01323b1fca tempest-VolumeTypesAccessTest-250921684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b721254a-dfee-420d-9b95-a9a605e56260) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7f68b8a-2b62-431b-85f3-367d1f57de27', 'volume_name': 'volume-e7f68b8a-2b62-431b-85f3-367d1f57de27', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:52:51 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-adfbf4f3-15d1-47fe-aa3f-4f01323b1fca tempest-VolumeTypesAccessTest-250921684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80f4de22-fbe0-4bd6-9c58-37ec4a1be5c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:52:51 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-adfbf4f3-15d1-47fe-aa3f-4f01323b1fca tempest-VolumeTypesAccessTest-250921684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80f4de22-fbe0-4bd6-9c58-37ec4a1be5c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:52:51 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-adfbf4f3-15d1-47fe-aa3f-4f01323b1fca tempest-VolumeTypesAccessTest-250921684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f375b368-bdae-4e56-ab09-bcf6f63b240c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:52:51 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-adfbf4f3-15d1-47fe-aa3f-4f01323b1fca tempest-VolumeTypesAccessTest-250921684 None] Volume e7f68b8a-2b62-431b-85f3-367d1f57de27: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7f68b8a-2b62-431b-85f3-367d1f57de27', 'volume_size': 1} Apr 22 17:52:51 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-adfbf4f3-15d1-47fe-aa3f-4f01323b1fca tempest-VolumeTypesAccessTest-250921684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:52:51 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-adfbf4f3-15d1-47fe-aa3f-4f01323b1fca tempest-VolumeTypesAccessTest-250921684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:52:51 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-adfbf4f3-15d1-47fe-aa3f-4f01323b1fca tempest-VolumeTypesAccessTest-250921684 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:52:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1156487152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7f68b8a-2b62-431b-85f3-367d1f57de27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a508fedc296d4ff9839631498cb4f341',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:52:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:52:52Z,use_quota=True,user_id='f78569b569014e6490d27041e793c510',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1c0bf4b8-9076-4a0b-92ed-7b5f2c1d0ea5),volume_type_id=1c0bf4b8-9076-4a0b-92ed-7b5f2c1d0ea5)}" {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 17:52:51 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-adfbf4f3-15d1-47fe-aa3f-4f01323b1fca tempest-VolumeTypesAccessTest-250921684 None] Creating volume e7f68b8a-2b62-431b-85f3-367d1f57de27 {{(pid=81771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 17:52:51 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-adfbf4f3-15d1-47fe-aa3f-4f01323b1fca tempest-VolumeTypesAccessTest-250921684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:52:51 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-adfbf4f3-15d1-47fe-aa3f-4f01323b1fca tempest-VolumeTypesAccessTest-250921684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:52:51 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-adfbf4f3-15d1-47fe-aa3f-4f01323b1fca tempest-VolumeTypesAccessTest-250921684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:52:51 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-adfbf4f3-15d1-47fe-aa3f-4f01323b1fca tempest-VolumeTypesAccessTest-250921684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:52:51 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-adfbf4f3-15d1-47fe-aa3f-4f01323b1fca tempest-VolumeTypesAccessTest-250921684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:52:51 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-adfbf4f3-15d1-47fe-aa3f-4f01323b1fca tempest-VolumeTypesAccessTest-250921684 None] Selected osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 as target Quobyte volume. {{(pid=81771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 17:52:51 devstack cinder-volume[81771]: INFO cinder.volume.drivers.remotefs [None req-adfbf4f3-15d1-47fe-aa3f-4f01323b1fca tempest-VolumeTypesAccessTest-250921684 None] casted to osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 Apr 22 17:52:51 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-adfbf4f3-15d1-47fe-aa3f-4f01323b1fca tempest-VolumeTypesAccessTest-250921684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e7f68b8a-2b62-431b-85f3-367d1f57de27 1073741824 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:52:51 devstack sudo[85715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e7f68b8a-2b62-431b-85f3-367d1f57de27 1073741824 Apr 22 17:52:51 devstack sudo[85715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:52:52 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-2c19ee99-ba8c-4580-918a-81b79dd4359d tempest-GroupSnapshotsTest-38718681 None] Update group completed successfully. Apr 22 17:52:52 devstack sudo[85715]: pam_unix(sudo:session): session closed for user root Apr 22 17:52:52 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-adfbf4f3-15d1-47fe-aa3f-4f01323b1fca tempest-VolumeTypesAccessTest-250921684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e7f68b8a-2b62-431b-85f3-367d1f57de27 1073741824" returned: 0 in 0.836s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:52:52 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-adfbf4f3-15d1-47fe-aa3f-4f01323b1fca tempest-VolumeTypesAccessTest-250921684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e7f68b8a-2b62-431b-85f3-367d1f57de27 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:52:52 devstack sudo[85726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e7f68b8a-2b62-431b-85f3-367d1f57de27 Apr 22 17:52:52 devstack sudo[85726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:52:53 devstack sudo[85726]: pam_unix(sudo:session): session closed for user root Apr 22 17:52:53 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-adfbf4f3-15d1-47fe-aa3f-4f01323b1fca tempest-VolumeTypesAccessTest-250921684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e7f68b8a-2b62-431b-85f3-367d1f57de27" returned: 0 in 0.518s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:52:53 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-adfbf4f3-15d1-47fe-aa3f-4f01323b1fca tempest-VolumeTypesAccessTest-250921684 None] <== create_volume: return (1450ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'} {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 17:52:53 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-adfbf4f3-15d1-47fe-aa3f-4f01323b1fca tempest-VolumeTypesAccessTest-250921684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.454s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:52:53 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-adfbf4f3-15d1-47fe-aa3f-4f01323b1fca tempest-VolumeTypesAccessTest-250921684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f375b368-bdae-4e56-ab09-bcf6f63b240c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7f68b8a-2b62-431b-85f3-367d1f57de27', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:52:53 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-adfbf4f3-15d1-47fe-aa3f-4f01323b1fca tempest-VolumeTypesAccessTest-250921684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfc2a997-8f91-46d4-8e14-699d6228050c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:52:53 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-adfbf4f3-15d1-47fe-aa3f-4f01323b1fca tempest-VolumeTypesAccessTest-250921684 None] Volume volume-e7f68b8a-2b62-431b-85f3-367d1f57de27 (e7f68b8a-2b62-431b-85f3-367d1f57de27): created successfully Apr 22 17:52:53 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-adfbf4f3-15d1-47fe-aa3f-4f01323b1fca tempest-VolumeTypesAccessTest-250921684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfc2a997-8f91-46d4-8e14-699d6228050c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:52:53 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-adfbf4f3-15d1-47fe-aa3f-4f01323b1fca tempest-VolumeTypesAccessTest-250921684 None] Flow 'volume_create_manager' (a803f55e-36e6-49bf-b912-5f96dc596cb0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:52:53 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-adfbf4f3-15d1-47fe-aa3f-4f01323b1fca tempest-VolumeTypesAccessTest-250921684 None] Created volume successfully. Apr 22 17:52:54 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-05a3f05a-9195-41d6-82e5-a06d9e4543a0 tempest-GroupSnapshotsTest-38718681 None] GroupSnapshot 7590b550-7eb1-43d4-8f19-9294e973478e: creating. Apr 22 17:52:54 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-05a3f05a-9195-41d6-82e5-a06d9e4543a0 tempest-GroupSnapshotsTest-38718681 None] Group snapshot 7590b550-7eb1-43d4-8f19-9294e973478e: creating. {{(pid=81771) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 22 17:52:54 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-05a3f05a-9195-41d6-82e5-a06d9e4543a0 tempest-GroupSnapshotsTest-38718681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:52:54 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-05a3f05a-9195-41d6-82e5-a06d9e4543a0 tempest-GroupSnapshotsTest-38718681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:52:54 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-05a3f05a-9195-41d6-82e5-a06d9e4543a0 tempest-GroupSnapshotsTest-38718681 None] Creating offline snapshot 4c4b35e5-9e2e-4910-9726-ce9b144be8d5 of volume b2bc74d7-0c38-4930-a975-8388b7be1d2e {{(pid=81771) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 22 17:52:54 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[8051a5fa-d0f2-411f-a2f2-12afef48641b]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:52:54 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-05a3f05a-9195-41d6-82e5-a06d9e4543a0 tempest-GroupSnapshotsTest-38718681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b2bc74d7-0c38-4930-a975-8388b7be1d2e {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:52:54 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-a542149c-ece4-49c7-b787-3bcaf04dfde6 tempest-VolumeTypesAccessTest-250921684 None] Acquiring lock "cinder-e7f68b8a-2b62-431b-85f3-367d1f57de27-delete_volume" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:52:54 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-a542149c-ece4-49c7-b787-3bcaf04dfde6 tempest-VolumeTypesAccessTest-250921684 None] Lock "cinder-e7f68b8a-2b62-431b-85f3-367d1f57de27-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:52:54 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-a542149c-ece4-49c7-b787-3bcaf04dfde6 tempest-VolumeTypesAccessTest-250921684 None] Acquiring lock "cinder-quobyte-e7f68b8a-2b62-431b-85f3-367d1f57de27" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:52:54 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-a542149c-ece4-49c7-b787-3bcaf04dfde6 tempest-VolumeTypesAccessTest-250921684 None] Lock "cinder-quobyte-e7f68b8a-2b62-431b-85f3-367d1f57de27" acquired by "delete_volume" :: waited 0.018s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:52:54 devstack sudo[85730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b2bc74d7-0c38-4930-a975-8388b7be1d2e Apr 22 17:52:54 devstack sudo[85730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:52:54 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[abf4fc96-04ba-4d3b-94b1-a2f97052bc5d]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:52:54 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-a542149c-ece4-49c7-b787-3bcaf04dfde6 tempest-VolumeTypesAccessTest-250921684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e7f68b8a-2b62-431b-85f3-367d1f57de27 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:52:54 devstack sudo[85732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e7f68b8a-2b62-431b-85f3-367d1f57de27 Apr 22 17:52:54 devstack sudo[85732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:52:54 devstack sudo[85730]: pam_unix(sudo:session): session closed for user root Apr 22 17:52:54 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-05a3f05a-9195-41d6-82e5-a06d9e4543a0 tempest-GroupSnapshotsTest-38718681 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b2bc74d7-0c38-4930-a975-8388b7be1d2e" returned: 0 in 0.617s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:52:54 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-05a3f05a-9195-41d6-82e5-a06d9e4543a0 tempest-GroupSnapshotsTest-38718681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b2bc74d7-0c38-4930-a975-8388b7be1d2e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b2bc74d7-0c38-4930-a975-8388b7be1d2e.4c4b35e5-9e2e-4910-9726-ce9b144be8d5 1G {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:52:54 devstack sudo[85740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b2bc74d7-0c38-4930-a975-8388b7be1d2e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b2bc74d7-0c38-4930-a975-8388b7be1d2e.4c4b35e5-9e2e-4910-9726-ce9b144be8d5 1G Apr 22 17:52:54 devstack sudo[85740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:52:54 devstack sudo[85732]: pam_unix(sudo:session): session closed for user root Apr 22 17:52:54 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-a542149c-ece4-49c7-b787-3bcaf04dfde6 tempest-VolumeTypesAccessTest-250921684 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e7f68b8a-2b62-431b-85f3-367d1f57de27" returned: 0 in 0.608s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:52:54 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-a542149c-ece4-49c7-b787-3bcaf04dfde6 tempest-VolumeTypesAccessTest-250921684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e7f68b8a-2b62-431b-85f3-367d1f57de27 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:52:54 devstack sudo[85743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e7f68b8a-2b62-431b-85f3-367d1f57de27 Apr 22 17:52:54 devstack sudo[85743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:52:55 devstack sudo[85743]: pam_unix(sudo:session): session closed for user root Apr 22 17:52:55 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-a542149c-ece4-49c7-b787-3bcaf04dfde6 tempest-VolumeTypesAccessTest-250921684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e7f68b8a-2b62-431b-85f3-367d1f57de27" returned: 0 in 0.536s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:52:55 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-a542149c-ece4-49c7-b787-3bcaf04dfde6 tempest-VolumeTypesAccessTest-250921684 None] Lock "cinder-quobyte-e7f68b8a-2b62-431b-85f3-367d1f57de27" released by "delete_volume" :: held 1.186s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:52:55 devstack cinder-volume[81771]: WARNING cinder.quota [None req-a542149c-ece4-49c7-b787-3bcaf04dfde6 tempest-VolumeTypesAccessTest-250921684 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-2801657 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-2801657, it is now deprecated. Please use the default quota class for default quota. Apr 22 17:52:55 devstack cinder-volume[81771]: WARNING cinder.quota [None req-a542149c-ece4-49c7-b787-3bcaf04dfde6 tempest-VolumeTypesAccessTest-250921684 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-2801657 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-2801657, it is now deprecated. Please use the default quota class for default quota. Apr 22 17:52:55 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-a542149c-ece4-49c7-b787-3bcaf04dfde6 tempest-VolumeTypesAccessTest-250921684 None] Created reservations ['0226f47f-05d2-4747-8342-0e00e7e2ae4d', 'c2da4172-8e5a-48e0-b67d-e6f9ff302319', '02126b25-d75e-402f-a35f-b92886c7090e', '0263268e-9f56-4cb4-8947-9926df481385'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 17:52:55 devstack sudo[85740]: pam_unix(sudo:session): session closed for user root Apr 22 17:52:55 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-05a3f05a-9195-41d6-82e5-a06d9e4543a0 tempest-GroupSnapshotsTest-38718681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b2bc74d7-0c38-4930-a975-8388b7be1d2e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b2bc74d7-0c38-4930-a975-8388b7be1d2e.4c4b35e5-9e2e-4910-9726-ce9b144be8d5 1G" returned: 0 in 0.744s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:52:55 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-05a3f05a-9195-41d6-82e5-a06d9e4543a0 tempest-GroupSnapshotsTest-38718681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2bc74d7-0c38-4930-a975-8388b7be1d2e -F qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b2bc74d7-0c38-4930-a975-8388b7be1d2e.4c4b35e5-9e2e-4910-9726-ce9b144be8d5 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:52:55 devstack sudo[85783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2bc74d7-0c38-4930-a975-8388b7be1d2e -F qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b2bc74d7-0c38-4930-a975-8388b7be1d2e.4c4b35e5-9e2e-4910-9726-ce9b144be8d5 Apr 22 17:52:55 devstack sudo[85783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:52:55 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-a542149c-ece4-49c7-b787-3bcaf04dfde6 tempest-VolumeTypesAccessTest-250921684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:52:55 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-a542149c-ece4-49c7-b787-3bcaf04dfde6 tempest-VolumeTypesAccessTest-250921684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:52:55 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-a542149c-ece4-49c7-b787-3bcaf04dfde6 tempest-VolumeTypesAccessTest-250921684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:52:55 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-a542149c-ece4-49c7-b787-3bcaf04dfde6 tempest-VolumeTypesAccessTest-250921684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:52:55 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-a542149c-ece4-49c7-b787-3bcaf04dfde6 tempest-VolumeTypesAccessTest-250921684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:52:55 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-a542149c-ece4-49c7-b787-3bcaf04dfde6 tempest-VolumeTypesAccessTest-250921684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:52:55 devstack sudo[85785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 Apr 22 17:52:55 devstack sudo[85785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:52:56 devstack sudo[85783]: pam_unix(sudo:session): session closed for user root Apr 22 17:52:56 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-05a3f05a-9195-41d6-82e5-a06d9e4543a0 tempest-GroupSnapshotsTest-38718681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2bc74d7-0c38-4930-a975-8388b7be1d2e -F qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b2bc74d7-0c38-4930-a975-8388b7be1d2e.4c4b35e5-9e2e-4910-9726-ce9b144be8d5" returned: 0 in 0.553s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:52:56 devstack cinder-volume[81771]: WARNING cinder.volume.drivers.remotefs [None req-05a3f05a-9195-41d6-82e5-a06d9e4543a0 tempest-GroupSnapshotsTest-38718681 None] /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b2bc74d7-0c38-4930-a975-8388b7be1d2e.4c4b35e5-9e2e-4910-9726-ce9b144be8d5 is being set with open permissions: ugo+rw: NotImplementedError Apr 22 17:52:56 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-05a3f05a-9195-41d6-82e5-a06d9e4543a0 tempest-GroupSnapshotsTest-38718681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b2bc74d7-0c38-4930-a975-8388b7be1d2e.4c4b35e5-9e2e-4910-9726-ce9b144be8d5 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:52:56 devstack sudo[85785]: pam_unix(sudo:session): session closed for user root Apr 22 17:52:56 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-a542149c-ece4-49c7-b787-3bcaf04dfde6 tempest-VolumeTypesAccessTest-250921684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33" returned: 0 in 0.514s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:52:56 devstack cinder-volume[81771]: DEBUG cinder.manager [None req-a542149c-ece4-49c7-b787-3bcaf04dfde6 tempest-VolumeTypesAccessTest-250921684 None] Notifying Schedulers of capabilities ... {{(pid=81771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 17:52:56 devstack sudo[85791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b2bc74d7-0c38-4930-a975-8388b7be1d2e.4c4b35e5-9e2e-4910-9726-ce9b144be8d5 Apr 22 17:52:56 devstack sudo[85791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:52:56 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-a542149c-ece4-49c7-b787-3bcaf04dfde6 tempest-VolumeTypesAccessTest-250921684 None] Deleted volume successfully. Apr 22 17:52:56 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-a542149c-ece4-49c7-b787-3bcaf04dfde6 tempest-VolumeTypesAccessTest-250921684 None] Lock "cinder-e7f68b8a-2b62-431b-85f3-367d1f57de27-delete_volume" released by "delete_volume" :: held 1.922s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:52:56 devstack sudo[85791]: pam_unix(sudo:session): session closed for user root Apr 22 17:52:56 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-05a3f05a-9195-41d6-82e5-a06d9e4543a0 tempest-GroupSnapshotsTest-38718681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b2bc74d7-0c38-4930-a975-8388b7be1d2e.4c4b35e5-9e2e-4910-9726-ce9b144be8d5" returned: 0 in 0.533s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:52:56 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-05a3f05a-9195-41d6-82e5-a06d9e4543a0 tempest-GroupSnapshotsTest-38718681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b2bc74d7-0c38-4930-a975-8388b7be1d2e.info {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:52:56 devstack sudo[85794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b2bc74d7-0c38-4930-a975-8388b7be1d2e.info Apr 22 17:52:56 devstack sudo[85794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:52:57 devstack sudo[85794]: pam_unix(sudo:session): session closed for user root Apr 22 17:52:57 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-05a3f05a-9195-41d6-82e5-a06d9e4543a0 tempest-GroupSnapshotsTest-38718681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b2bc74d7-0c38-4930-a975-8388b7be1d2e.info" returned: 0 in 0.668s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:52:57 devstack cinder-volume[81771]: WARNING cinder.volume.drivers.remotefs [None req-05a3f05a-9195-41d6-82e5-a06d9e4543a0 tempest-GroupSnapshotsTest-38718681 None] /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b2bc74d7-0c38-4930-a975-8388b7be1d2e.info is being set with open permissions: ugo+rw: NotImplementedError Apr 22 17:52:57 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-05a3f05a-9195-41d6-82e5-a06d9e4543a0 tempest-GroupSnapshotsTest-38718681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b2bc74d7-0c38-4930-a975-8388b7be1d2e.info {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:52:57 devstack sudo[85798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b2bc74d7-0c38-4930-a975-8388b7be1d2e.info Apr 22 17:52:57 devstack sudo[85798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:52:58 devstack sudo[85798]: pam_unix(sudo:session): session closed for user root Apr 22 17:52:58 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-05a3f05a-9195-41d6-82e5-a06d9e4543a0 tempest-GroupSnapshotsTest-38718681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b2bc74d7-0c38-4930-a975-8388b7be1d2e.info" returned: 0 in 0.742s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:52:58 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-05a3f05a-9195-41d6-82e5-a06d9e4543a0 tempest-GroupSnapshotsTest-38718681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.956s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:52:58 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-05a3f05a-9195-41d6-82e5-a06d9e4543a0 tempest-GroupSnapshotsTest-38718681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:52:58 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-05a3f05a-9195-41d6-82e5-a06d9e4543a0 tempest-GroupSnapshotsTest-38718681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:52:58 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-05a3f05a-9195-41d6-82e5-a06d9e4543a0 tempest-GroupSnapshotsTest-38718681 None] Creating offline snapshot 9cac9947-d8fe-4b66-b20d-14d7610180f0 of volume d74685c0-3558-4643-ae25-2c195bbbd356 {{(pid=81771) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 22 17:52:58 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[86924a02-e5ca-42cb-8f49-816450411f55]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:52:58 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-05a3f05a-9195-41d6-82e5-a06d9e4543a0 tempest-GroupSnapshotsTest-38718681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-d74685c0-3558-4643-ae25-2c195bbbd356 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:52:58 devstack sudo[85802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-d74685c0-3558-4643-ae25-2c195bbbd356 Apr 22 17:52:58 devstack sudo[85802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:52:58 devstack sudo[85802]: pam_unix(sudo:session): session closed for user root Apr 22 17:52:58 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-05a3f05a-9195-41d6-82e5-a06d9e4543a0 tempest-GroupSnapshotsTest-38718681 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-d74685c0-3558-4643-ae25-2c195bbbd356" returned: 0 in 0.798s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:52:58 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-05a3f05a-9195-41d6-82e5-a06d9e4543a0 tempest-GroupSnapshotsTest-38718681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-d74685c0-3558-4643-ae25-2c195bbbd356,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-d74685c0-3558-4643-ae25-2c195bbbd356.9cac9947-d8fe-4b66-b20d-14d7610180f0 1G {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:52:58 devstack sudo[85807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-d74685c0-3558-4643-ae25-2c195bbbd356,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-d74685c0-3558-4643-ae25-2c195bbbd356.9cac9947-d8fe-4b66-b20d-14d7610180f0 1G Apr 22 17:52:58 devstack sudo[85807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:52:59 devstack cinder-volume[81771]: DEBUG dbcounter [-] [81771] Writing DB stats cinder:SELECT=110,cinder:INSERT=25,cinder:UPDATE=117,cinder:DELETE=10 {{(pid=81771) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 22 17:52:59 devstack cinder-volume[81771]: DEBUG cinder.volume.flows.manager.create_volume [req-84d22fd2-e1dc-475d-ab6d-9963ba54ad85 req-4bf2c1a9-4705-4dfb-bb38-80a31752b839 tempest-ServerBootFromVolumeStableRescueTest-800024217 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 17:52:59 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [req-84d22fd2-e1dc-475d-ab6d-9963ba54ad85 req-4bf2c1a9-4705-4dfb-bb38-80a31752b839 tempest-ServerBootFromVolumeStableRescueTest-800024217 None] Flow 'volume_create_manager' (dd5def9f-0289-4827-92a4-1579be892182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:52:59 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [req-84d22fd2-e1dc-475d-ab6d-9963ba54ad85 req-4bf2c1a9-4705-4dfb-bb38-80a31752b839 tempest-ServerBootFromVolumeStableRescueTest-800024217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6993d36f-ff1e-4e09-b711-97e96c8d0ec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:52:59 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [req-84d22fd2-e1dc-475d-ab6d-9963ba54ad85 req-4bf2c1a9-4705-4dfb-bb38-80a31752b839 tempest-ServerBootFromVolumeStableRescueTest-800024217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6993d36f-ff1e-4e09-b711-97e96c8d0ec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:52:59Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b65b8307-7292-4108-ba72-331fceb4c3f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60cbe8aa72e44583b8549f74d54325d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:52:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:52:59Z,use_quota=True,user_id='b063426c8b9b41a5a48e0e1035ec179c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:52:59 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [req-84d22fd2-e1dc-475d-ab6d-9963ba54ad85 req-4bf2c1a9-4705-4dfb-bb38-80a31752b839 tempest-ServerBootFromVolumeStableRescueTest-800024217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (387ff120-cc3e-4d05-b867-fbce31033a60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:52:59 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [req-84d22fd2-e1dc-475d-ab6d-9963ba54ad85 req-4bf2c1a9-4705-4dfb-bb38-80a31752b839 tempest-ServerBootFromVolumeStableRescueTest-800024217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (387ff120-cc3e-4d05-b867-fbce31033a60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:52:59 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [req-84d22fd2-e1dc-475d-ab6d-9963ba54ad85 req-4bf2c1a9-4705-4dfb-bb38-80a31752b839 tempest-ServerBootFromVolumeStableRescueTest-800024217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cf9413f-42ff-4e29-96ff-ae3976abbd82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:52:59 devstack cinder-volume[81771]: DEBUG cinder.image.glance [req-84d22fd2-e1dc-475d-ab6d-9963ba54ad85 req-4bf2c1a9-4705-4dfb-bb38-80a31752b839 tempest-ServerBootFromVolumeStableRescueTest-800024217 None] Creating Keystone auth plugin from conf {{(pid=81771) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 22 17:52:59 devstack sudo[85807]: pam_unix(sudo:session): session closed for user root Apr 22 17:52:59 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-05a3f05a-9195-41d6-82e5-a06d9e4543a0 tempest-GroupSnapshotsTest-38718681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-d74685c0-3558-4643-ae25-2c195bbbd356,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-d74685c0-3558-4643-ae25-2c195bbbd356.9cac9947-d8fe-4b66-b20d-14d7610180f0 1G" returned: 0 in 1.031s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:52:59 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-05a3f05a-9195-41d6-82e5-a06d9e4543a0 tempest-GroupSnapshotsTest-38718681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d74685c0-3558-4643-ae25-2c195bbbd356 -F qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-d74685c0-3558-4643-ae25-2c195bbbd356.9cac9947-d8fe-4b66-b20d-14d7610180f0 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:52:59 devstack sudo[85814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d74685c0-3558-4643-ae25-2c195bbbd356 -F qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-d74685c0-3558-4643-ae25-2c195bbbd356.9cac9947-d8fe-4b66-b20d-14d7610180f0 Apr 22 17:52:59 devstack sudo[85814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:53:00 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [req-84d22fd2-e1dc-475d-ab6d-9963ba54ad85 req-4bf2c1a9-4705-4dfb-bb38-80a31752b839 tempest-ServerBootFromVolumeStableRescueTest-800024217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cf9413f-42ff-4e29-96ff-ae3976abbd82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b65b8307-7292-4108-ba72-331fceb4c3f1', 'volume_name': 'volume-b65b8307-7292-4108-ba72-331fceb4c3f1', 'volume_size': 1, 'image_id': '9e076047-8ac8-4bf8-88ea-602aa20d3c9e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9e076047-8ac8-4bf8-88ea-602aa20d3c9e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '39e18fb0fde242f68d38bed6963e8744', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9e076047-8ac8-4bf8-88ea-602aa20d3c9e', 'created_at': datetime.datetime(2026, 4, 22, 15, 44, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 22, 15, 44, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9e076047-8ac8-4bf8-88ea-602aa20d3c9e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:53:00 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [req-84d22fd2-e1dc-475d-ab6d-9963ba54ad85 req-4bf2c1a9-4705-4dfb-bb38-80a31752b839 tempest-ServerBootFromVolumeStableRescueTest-800024217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (faac5637-9701-4f2a-b96b-c493cea78faa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:53:00 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [req-84d22fd2-e1dc-475d-ab6d-9963ba54ad85 req-4bf2c1a9-4705-4dfb-bb38-80a31752b839 tempest-ServerBootFromVolumeStableRescueTest-800024217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (faac5637-9701-4f2a-b96b-c493cea78faa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:53:00 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [req-84d22fd2-e1dc-475d-ab6d-9963ba54ad85 req-4bf2c1a9-4705-4dfb-bb38-80a31752b839 tempest-ServerBootFromVolumeStableRescueTest-800024217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f8c97fd-5291-440a-b73f-00db63fcfafa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:53:00 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [req-84d22fd2-e1dc-475d-ab6d-9963ba54ad85 req-4bf2c1a9-4705-4dfb-bb38-80a31752b839 tempest-ServerBootFromVolumeStableRescueTest-800024217 None] Volume b65b8307-7292-4108-ba72-331fceb4c3f1: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b65b8307-7292-4108-ba72-331fceb4c3f1', 'volume_size': 1, 'image_id': '9e076047-8ac8-4bf8-88ea-602aa20d3c9e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9e076047-8ac8-4bf8-88ea-602aa20d3c9e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '39e18fb0fde242f68d38bed6963e8744', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9e076047-8ac8-4bf8-88ea-602aa20d3c9e', 'created_at': datetime.datetime(2026, 4, 22, 15, 44, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 22, 15, 44, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9e076047-8ac8-4bf8-88ea-602aa20d3c9e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 22 17:53:00 devstack cinder-volume[81771]: DEBUG cinder.volume.flows.manager.create_volume [req-84d22fd2-e1dc-475d-ab6d-9963ba54ad85 req-4bf2c1a9-4705-4dfb-bb38-80a31752b839 tempest-ServerBootFromVolumeStableRescueTest-800024217 None] Trying to clone b65b8307-7292-4108-ba72-331fceb4c3f1 from image 9e076047-8ac8-4bf8-88ea-602aa20d3c9e at location (None, [{'url': 'file:///opt/stack/data/glance/images/9e076047-8ac8-4bf8-88ea-602aa20d3c9e', 'metadata': {}}]). {{(pid=81771) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 22 17:53:00 devstack sudo[85814]: pam_unix(sudo:session): session closed for user root Apr 22 17:53:00 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-05a3f05a-9195-41d6-82e5-a06d9e4543a0 tempest-GroupSnapshotsTest-38718681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d74685c0-3558-4643-ae25-2c195bbbd356 -F qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-d74685c0-3558-4643-ae25-2c195bbbd356.9cac9947-d8fe-4b66-b20d-14d7610180f0" returned: 0 in 0.777s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:53:00 devstack cinder-volume[81771]: WARNING cinder.volume.drivers.remotefs [None req-05a3f05a-9195-41d6-82e5-a06d9e4543a0 tempest-GroupSnapshotsTest-38718681 None] /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-d74685c0-3558-4643-ae25-2c195bbbd356.9cac9947-d8fe-4b66-b20d-14d7610180f0 is being set with open permissions: ugo+rw: NotImplementedError Apr 22 17:53:00 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-05a3f05a-9195-41d6-82e5-a06d9e4543a0 tempest-GroupSnapshotsTest-38718681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-d74685c0-3558-4643-ae25-2c195bbbd356.9cac9947-d8fe-4b66-b20d-14d7610180f0 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:53:00 devstack sudo[85820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-d74685c0-3558-4643-ae25-2c195bbbd356.9cac9947-d8fe-4b66-b20d-14d7610180f0 Apr 22 17:53:00 devstack sudo[85820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:53:01 devstack cinder-volume[81771]: DEBUG cinder.image.image_utils [req-84d22fd2-e1dc-475d-ab6d-9963ba54ad85 req-4bf2c1a9-4705-4dfb-bb38-80a31752b839 tempest-ServerBootFromVolumeStableRescueTest-800024217 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9e076047-8ac8-4bf8-88ea-602aa20d3c9e_pqa2wb3wdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=81771) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 22 17:53:01 devstack cinder-volume[81771]: INFO cinder.image.image_utils [req-84d22fd2-e1dc-475d-ab6d-9963ba54ad85 req-4bf2c1a9-4705-4dfb-bb38-80a31752b839 tempest-ServerBootFromVolumeStableRescueTest-800024217 None] Image download 20.69 MB at 20.69 MB/s Apr 22 17:53:01 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f97bc0a-dd24-46e4-a386-c5c0cdbb2504]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:53:01 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [req-84d22fd2-e1dc-475d-ab6d-9963ba54ad85 req-4bf2c1a9-4705-4dfb-bb38-80a31752b839 tempest-ServerBootFromVolumeStableRescueTest-800024217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9e076047-8ac8-4bf8-88ea-602aa20d3c9e_pqa2wb3wdevstack@QuobyteHD {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:53:01 devstack sudo[85844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9e076047-8ac8-4bf8-88ea-602aa20d3c9e_pqa2wb3wdevstack@QuobyteHD Apr 22 17:53:01 devstack sudo[85844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:53:01 devstack sudo[85820]: pam_unix(sudo:session): session closed for user root Apr 22 17:53:01 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-05a3f05a-9195-41d6-82e5-a06d9e4543a0 tempest-GroupSnapshotsTest-38718681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-d74685c0-3558-4643-ae25-2c195bbbd356.9cac9947-d8fe-4b66-b20d-14d7610180f0" returned: 0 in 0.774s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:53:01 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-05a3f05a-9195-41d6-82e5-a06d9e4543a0 tempest-GroupSnapshotsTest-38718681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-d74685c0-3558-4643-ae25-2c195bbbd356.info {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:53:01 devstack sudo[85846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-d74685c0-3558-4643-ae25-2c195bbbd356.info Apr 22 17:53:01 devstack sudo[85846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:53:01 devstack sudo[85844]: pam_unix(sudo:session): session closed for user root Apr 22 17:53:01 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [req-84d22fd2-e1dc-475d-ab6d-9963ba54ad85 req-4bf2c1a9-4705-4dfb-bb38-80a31752b839 tempest-ServerBootFromVolumeStableRescueTest-800024217 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9e076047-8ac8-4bf8-88ea-602aa20d3c9e_pqa2wb3wdevstack@QuobyteHD" returned: 0 in 0.665s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:53:01 devstack cinder-volume[81771]: DEBUG cinder.image.image_utils [req-84d22fd2-e1dc-475d-ab6d-9963ba54ad85 req-4bf2c1a9-4705-4dfb-bb38-80a31752b839 tempest-ServerBootFromVolumeStableRescueTest-800024217 None] Temporary image 9e076047-8ac8-4bf8-88ea-602aa20d3c9e is fetched for user b063426c8b9b41a5a48e0e1035ec179c. {{(pid=81771) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 22 17:53:02 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[422a92da-a4eb-47f2-b191-1b20639acb46]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:53:02 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [req-84d22fd2-e1dc-475d-ab6d-9963ba54ad85 req-4bf2c1a9-4705-4dfb-bb38-80a31752b839 tempest-ServerBootFromVolumeStableRescueTest-800024217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9e076047-8ac8-4bf8-88ea-602aa20d3c9e_pqa2wb3wdevstack@QuobyteHD {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:53:02 devstack sudo[85853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9e076047-8ac8-4bf8-88ea-602aa20d3c9e_pqa2wb3wdevstack@QuobyteHD Apr 22 17:53:02 devstack sudo[85853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:53:02 devstack sudo[85846]: pam_unix(sudo:session): session closed for user root Apr 22 17:53:02 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-05a3f05a-9195-41d6-82e5-a06d9e4543a0 tempest-GroupSnapshotsTest-38718681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-d74685c0-3558-4643-ae25-2c195bbbd356.info" returned: 0 in 0.693s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:53:02 devstack cinder-volume[81771]: WARNING cinder.volume.drivers.remotefs [None req-05a3f05a-9195-41d6-82e5-a06d9e4543a0 tempest-GroupSnapshotsTest-38718681 None] /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-d74685c0-3558-4643-ae25-2c195bbbd356.info is being set with open permissions: ugo+rw: NotImplementedError Apr 22 17:53:02 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-05a3f05a-9195-41d6-82e5-a06d9e4543a0 tempest-GroupSnapshotsTest-38718681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-d74685c0-3558-4643-ae25-2c195bbbd356.info {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:53:02 devstack sudo[85855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-d74685c0-3558-4643-ae25-2c195bbbd356.info Apr 22 17:53:02 devstack sudo[85855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:53:02 devstack sudo[85853]: pam_unix(sudo:session): session closed for user root Apr 22 17:53:02 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [req-84d22fd2-e1dc-475d-ab6d-9963ba54ad85 req-4bf2c1a9-4705-4dfb-bb38-80a31752b839 tempest-ServerBootFromVolumeStableRescueTest-800024217 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9e076047-8ac8-4bf8-88ea-602aa20d3c9e_pqa2wb3wdevstack@QuobyteHD" returned: 0 in 0.663s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:53:02 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [req-84d22fd2-e1dc-475d-ab6d-9963ba54ad85 req-4bf2c1a9-4705-4dfb-bb38-80a31752b839 tempest-ServerBootFromVolumeStableRescueTest-800024217 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:53:02 devstack sudo[85855]: pam_unix(sudo:session): session closed for user root Apr 22 17:53:02 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-05a3f05a-9195-41d6-82e5-a06d9e4543a0 tempest-GroupSnapshotsTest-38718681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-d74685c0-3558-4643-ae25-2c195bbbd356.info" returned: 0 in 0.679s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:53:02 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-05a3f05a-9195-41d6-82e5-a06d9e4543a0 tempest-GroupSnapshotsTest-38718681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.875s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:53:02 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [req-84d22fd2-e1dc-475d-ab6d-9963ba54ad85 req-4bf2c1a9-4705-4dfb-bb38-80a31752b839 tempest-ServerBootFromVolumeStableRescueTest-800024217 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.204s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:53:02 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [req-84d22fd2-e1dc-475d-ab6d-9963ba54ad85 req-4bf2c1a9-4705-4dfb-bb38-80a31752b839 tempest-ServerBootFromVolumeStableRescueTest-800024217 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:52:59Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b65b8307-7292-4108-ba72-331fceb4c3f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60cbe8aa72e44583b8549f74d54325d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:52:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:52:59Z,use_quota=True,user_id='b063426c8b9b41a5a48e0e1035ec179c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)}" {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 17:53:02 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [req-84d22fd2-e1dc-475d-ab6d-9963ba54ad85 req-4bf2c1a9-4705-4dfb-bb38-80a31752b839 tempest-ServerBootFromVolumeStableRescueTest-800024217 None] Creating volume b65b8307-7292-4108-ba72-331fceb4c3f1 {{(pid=81771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 17:53:02 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [req-84d22fd2-e1dc-475d-ab6d-9963ba54ad85 req-4bf2c1a9-4705-4dfb-bb38-80a31752b839 tempest-ServerBootFromVolumeStableRescueTest-800024217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:53:02 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [req-84d22fd2-e1dc-475d-ab6d-9963ba54ad85 req-4bf2c1a9-4705-4dfb-bb38-80a31752b839 tempest-ServerBootFromVolumeStableRescueTest-800024217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:53:02 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [req-84d22fd2-e1dc-475d-ab6d-9963ba54ad85 req-4bf2c1a9-4705-4dfb-bb38-80a31752b839 tempest-ServerBootFromVolumeStableRescueTest-800024217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:53:02 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [req-84d22fd2-e1dc-475d-ab6d-9963ba54ad85 req-4bf2c1a9-4705-4dfb-bb38-80a31752b839 tempest-ServerBootFromVolumeStableRescueTest-800024217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:53:02 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [req-84d22fd2-e1dc-475d-ab6d-9963ba54ad85 req-4bf2c1a9-4705-4dfb-bb38-80a31752b839 tempest-ServerBootFromVolumeStableRescueTest-800024217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:53:02 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [req-84d22fd2-e1dc-475d-ab6d-9963ba54ad85 req-4bf2c1a9-4705-4dfb-bb38-80a31752b839 tempest-ServerBootFromVolumeStableRescueTest-800024217 None] Selected osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 as target Quobyte volume. {{(pid=81771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 17:53:02 devstack cinder-volume[81771]: INFO cinder.volume.drivers.remotefs [req-84d22fd2-e1dc-475d-ab6d-9963ba54ad85 req-4bf2c1a9-4705-4dfb-bb38-80a31752b839 tempest-ServerBootFromVolumeStableRescueTest-800024217 None] casted to osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 Apr 22 17:53:02 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [req-84d22fd2-e1dc-475d-ab6d-9963ba54ad85 req-4bf2c1a9-4705-4dfb-bb38-80a31752b839 tempest-ServerBootFromVolumeStableRescueTest-800024217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b65b8307-7292-4108-ba72-331fceb4c3f1 1073741824 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:53:02 devstack sudo[85861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b65b8307-7292-4108-ba72-331fceb4c3f1 1073741824 Apr 22 17:53:02 devstack sudo[85861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:53:03 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-05a3f05a-9195-41d6-82e5-a06d9e4543a0 tempest-GroupSnapshotsTest-38718681 None] group_snapshot 7590b550-7eb1-43d4-8f19-9294e973478e: created successfully Apr 22 17:53:03 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-acfac840-1076-44db-8ef4-67f7e82b7284 tempest-GroupSnapshotsTest-38718681 None] group_snapshot 7590b550-7eb1-43d4-8f19-9294e973478e: deleting Apr 22 17:53:04 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-acfac840-1076-44db-8ef4-67f7e82b7284 tempest-GroupSnapshotsTest-38718681 None] group_snapshot 7590b550-7eb1-43d4-8f19-9294e973478e: deleting {{(pid=81771) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 22 17:53:04 devstack sudo[85861]: pam_unix(sudo:session): session closed for user root Apr 22 17:53:04 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-acfac840-1076-44db-8ef4-67f7e82b7284 tempest-GroupSnapshotsTest-38718681 None] Acquiring lock "cinder-quobyte-b2bc74d7-0c38-4930-a975-8388b7be1d2e" by "delete_snapshot" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:53:04 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [req-84d22fd2-e1dc-475d-ab6d-9963ba54ad85 req-4bf2c1a9-4705-4dfb-bb38-80a31752b839 tempest-ServerBootFromVolumeStableRescueTest-800024217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b65b8307-7292-4108-ba72-331fceb4c3f1 1073741824" returned: 0 in 1.133s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:53:04 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-acfac840-1076-44db-8ef4-67f7e82b7284 tempest-GroupSnapshotsTest-38718681 None] Lock "cinder-quobyte-b2bc74d7-0c38-4930-a975-8388b7be1d2e" acquired by "delete_snapshot" :: waited 0.036s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:53:04 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-acfac840-1076-44db-8ef4-67f7e82b7284 tempest-GroupSnapshotsTest-38718681 None] Acquiring lock "cinder-quobyte-4c4b35e5-9e2e-4910-9726-ce9b144be8d5" by "_delete_snapshot" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:53:04 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-acfac840-1076-44db-8ef4-67f7e82b7284 tempest-GroupSnapshotsTest-38718681 None] Lock "cinder-quobyte-4c4b35e5-9e2e-4910-9726-ce9b144be8d5" acquired by "_delete_snapshot" :: waited 0.051s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:53:04 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-acfac840-1076-44db-8ef4-67f7e82b7284 tempest-GroupSnapshotsTest-38718681 None] Deleting offline snapshot 4c4b35e5-9e2e-4910-9726-ce9b144be8d5 of volume b2bc74d7-0c38-4930-a975-8388b7be1d2e {{(pid=81771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 22 17:53:04 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-acfac840-1076-44db-8ef4-67f7e82b7284 tempest-GroupSnapshotsTest-38718681 None] snapshot_file for this snap is: volume-b2bc74d7-0c38-4930-a975-8388b7be1d2e.4c4b35e5-9e2e-4910-9726-ce9b144be8d5 {{(pid=81771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 22 17:53:04 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [req-84d22fd2-e1dc-475d-ab6d-9963ba54ad85 req-4bf2c1a9-4705-4dfb-bb38-80a31752b839 tempest-ServerBootFromVolumeStableRescueTest-800024217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b65b8307-7292-4108-ba72-331fceb4c3f1 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:53:04 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff1626c6-5336-4b2b-82ba-55385b6732b5]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:53:04 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-acfac840-1076-44db-8ef4-67f7e82b7284 tempest-GroupSnapshotsTest-38718681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b2bc74d7-0c38-4930-a975-8388b7be1d2e.4c4b35e5-9e2e-4910-9726-ce9b144be8d5 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:53:04 devstack sudo[85866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b65b8307-7292-4108-ba72-331fceb4c3f1 Apr 22 17:53:04 devstack sudo[85866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:53:04 devstack sudo[85867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b2bc74d7-0c38-4930-a975-8388b7be1d2e.4c4b35e5-9e2e-4910-9726-ce9b144be8d5 Apr 22 17:53:04 devstack sudo[85867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:53:04 devstack cinder-volume[81771]: DEBUG cinder.volume.flows.manager.create_volume [None req-3eede415-c8f2-4c4b-b565-994179cf408b tempest-SnapshotMetadataTestJSON-177948815 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 17:53:04 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-3eede415-c8f2-4c4b-b565-994179cf408b tempest-SnapshotMetadataTestJSON-177948815 None] Flow 'volume_create_manager' (e4a5675c-ab32-49fd-989d-2bbff7816570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:53:04 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-3eede415-c8f2-4c4b-b565-994179cf408b tempest-SnapshotMetadataTestJSON-177948815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe3e8860-c82d-42c1-83db-31f0eb675044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:53:04 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-3eede415-c8f2-4c4b-b565-994179cf408b tempest-SnapshotMetadataTestJSON-177948815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe3e8860-c82d-42c1-83db-31f0eb675044) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:53:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1336797099',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee0221eb-4481-4b96-850f-4ae995b44377,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4d4a6bb0db64396b60da4b7173c8b7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:53:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:53:05Z,use_quota=True,user_id='736da2bd60c141ae8cc610e27dabfbdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:53:04 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-3eede415-c8f2-4c4b-b565-994179cf408b tempest-SnapshotMetadataTestJSON-177948815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d940a5f-8c17-4017-98c2-29cfc0e6b094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:53:04 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-3eede415-c8f2-4c4b-b565-994179cf408b tempest-SnapshotMetadataTestJSON-177948815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d940a5f-8c17-4017-98c2-29cfc0e6b094) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:53:04 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-3eede415-c8f2-4c4b-b565-994179cf408b tempest-SnapshotMetadataTestJSON-177948815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b303bdf0-4db4-4b48-bb20-3071171cad85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:53:04 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-3eede415-c8f2-4c4b-b565-994179cf408b tempest-SnapshotMetadataTestJSON-177948815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b303bdf0-4db4-4b48-bb20-3071171cad85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee0221eb-4481-4b96-850f-4ae995b44377', 'volume_name': 'volume-ee0221eb-4481-4b96-850f-4ae995b44377', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:53:04 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-3eede415-c8f2-4c4b-b565-994179cf408b tempest-SnapshotMetadataTestJSON-177948815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1fbee05-1f7e-4830-be2d-e5b88cbee3aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:53:04 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-3eede415-c8f2-4c4b-b565-994179cf408b tempest-SnapshotMetadataTestJSON-177948815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1fbee05-1f7e-4830-be2d-e5b88cbee3aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:53:04 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-3eede415-c8f2-4c4b-b565-994179cf408b tempest-SnapshotMetadataTestJSON-177948815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04f83174-9ca6-4eae-ac07-820d5faf7ee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:53:04 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-3eede415-c8f2-4c4b-b565-994179cf408b tempest-SnapshotMetadataTestJSON-177948815 None] Volume ee0221eb-4481-4b96-850f-4ae995b44377: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee0221eb-4481-4b96-850f-4ae995b44377', 'volume_size': 1} Apr 22 17:53:04 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-3eede415-c8f2-4c4b-b565-994179cf408b tempest-SnapshotMetadataTestJSON-177948815 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:53:04 devstack sudo[85866]: pam_unix(sudo:session): session closed for user root Apr 22 17:53:04 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [req-84d22fd2-e1dc-475d-ab6d-9963ba54ad85 req-4bf2c1a9-4705-4dfb-bb38-80a31752b839 tempest-ServerBootFromVolumeStableRescueTest-800024217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b65b8307-7292-4108-ba72-331fceb4c3f1" returned: 0 in 0.649s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:53:04 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [req-84d22fd2-e1dc-475d-ab6d-9963ba54ad85 req-4bf2c1a9-4705-4dfb-bb38-80a31752b839 tempest-ServerBootFromVolumeStableRescueTest-800024217 None] <== create_volume: return (1928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'} {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 17:53:04 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [req-84d22fd2-e1dc-475d-ab6d-9963ba54ad85 req-4bf2c1a9-4705-4dfb-bb38-80a31752b839 tempest-ServerBootFromVolumeStableRescueTest-800024217 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.932s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:53:04 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-3eede415-c8f2-4c4b-b565-994179cf408b tempest-SnapshotMetadataTestJSON-177948815 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.069s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:53:04 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-3eede415-c8f2-4c4b-b565-994179cf408b tempest-SnapshotMetadataTestJSON-177948815 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:53:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1336797099',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee0221eb-4481-4b96-850f-4ae995b44377,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4d4a6bb0db64396b60da4b7173c8b7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:53:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:53:05Z,use_quota=True,user_id='736da2bd60c141ae8cc610e27dabfbdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)}" {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 17:53:04 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-3eede415-c8f2-4c4b-b565-994179cf408b tempest-SnapshotMetadataTestJSON-177948815 None] Creating volume ee0221eb-4481-4b96-850f-4ae995b44377 {{(pid=81771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 17:53:04 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-3eede415-c8f2-4c4b-b565-994179cf408b tempest-SnapshotMetadataTestJSON-177948815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:53:04 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-3eede415-c8f2-4c4b-b565-994179cf408b tempest-SnapshotMetadataTestJSON-177948815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:53:04 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-3eede415-c8f2-4c4b-b565-994179cf408b tempest-SnapshotMetadataTestJSON-177948815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:53:04 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-3eede415-c8f2-4c4b-b565-994179cf408b tempest-SnapshotMetadataTestJSON-177948815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:53:04 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-3eede415-c8f2-4c4b-b565-994179cf408b tempest-SnapshotMetadataTestJSON-177948815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:53:04 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-3eede415-c8f2-4c4b-b565-994179cf408b tempest-SnapshotMetadataTestJSON-177948815 None] Selected osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 as target Quobyte volume. {{(pid=81771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 17:53:04 devstack cinder-volume[81771]: INFO cinder.volume.drivers.remotefs [None req-3eede415-c8f2-4c4b-b565-994179cf408b tempest-SnapshotMetadataTestJSON-177948815 None] casted to osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 Apr 22 17:53:04 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-3eede415-c8f2-4c4b-b565-994179cf408b tempest-SnapshotMetadataTestJSON-177948815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-ee0221eb-4481-4b96-850f-4ae995b44377 1073741824 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:53:04 devstack cinder-volume[81771]: DEBUG cinder.volume.volume_utils [req-84d22fd2-e1dc-475d-ab6d-9963ba54ad85 req-4bf2c1a9-4705-4dfb-bb38-80a31752b839 tempest-ServerBootFromVolumeStableRescueTest-800024217 None] Attempting download of 9e076047-8ac8-4bf8-88ea-602aa20d3c9e ((None, [{'url': 'file:///opt/stack/data/glance/images/9e076047-8ac8-4bf8-88ea-602aa20d3c9e', 'metadata': {}}])) to volume b65b8307-7292-4108-ba72-331fceb4c3f1. {{(pid=81771) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 22 17:53:04 devstack sudo[85872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-ee0221eb-4481-4b96-850f-4ae995b44377 1073741824 Apr 22 17:53:04 devstack sudo[85872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:53:04 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[457b9fd0-8076-41c7-9040-87f7d67e09e4]: (4, 'raw') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:53:04 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [req-84d22fd2-e1dc-475d-ab6d-9963ba54ad85 req-4bf2c1a9-4705-4dfb-bb38-80a31752b839 tempest-ServerBootFromVolumeStableRescueTest-800024217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9e076047-8ac8-4bf8-88ea-602aa20d3c9e_ktpy711a {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:53:05 devstack sudo[85877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9e076047-8ac8-4bf8-88ea-602aa20d3c9e_ktpy711a Apr 22 17:53:05 devstack sudo[85877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:53:05 devstack sudo[85867]: pam_unix(sudo:session): session closed for user root Apr 22 17:53:05 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-acfac840-1076-44db-8ef4-67f7e82b7284 tempest-GroupSnapshotsTest-38718681 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b2bc74d7-0c38-4930-a975-8388b7be1d2e.4c4b35e5-9e2e-4910-9726-ce9b144be8d5" returned: 0 in 0.866s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:53:05 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-acfac840-1076-44db-8ef4-67f7e82b7284 tempest-GroupSnapshotsTest-38718681 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b2bc74d7-0c38-4930-a975-8388b7be1d2e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81771) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 22 17:53:05 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf9dec4f-fc01-4793-8eb2-a4fa3a3cefb3]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:53:05 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-acfac840-1076-44db-8ef4-67f7e82b7284 tempest-GroupSnapshotsTest-38718681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b2bc74d7-0c38-4930-a975-8388b7be1d2e {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:53:05 devstack sudo[85879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b2bc74d7-0c38-4930-a975-8388b7be1d2e Apr 22 17:53:05 devstack sudo[85879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:53:05 devstack sudo[85872]: pam_unix(sudo:session): session closed for user root Apr 22 17:53:05 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-3eede415-c8f2-4c4b-b565-994179cf408b tempest-SnapshotMetadataTestJSON-177948815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-ee0221eb-4481-4b96-850f-4ae995b44377 1073741824" returned: 0 in 0.796s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:53:05 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-3eede415-c8f2-4c4b-b565-994179cf408b tempest-SnapshotMetadataTestJSON-177948815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-ee0221eb-4481-4b96-850f-4ae995b44377 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:53:05 devstack sudo[85889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-ee0221eb-4481-4b96-850f-4ae995b44377 Apr 22 17:53:05 devstack sudo[85889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:53:05 devstack sudo[85877]: pam_unix(sudo:session): session closed for user root Apr 22 17:53:05 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [req-84d22fd2-e1dc-475d-ab6d-9963ba54ad85 req-4bf2c1a9-4705-4dfb-bb38-80a31752b839 tempest-ServerBootFromVolumeStableRescueTest-800024217 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9e076047-8ac8-4bf8-88ea-602aa20d3c9e_ktpy711a" returned: 0 in 0.777s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:53:05 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [req-84d22fd2-e1dc-475d-ab6d-9963ba54ad85 req-4bf2c1a9-4705-4dfb-bb38-80a31752b839 tempest-ServerBootFromVolumeStableRescueTest-800024217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9e076047-8ac8-4bf8-88ea-602aa20d3c9e_ktpy711a {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:53:05 devstack sudo[85879]: pam_unix(sudo:session): session closed for user root Apr 22 17:53:05 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-acfac840-1076-44db-8ef4-67f7e82b7284 tempest-GroupSnapshotsTest-38718681 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b2bc74d7-0c38-4930-a975-8388b7be1d2e" returned: 0 in 0.703s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:53:05 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-acfac840-1076-44db-8ef4-67f7e82b7284 tempest-GroupSnapshotsTest-38718681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b2bc74d7-0c38-4930-a975-8388b7be1d2e.4c4b35e5-9e2e-4910-9726-ce9b144be8d5 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:53:05 devstack sudo[85892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b2bc74d7-0c38-4930-a975-8388b7be1d2e.4c4b35e5-9e2e-4910-9726-ce9b144be8d5 Apr 22 17:53:05 devstack sudo[85892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:53:05 devstack sudo[85891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9e076047-8ac8-4bf8-88ea-602aa20d3c9e_ktpy711a Apr 22 17:53:05 devstack sudo[85891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:53:06 devstack sudo[85891]: pam_unix(sudo:session): session closed for user root Apr 22 17:53:06 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [req-84d22fd2-e1dc-475d-ab6d-9963ba54ad85 req-4bf2c1a9-4705-4dfb-bb38-80a31752b839 tempest-ServerBootFromVolumeStableRescueTest-800024217 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9e076047-8ac8-4bf8-88ea-602aa20d3c9e_ktpy711a" returned: 1 in 0.556s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:53:06 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [req-84d22fd2-e1dc-475d-ab6d-9963ba54ad85 req-4bf2c1a9-4705-4dfb-bb38-80a31752b839 tempest-ServerBootFromVolumeStableRescueTest-800024217 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9e076047-8ac8-4bf8-88ea-602aa20d3c9e_ktpy711a' failed. Not Retrying. {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 22 17:53:06 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff7de93d-d4d9-49b9-9779-acd59c7f367c]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:53:06 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [req-84d22fd2-e1dc-475d-ab6d-9963ba54ad85 req-4bf2c1a9-4705-4dfb-bb38-80a31752b839 tempest-ServerBootFromVolumeStableRescueTest-800024217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9e076047-8ac8-4bf8-88ea-602aa20d3c9e_pqa2wb3wdevstack@QuobyteHD {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:53:06 devstack sudo[85889]: pam_unix(sudo:session): session closed for user root Apr 22 17:53:06 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-3eede415-c8f2-4c4b-b565-994179cf408b tempest-SnapshotMetadataTestJSON-177948815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-ee0221eb-4481-4b96-850f-4ae995b44377" returned: 0 in 0.651s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:53:06 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-3eede415-c8f2-4c4b-b565-994179cf408b tempest-SnapshotMetadataTestJSON-177948815 None] <== create_volume: return (1498ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'} {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 17:53:06 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-3eede415-c8f2-4c4b-b565-994179cf408b tempest-SnapshotMetadataTestJSON-177948815 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.504s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:53:06 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-3eede415-c8f2-4c4b-b565-994179cf408b tempest-SnapshotMetadataTestJSON-177948815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04f83174-9ca6-4eae-ac07-820d5faf7ee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee0221eb-4481-4b96-850f-4ae995b44377', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:53:06 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-3eede415-c8f2-4c4b-b565-994179cf408b tempest-SnapshotMetadataTestJSON-177948815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab8b4d7b-4a06-475d-ac87-8ace069be756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:53:06 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-3eede415-c8f2-4c4b-b565-994179cf408b tempest-SnapshotMetadataTestJSON-177948815 None] Volume volume-ee0221eb-4481-4b96-850f-4ae995b44377 (ee0221eb-4481-4b96-850f-4ae995b44377): created successfully Apr 22 17:53:06 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-3eede415-c8f2-4c4b-b565-994179cf408b tempest-SnapshotMetadataTestJSON-177948815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab8b4d7b-4a06-475d-ac87-8ace069be756) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:53:06 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-3eede415-c8f2-4c4b-b565-994179cf408b tempest-SnapshotMetadataTestJSON-177948815 None] Flow 'volume_create_manager' (e4a5675c-ab32-49fd-989d-2bbff7816570) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:53:06 devstack sudo[85901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9e076047-8ac8-4bf8-88ea-602aa20d3c9e_pqa2wb3wdevstack@QuobyteHD Apr 22 17:53:06 devstack sudo[85901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:53:06 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-3eede415-c8f2-4c4b-b565-994179cf408b tempest-SnapshotMetadataTestJSON-177948815 None] Created volume successfully. Apr 22 17:53:06 devstack sudo[85892]: pam_unix(sudo:session): session closed for user root Apr 22 17:53:06 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-acfac840-1076-44db-8ef4-67f7e82b7284 tempest-GroupSnapshotsTest-38718681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b2bc74d7-0c38-4930-a975-8388b7be1d2e.4c4b35e5-9e2e-4910-9726-ce9b144be8d5" returned: 0 in 0.638s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:53:06 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-acfac840-1076-44db-8ef4-67f7e82b7284 tempest-GroupSnapshotsTest-38718681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b2bc74d7-0c38-4930-a975-8388b7be1d2e.4c4b35e5-9e2e-4910-9726-ce9b144be8d5 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:53:06 devstack sudo[85903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b2bc74d7-0c38-4930-a975-8388b7be1d2e.4c4b35e5-9e2e-4910-9726-ce9b144be8d5 Apr 22 17:53:06 devstack sudo[85903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:53:06 devstack sudo[85901]: pam_unix(sudo:session): session closed for user root Apr 22 17:53:06 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [req-84d22fd2-e1dc-475d-ab6d-9963ba54ad85 req-4bf2c1a9-4705-4dfb-bb38-80a31752b839 tempest-ServerBootFromVolumeStableRescueTest-800024217 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9e076047-8ac8-4bf8-88ea-602aa20d3c9e_pqa2wb3wdevstack@QuobyteHD" returned: 0 in 0.647s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:53:06 devstack cinder-volume[81771]: DEBUG cinder.image.image_utils [req-84d22fd2-e1dc-475d-ab6d-9963ba54ad85 req-4bf2c1a9-4705-4dfb-bb38-80a31752b839 tempest-ServerBootFromVolumeStableRescueTest-800024217 None] 9e076047-8ac8-4bf8-88ea-602aa20d3c9e was qcow2, converting to raw {{(pid=81771) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 22 17:53:06 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [req-84d22fd2-e1dc-475d-ab6d-9963ba54ad85 req-4bf2c1a9-4705-4dfb-bb38-80a31752b839 tempest-ServerBootFromVolumeStableRescueTest-800024217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9e076047-8ac8-4bf8-88ea-602aa20d3c9e_pqa2wb3wdevstack@QuobyteHD /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b65b8307-7292-4108-ba72-331fceb4c3f1 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:53:06 devstack sudo[85910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9e076047-8ac8-4bf8-88ea-602aa20d3c9e_pqa2wb3wdevstack@QuobyteHD /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b65b8307-7292-4108-ba72-331fceb4c3f1 Apr 22 17:53:06 devstack sudo[85910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:53:07 devstack sudo[85903]: pam_unix(sudo:session): session closed for user root Apr 22 17:53:07 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-acfac840-1076-44db-8ef4-67f7e82b7284 tempest-GroupSnapshotsTest-38718681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b2bc74d7-0c38-4930-a975-8388b7be1d2e.4c4b35e5-9e2e-4910-9726-ce9b144be8d5" returned: 0 in 0.612s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:53:07 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-acfac840-1076-44db-8ef4-67f7e82b7284 tempest-GroupSnapshotsTest-38718681 None] Lock "cinder-quobyte-4c4b35e5-9e2e-4910-9726-ce9b144be8d5" released by "_delete_snapshot" :: held 2.965s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:53:07 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-acfac840-1076-44db-8ef4-67f7e82b7284 tempest-GroupSnapshotsTest-38718681 None] Lock "cinder-quobyte-b2bc74d7-0c38-4930-a975-8388b7be1d2e" released by "delete_snapshot" :: held 3.031s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:53:07 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-acfac840-1076-44db-8ef4-67f7e82b7284 tempest-GroupSnapshotsTest-38718681 None] Acquiring lock "cinder-quobyte-d74685c0-3558-4643-ae25-2c195bbbd356" by "delete_snapshot" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:53:07 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-169cb46c-742e-4f6c-bf22-5ad119918a40 tempest-SnapshotMetadataTestJSON-177948815 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:53:07 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-169cb46c-742e-4f6c-bf22-5ad119918a40 tempest-SnapshotMetadataTestJSON-177948815 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:53:07 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-169cb46c-742e-4f6c-bf22-5ad119918a40 tempest-SnapshotMetadataTestJSON-177948815 None] Creating offline snapshot 48d942b1-1067-4a06-830f-54172c0d6477 of volume ee0221eb-4481-4b96-850f-4ae995b44377 {{(pid=81771) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 22 17:53:07 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-acfac840-1076-44db-8ef4-67f7e82b7284 tempest-GroupSnapshotsTest-38718681 None] Lock "cinder-quobyte-d74685c0-3558-4643-ae25-2c195bbbd356" acquired by "delete_snapshot" :: waited 0.042s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:53:07 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-acfac840-1076-44db-8ef4-67f7e82b7284 tempest-GroupSnapshotsTest-38718681 None] Acquiring lock "cinder-quobyte-9cac9947-d8fe-4b66-b20d-14d7610180f0" by "_delete_snapshot" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:53:07 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b0a82c1-2adc-4550-ba0b-c7b07466fa4a]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:53:07 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-169cb46c-742e-4f6c-bf22-5ad119918a40 tempest-SnapshotMetadataTestJSON-177948815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-ee0221eb-4481-4b96-850f-4ae995b44377 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:53:07 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-acfac840-1076-44db-8ef4-67f7e82b7284 tempest-GroupSnapshotsTest-38718681 None] Lock "cinder-quobyte-9cac9947-d8fe-4b66-b20d-14d7610180f0" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:53:07 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-acfac840-1076-44db-8ef4-67f7e82b7284 tempest-GroupSnapshotsTest-38718681 None] Deleting offline snapshot 9cac9947-d8fe-4b66-b20d-14d7610180f0 of volume d74685c0-3558-4643-ae25-2c195bbbd356 {{(pid=81771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 22 17:53:07 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-acfac840-1076-44db-8ef4-67f7e82b7284 tempest-GroupSnapshotsTest-38718681 None] snapshot_file for this snap is: volume-d74685c0-3558-4643-ae25-2c195bbbd356.9cac9947-d8fe-4b66-b20d-14d7610180f0 {{(pid=81771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 22 17:53:07 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd510f48-d522-4770-8539-5ae21d5d6861]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:53:07 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-acfac840-1076-44db-8ef4-67f7e82b7284 tempest-GroupSnapshotsTest-38718681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-d74685c0-3558-4643-ae25-2c195bbbd356.9cac9947-d8fe-4b66-b20d-14d7610180f0 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:53:07 devstack sudo[85912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-ee0221eb-4481-4b96-850f-4ae995b44377 Apr 22 17:53:07 devstack sudo[85912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:53:07 devstack sudo[85913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-d74685c0-3558-4643-ae25-2c195bbbd356.9cac9947-d8fe-4b66-b20d-14d7610180f0 Apr 22 17:53:07 devstack sudo[85913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:53:07 devstack sudo[85912]: pam_unix(sudo:session): session closed for user root Apr 22 17:53:07 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-169cb46c-742e-4f6c-bf22-5ad119918a40 tempest-SnapshotMetadataTestJSON-177948815 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-ee0221eb-4481-4b96-850f-4ae995b44377" returned: 0 in 0.715s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:53:07 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-169cb46c-742e-4f6c-bf22-5ad119918a40 tempest-SnapshotMetadataTestJSON-177948815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-ee0221eb-4481-4b96-850f-4ae995b44377,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-ee0221eb-4481-4b96-850f-4ae995b44377.48d942b1-1067-4a06-830f-54172c0d6477 1G {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:53:07 devstack sudo[85913]: pam_unix(sudo:session): session closed for user root Apr 22 17:53:07 devstack sudo[85927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-ee0221eb-4481-4b96-850f-4ae995b44377,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-ee0221eb-4481-4b96-850f-4ae995b44377.48d942b1-1067-4a06-830f-54172c0d6477 1G Apr 22 17:53:07 devstack sudo[85927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:53:07 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-acfac840-1076-44db-8ef4-67f7e82b7284 tempest-GroupSnapshotsTest-38718681 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-d74685c0-3558-4643-ae25-2c195bbbd356.9cac9947-d8fe-4b66-b20d-14d7610180f0" returned: 0 in 0.690s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:53:07 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-acfac840-1076-44db-8ef4-67f7e82b7284 tempest-GroupSnapshotsTest-38718681 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d74685c0-3558-4643-ae25-2c195bbbd356(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81771) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 22 17:53:07 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4b8751b-26b1-46b6-8b99-d0a0f6873f16]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:53:07 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-acfac840-1076-44db-8ef4-67f7e82b7284 tempest-GroupSnapshotsTest-38718681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-d74685c0-3558-4643-ae25-2c195bbbd356 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:53:08 devstack sudo[85929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-d74685c0-3558-4643-ae25-2c195bbbd356 Apr 22 17:53:08 devstack sudo[85929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:53:08 devstack sudo[85910]: pam_unix(sudo:session): session closed for user root Apr 22 17:53:08 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [req-84d22fd2-e1dc-475d-ab6d-9963ba54ad85 req-4bf2c1a9-4705-4dfb-bb38-80a31752b839 tempest-ServerBootFromVolumeStableRescueTest-800024217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9e076047-8ac8-4bf8-88ea-602aa20d3c9e_pqa2wb3wdevstack@QuobyteHD /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b65b8307-7292-4108-ba72-331fceb4c3f1" returned: 0 in 1.561s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:53:08 devstack cinder-volume[81771]: DEBUG cinder.image.image_utils [req-84d22fd2-e1dc-475d-ab6d-9963ba54ad85 req-4bf2c1a9-4705-4dfb-bb38-80a31752b839 tempest-ServerBootFromVolumeStableRescueTest-800024217 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9e076047-8ac8-4bf8-88ea-602aa20d3c9e_pqa2wb3wdevstack@QuobyteHD, size 112.00 MB, duration 1.56 sec, destination /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b65b8307-7292-4108-ba72-331fceb4c3f1 {{(pid=81771) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 22 17:53:08 devstack cinder-volume[81771]: INFO cinder.image.image_utils [req-84d22fd2-e1dc-475d-ab6d-9963ba54ad85 req-4bf2c1a9-4705-4dfb-bb38-80a31752b839 tempest-ServerBootFromVolumeStableRescueTest-800024217 None] Converted 112.00 MB image at 71.66 MB/s Apr 22 17:53:08 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [req-84d22fd2-e1dc-475d-ab6d-9963ba54ad85 req-4bf2c1a9-4705-4dfb-bb38-80a31752b839 tempest-ServerBootFromVolumeStableRescueTest-800024217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b65b8307-7292-4108-ba72-331fceb4c3f1 1G {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:53:08 devstack sudo[85934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b65b8307-7292-4108-ba72-331fceb4c3f1 1G Apr 22 17:53:08 devstack sudo[85934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:53:08 devstack sudo[85927]: pam_unix(sudo:session): session closed for user root Apr 22 17:53:08 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-169cb46c-742e-4f6c-bf22-5ad119918a40 tempest-SnapshotMetadataTestJSON-177948815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-ee0221eb-4481-4b96-850f-4ae995b44377,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-ee0221eb-4481-4b96-850f-4ae995b44377.48d942b1-1067-4a06-830f-54172c0d6477 1G" returned: 0 in 0.762s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:53:08 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-169cb46c-742e-4f6c-bf22-5ad119918a40 tempest-SnapshotMetadataTestJSON-177948815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee0221eb-4481-4b96-850f-4ae995b44377 -F qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-ee0221eb-4481-4b96-850f-4ae995b44377.48d942b1-1067-4a06-830f-54172c0d6477 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:53:08 devstack sudo[85929]: pam_unix(sudo:session): session closed for user root Apr 22 17:53:08 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-acfac840-1076-44db-8ef4-67f7e82b7284 tempest-GroupSnapshotsTest-38718681 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-d74685c0-3558-4643-ae25-2c195bbbd356" returned: 0 in 0.722s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:53:08 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-acfac840-1076-44db-8ef4-67f7e82b7284 tempest-GroupSnapshotsTest-38718681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-d74685c0-3558-4643-ae25-2c195bbbd356.9cac9947-d8fe-4b66-b20d-14d7610180f0 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:53:08 devstack sudo[85939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee0221eb-4481-4b96-850f-4ae995b44377 -F qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-ee0221eb-4481-4b96-850f-4ae995b44377.48d942b1-1067-4a06-830f-54172c0d6477 Apr 22 17:53:08 devstack sudo[85939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:53:08 devstack sudo[85940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-d74685c0-3558-4643-ae25-2c195bbbd356.9cac9947-d8fe-4b66-b20d-14d7610180f0 Apr 22 17:53:08 devstack sudo[85940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:53:08 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-f5bd48c0-ee7c-4981-9b78-5dda7284e890 tempest-BackendsCapabilitiesAdminTestsJSON-845850544 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6804428100586, 'free_capacity_gb': 1775.6804428100586, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=81771) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 22 17:53:09 devstack sudo[85934]: pam_unix(sudo:session): session closed for user root Apr 22 17:53:09 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [req-84d22fd2-e1dc-475d-ab6d-9963ba54ad85 req-4bf2c1a9-4705-4dfb-bb38-80a31752b839 tempest-ServerBootFromVolumeStableRescueTest-800024217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b65b8307-7292-4108-ba72-331fceb4c3f1 1G" returned: 0 in 0.515s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:53:09 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[10b9d4b9-cc9d-4cd3-a6a8-b23c59b9f66e]: (4, 'raw') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:53:09 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [req-84d22fd2-e1dc-475d-ab6d-9963ba54ad85 req-4bf2c1a9-4705-4dfb-bb38-80a31752b839 tempest-ServerBootFromVolumeStableRescueTest-800024217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b65b8307-7292-4108-ba72-331fceb4c3f1 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:53:09 devstack sudo[85948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b65b8307-7292-4108-ba72-331fceb4c3f1 Apr 22 17:53:09 devstack sudo[85948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:53:09 devstack sudo[85939]: pam_unix(sudo:session): session closed for user root Apr 22 17:53:09 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-169cb46c-742e-4f6c-bf22-5ad119918a40 tempest-SnapshotMetadataTestJSON-177948815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee0221eb-4481-4b96-850f-4ae995b44377 -F qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-ee0221eb-4481-4b96-850f-4ae995b44377.48d942b1-1067-4a06-830f-54172c0d6477" returned: 0 in 0.549s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:53:09 devstack cinder-volume[81771]: WARNING cinder.volume.drivers.remotefs [None req-169cb46c-742e-4f6c-bf22-5ad119918a40 tempest-SnapshotMetadataTestJSON-177948815 None] /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-ee0221eb-4481-4b96-850f-4ae995b44377.48d942b1-1067-4a06-830f-54172c0d6477 is being set with open permissions: ugo+rw Apr 22 17:53:09 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-169cb46c-742e-4f6c-bf22-5ad119918a40 tempest-SnapshotMetadataTestJSON-177948815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-ee0221eb-4481-4b96-850f-4ae995b44377.48d942b1-1067-4a06-830f-54172c0d6477 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:53:09 devstack sudo[85954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-ee0221eb-4481-4b96-850f-4ae995b44377.48d942b1-1067-4a06-830f-54172c0d6477 Apr 22 17:53:09 devstack sudo[85954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:53:09 devstack sudo[85940]: pam_unix(sudo:session): session closed for user root Apr 22 17:53:09 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-acfac840-1076-44db-8ef4-67f7e82b7284 tempest-GroupSnapshotsTest-38718681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-d74685c0-3558-4643-ae25-2c195bbbd356.9cac9947-d8fe-4b66-b20d-14d7610180f0" returned: 0 in 0.635s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:53:09 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-acfac840-1076-44db-8ef4-67f7e82b7284 tempest-GroupSnapshotsTest-38718681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-d74685c0-3558-4643-ae25-2c195bbbd356.9cac9947-d8fe-4b66-b20d-14d7610180f0 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:53:09 devstack sudo[85956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-d74685c0-3558-4643-ae25-2c195bbbd356.9cac9947-d8fe-4b66-b20d-14d7610180f0 Apr 22 17:53:09 devstack sudo[85956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:53:09 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-4fa99df5-48f5-4b74-8c0e-481bfe1c8d3c tempest-BackendsCapabilitiesAdminTestsJSON-845850544 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6804428100586, 'free_capacity_gb': 1775.6804428100586, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=81771) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 22 17:53:09 devstack sudo[85954]: pam_unix(sudo:session): session closed for user root Apr 22 17:53:09 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-169cb46c-742e-4f6c-bf22-5ad119918a40 tempest-SnapshotMetadataTestJSON-177948815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-ee0221eb-4481-4b96-850f-4ae995b44377.48d942b1-1067-4a06-830f-54172c0d6477" returned: 0 in 0.475s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:53:09 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-169cb46c-742e-4f6c-bf22-5ad119918a40 tempest-SnapshotMetadataTestJSON-177948815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-ee0221eb-4481-4b96-850f-4ae995b44377.info {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:53:09 devstack sudo[85948]: pam_unix(sudo:session): session closed for user root Apr 22 17:53:09 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [req-84d22fd2-e1dc-475d-ab6d-9963ba54ad85 req-4bf2c1a9-4705-4dfb-bb38-80a31752b839 tempest-ServerBootFromVolumeStableRescueTest-800024217 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b65b8307-7292-4108-ba72-331fceb4c3f1" returned: 0 in 0.673s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:53:09 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [req-84d22fd2-e1dc-475d-ab6d-9963ba54ad85 req-4bf2c1a9-4705-4dfb-bb38-80a31752b839 tempest-ServerBootFromVolumeStableRescueTest-800024217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b65b8307-7292-4108-ba72-331fceb4c3f1 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:53:09 devstack sudo[85962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-ee0221eb-4481-4b96-850f-4ae995b44377.info Apr 22 17:53:09 devstack sudo[85962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:53:09 devstack sudo[85963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b65b8307-7292-4108-ba72-331fceb4c3f1 Apr 22 17:53:09 devstack sudo[85963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:53:09 devstack sudo[85956]: pam_unix(sudo:session): session closed for user root Apr 22 17:53:09 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-acfac840-1076-44db-8ef4-67f7e82b7284 tempest-GroupSnapshotsTest-38718681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-d74685c0-3558-4643-ae25-2c195bbbd356.9cac9947-d8fe-4b66-b20d-14d7610180f0" returned: 0 in 0.501s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:53:09 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-acfac840-1076-44db-8ef4-67f7e82b7284 tempest-GroupSnapshotsTest-38718681 None] Lock "cinder-quobyte-9cac9947-d8fe-4b66-b20d-14d7610180f0" released by "_delete_snapshot" :: held 2.651s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:53:09 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-acfac840-1076-44db-8ef4-67f7e82b7284 tempest-GroupSnapshotsTest-38718681 None] Lock "cinder-quobyte-d74685c0-3558-4643-ae25-2c195bbbd356" released by "delete_snapshot" :: held 2.684s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:53:09 devstack cinder-volume[81771]: WARNING cinder.quota [None req-acfac840-1076-44db-8ef4-67f7e82b7284 tempest-GroupSnapshotsTest-38718681 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-707630089 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-707630089, it is now deprecated. Please use the default quota class for default quota. Apr 22 17:53:09 devstack cinder-volume[81771]: WARNING cinder.quota [None req-acfac840-1076-44db-8ef4-67f7e82b7284 tempest-GroupSnapshotsTest-38718681 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-707630089 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-707630089, it is now deprecated. Please use the default quota class for default quota. Apr 22 17:53:10 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-acfac840-1076-44db-8ef4-67f7e82b7284 tempest-GroupSnapshotsTest-38718681 None] Created reservations ['bc7bf52e-d000-4413-a257-eea81d1da171', '32b0f382-db43-4a40-b5a4-d19eb85caa67', 'a9e6316a-a014-4d74-8b56-0d51037916eb', '0db50236-5770-47c2-bdf2-71dae39c3c17'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 17:53:10 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-acfac840-1076-44db-8ef4-67f7e82b7284 tempest-GroupSnapshotsTest-38718681 None] Created reservations ['b79c8273-ba95-420e-b3ef-97357a77883f', 'f2265fc7-bab2-4433-a2b0-648841d4c4dc', '268c2928-c56f-4098-b5c8-c6f4da643fdd', '15115cfc-cee4-4b37-9c0a-20cd2f4ff085'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 17:53:10 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-acfac840-1076-44db-8ef4-67f7e82b7284 tempest-GroupSnapshotsTest-38718681 None] group_snapshot 7590b550-7eb1-43d4-8f19-9294e973478e: deleted successfully Apr 22 17:53:10 devstack sudo[85962]: pam_unix(sudo:session): session closed for user root Apr 22 17:53:10 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-169cb46c-742e-4f6c-bf22-5ad119918a40 tempest-SnapshotMetadataTestJSON-177948815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-ee0221eb-4481-4b96-850f-4ae995b44377.info" returned: 0 in 0.594s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:53:10 devstack cinder-volume[81771]: WARNING cinder.volume.drivers.remotefs [None req-169cb46c-742e-4f6c-bf22-5ad119918a40 tempest-SnapshotMetadataTestJSON-177948815 None] /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-ee0221eb-4481-4b96-850f-4ae995b44377.info is being set with open permissions: ugo+rw Apr 22 17:53:10 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-169cb46c-742e-4f6c-bf22-5ad119918a40 tempest-SnapshotMetadataTestJSON-177948815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-ee0221eb-4481-4b96-850f-4ae995b44377.info {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:53:10 devstack sudo[85970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-ee0221eb-4481-4b96-850f-4ae995b44377.info Apr 22 17:53:10 devstack sudo[85970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:53:10 devstack sudo[85963]: pam_unix(sudo:session): session closed for user root Apr 22 17:53:10 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [req-84d22fd2-e1dc-475d-ab6d-9963ba54ad85 req-4bf2c1a9-4705-4dfb-bb38-80a31752b839 tempest-ServerBootFromVolumeStableRescueTest-800024217 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b65b8307-7292-4108-ba72-331fceb4c3f1" returned: 1 in 0.678s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:53:10 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [req-84d22fd2-e1dc-475d-ab6d-9963ba54ad85 req-4bf2c1a9-4705-4dfb-bb38-80a31752b839 tempest-ServerBootFromVolumeStableRescueTest-800024217 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b65b8307-7292-4108-ba72-331fceb4c3f1' failed. Not Retrying. {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 22 17:53:10 devstack cinder-volume[81771]: DEBUG cinder.volume.volume_utils [req-84d22fd2-e1dc-475d-ab6d-9963ba54ad85 req-4bf2c1a9-4705-4dfb-bb38-80a31752b839 tempest-ServerBootFromVolumeStableRescueTest-800024217 None] Downloaded image 9e076047-8ac8-4bf8-88ea-602aa20d3c9e ((None, [{'url': 'file:///opt/stack/data/glance/images/9e076047-8ac8-4bf8-88ea-602aa20d3c9e', 'metadata': {}}])) to volume b65b8307-7292-4108-ba72-331fceb4c3f1 successfully. {{(pid=81771) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 22 17:53:10 devstack cinder-volume[81771]: DEBUG cinder.image.image_utils [req-84d22fd2-e1dc-475d-ab6d-9963ba54ad85 req-4bf2c1a9-4705-4dfb-bb38-80a31752b839 tempest-ServerBootFromVolumeStableRescueTest-800024217 None] Temporary image 9e076047-8ac8-4bf8-88ea-602aa20d3c9e for user b063426c8b9b41a5a48e0e1035ec179c is deleted. {{(pid=81771) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 22 17:53:10 devstack cinder-volume[81771]: DEBUG cinder.volume.volume_utils [req-84d22fd2-e1dc-475d-ab6d-9963ba54ad85 req-4bf2c1a9-4705-4dfb-bb38-80a31752b839 tempest-ServerBootFromVolumeStableRescueTest-800024217 None] Marking volume b65b8307-7292-4108-ba72-331fceb4c3f1 as bootable. {{(pid=81771) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 22 17:53:10 devstack cinder-volume[81771]: DEBUG cinder.volume.flows.manager.create_volume [req-84d22fd2-e1dc-475d-ab6d-9963ba54ad85 req-4bf2c1a9-4705-4dfb-bb38-80a31752b839 tempest-ServerBootFromVolumeStableRescueTest-800024217 None] Copying metadata from image 9e076047-8ac8-4bf8-88ea-602aa20d3c9e to b65b8307-7292-4108-ba72-331fceb4c3f1. {{(pid=81771) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 22 17:53:10 devstack cinder-volume[81771]: DEBUG cinder.volume.flows.manager.create_volume [req-84d22fd2-e1dc-475d-ab6d-9963ba54ad85 req-4bf2c1a9-4705-4dfb-bb38-80a31752b839 tempest-ServerBootFromVolumeStableRescueTest-800024217 None] Creating volume glance metadata for volume b65b8307-7292-4108-ba72-331fceb4c3f1 backed by image 9e076047-8ac8-4bf8-88ea-602aa20d3c9e with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '9e076047-8ac8-4bf8-88ea-602aa20d3c9e', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=81771) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 22 17:53:10 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [req-84d22fd2-e1dc-475d-ab6d-9963ba54ad85 req-4bf2c1a9-4705-4dfb-bb38-80a31752b839 tempest-ServerBootFromVolumeStableRescueTest-800024217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f8c97fd-5291-440a-b73f-00db63fcfafa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b65b8307-7292-4108-ba72-331fceb4c3f1', 'volume_size': 1, 'image_id': '9e076047-8ac8-4bf8-88ea-602aa20d3c9e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9e076047-8ac8-4bf8-88ea-602aa20d3c9e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '39e18fb0fde242f68d38bed6963e8744', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9e076047-8ac8-4bf8-88ea-602aa20d3c9e', 'created_at': datetime.datetime(2026, 4, 22, 15, 44, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 22, 15, 44, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9e076047-8ac8-4bf8-88ea-602aa20d3c9e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:53:10 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [req-84d22fd2-e1dc-475d-ab6d-9963ba54ad85 req-4bf2c1a9-4705-4dfb-bb38-80a31752b839 tempest-ServerBootFromVolumeStableRescueTest-800024217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b56fdca0-466b-4569-89c1-9a519fd2cc74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:53:10 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [req-84d22fd2-e1dc-475d-ab6d-9963ba54ad85 req-4bf2c1a9-4705-4dfb-bb38-80a31752b839 tempest-ServerBootFromVolumeStableRescueTest-800024217 None] Volume volume-b65b8307-7292-4108-ba72-331fceb4c3f1 (b65b8307-7292-4108-ba72-331fceb4c3f1): created successfully Apr 22 17:53:10 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [req-84d22fd2-e1dc-475d-ab6d-9963ba54ad85 req-4bf2c1a9-4705-4dfb-bb38-80a31752b839 tempest-ServerBootFromVolumeStableRescueTest-800024217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b56fdca0-466b-4569-89c1-9a519fd2cc74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:53:10 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [req-84d22fd2-e1dc-475d-ab6d-9963ba54ad85 req-4bf2c1a9-4705-4dfb-bb38-80a31752b839 tempest-ServerBootFromVolumeStableRescueTest-800024217 None] Flow 'volume_create_manager' (dd5def9f-0289-4827-92a4-1579be892182) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:53:10 devstack cinder-volume[81771]: INFO cinder.volume.manager [req-84d22fd2-e1dc-475d-ab6d-9963ba54ad85 req-4bf2c1a9-4705-4dfb-bb38-80a31752b839 tempest-ServerBootFromVolumeStableRescueTest-800024217 None] Created volume successfully. Apr 22 17:53:10 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-2bc5bb60-1417-4b0d-b8f4-5b2a020970d6 tempest-GroupSnapshotsTest-38718681 None] Acquiring lock "cinder-quobyte-b2bc74d7-0c38-4930-a975-8388b7be1d2e" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:53:10 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-2bc5bb60-1417-4b0d-b8f4-5b2a020970d6 tempest-GroupSnapshotsTest-38718681 None] Lock "cinder-quobyte-b2bc74d7-0c38-4930-a975-8388b7be1d2e" acquired by "delete_volume" :: waited 0.018s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:53:10 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1425404-67ca-43c8-9922-7191f5343358]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:53:10 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-2bc5bb60-1417-4b0d-b8f4-5b2a020970d6 tempest-GroupSnapshotsTest-38718681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b2bc74d7-0c38-4930-a975-8388b7be1d2e {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:53:11 devstack sudo[85970]: pam_unix(sudo:session): session closed for user root Apr 22 17:53:11 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-169cb46c-742e-4f6c-bf22-5ad119918a40 tempest-SnapshotMetadataTestJSON-177948815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-ee0221eb-4481-4b96-850f-4ae995b44377.info" returned: 0 in 0.695s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:53:11 devstack sudo[85973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b2bc74d7-0c38-4930-a975-8388b7be1d2e Apr 22 17:53:11 devstack sudo[85973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:53:11 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-169cb46c-742e-4f6c-bf22-5ad119918a40 tempest-SnapshotMetadataTestJSON-177948815 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.881s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:53:11 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-169cb46c-742e-4f6c-bf22-5ad119918a40 tempest-SnapshotMetadataTestJSON-177948815 None] Create snapshot completed successfully Apr 22 17:53:11 devstack sudo[85973]: pam_unix(sudo:session): session closed for user root Apr 22 17:53:11 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-2bc5bb60-1417-4b0d-b8f4-5b2a020970d6 tempest-GroupSnapshotsTest-38718681 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b2bc74d7-0c38-4930-a975-8388b7be1d2e" returned: 0 in 0.609s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:53:11 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-2bc5bb60-1417-4b0d-b8f4-5b2a020970d6 tempest-GroupSnapshotsTest-38718681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b2bc74d7-0c38-4930-a975-8388b7be1d2e {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:53:11 devstack sudo[85978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b2bc74d7-0c38-4930-a975-8388b7be1d2e Apr 22 17:53:11 devstack sudo[85978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:53:12 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-94b459e0-9817-4c0f-9ca8-3b2d9614474f tempest-SnapshotMetadataTestJSON-177948815 None] Acquiring lock "cinder-48d942b1-1067-4a06-830f-54172c0d6477-delete_snapshot" by "delete_snapshot" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:53:12 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-94b459e0-9817-4c0f-9ca8-3b2d9614474f tempest-SnapshotMetadataTestJSON-177948815 None] Lock "cinder-48d942b1-1067-4a06-830f-54172c0d6477-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:53:12 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-94b459e0-9817-4c0f-9ca8-3b2d9614474f tempest-SnapshotMetadataTestJSON-177948815 None] Acquiring lock "cinder-quobyte-ee0221eb-4481-4b96-850f-4ae995b44377" by "delete_snapshot" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:53:12 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-94b459e0-9817-4c0f-9ca8-3b2d9614474f tempest-SnapshotMetadataTestJSON-177948815 None] Lock "cinder-quobyte-ee0221eb-4481-4b96-850f-4ae995b44377" acquired by "delete_snapshot" :: waited 0.016s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:53:12 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-94b459e0-9817-4c0f-9ca8-3b2d9614474f tempest-SnapshotMetadataTestJSON-177948815 None] Acquiring lock "cinder-quobyte-48d942b1-1067-4a06-830f-54172c0d6477" by "_delete_snapshot" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:53:12 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-94b459e0-9817-4c0f-9ca8-3b2d9614474f tempest-SnapshotMetadataTestJSON-177948815 None] Lock "cinder-quobyte-48d942b1-1067-4a06-830f-54172c0d6477" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:53:12 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-94b459e0-9817-4c0f-9ca8-3b2d9614474f tempest-SnapshotMetadataTestJSON-177948815 None] Deleting offline snapshot 48d942b1-1067-4a06-830f-54172c0d6477 of volume ee0221eb-4481-4b96-850f-4ae995b44377 {{(pid=81771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 22 17:53:12 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-94b459e0-9817-4c0f-9ca8-3b2d9614474f tempest-SnapshotMetadataTestJSON-177948815 None] snapshot_file for this snap is: volume-ee0221eb-4481-4b96-850f-4ae995b44377.48d942b1-1067-4a06-830f-54172c0d6477 {{(pid=81771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 22 17:53:12 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[24910bc0-b8b8-493b-99d6-b85f231a62f8]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:53:12 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-94b459e0-9817-4c0f-9ca8-3b2d9614474f tempest-SnapshotMetadataTestJSON-177948815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-ee0221eb-4481-4b96-850f-4ae995b44377.48d942b1-1067-4a06-830f-54172c0d6477 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:53:12 devstack sudo[85978]: pam_unix(sudo:session): session closed for user root Apr 22 17:53:12 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-2bc5bb60-1417-4b0d-b8f4-5b2a020970d6 tempest-GroupSnapshotsTest-38718681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b2bc74d7-0c38-4930-a975-8388b7be1d2e" returned: 0 in 0.790s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:53:12 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-2bc5bb60-1417-4b0d-b8f4-5b2a020970d6 tempest-GroupSnapshotsTest-38718681 None] Lock "cinder-quobyte-b2bc74d7-0c38-4930-a975-8388b7be1d2e" released by "delete_volume" :: held 1.485s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:53:12 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-2bc5bb60-1417-4b0d-b8f4-5b2a020970d6 tempest-GroupSnapshotsTest-38718681 None] Acquiring lock "cinder-quobyte-d74685c0-3558-4643-ae25-2c195bbbd356" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:53:12 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-2bc5bb60-1417-4b0d-b8f4-5b2a020970d6 tempest-GroupSnapshotsTest-38718681 None] Lock "cinder-quobyte-d74685c0-3558-4643-ae25-2c195bbbd356" acquired by "delete_volume" :: waited 0.022s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:53:12 devstack sudo[85983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-ee0221eb-4481-4b96-850f-4ae995b44377.48d942b1-1067-4a06-830f-54172c0d6477 Apr 22 17:53:12 devstack sudo[85983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:53:12 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d278c10-ec58-47f8-bdcb-fa0d72858cdf]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:53:12 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-2bc5bb60-1417-4b0d-b8f4-5b2a020970d6 tempest-GroupSnapshotsTest-38718681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-d74685c0-3558-4643-ae25-2c195bbbd356 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:53:12 devstack sudo[85991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-d74685c0-3558-4643-ae25-2c195bbbd356 Apr 22 17:53:12 devstack sudo[85991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:53:12 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [req-84d22fd2-e1dc-475d-ab6d-9963ba54ad85 req-54d5c7cf-b786-4c97-a7e0-e20852845e30 tempest-ServerBootFromVolumeStableRescueTest-800024217 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:53:12 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [req-84d22fd2-e1dc-475d-ab6d-9963ba54ad85 req-54d5c7cf-b786-4c97-a7e0-e20852845e30 tempest-ServerBootFromVolumeStableRescueTest-800024217 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:53:12 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fbe716f-8223-4352-8e0a-81387c9fe1ba]: (4, 'raw') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:53:12 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [req-84d22fd2-e1dc-475d-ab6d-9963ba54ad85 req-54d5c7cf-b786-4c97-a7e0-e20852845e30 tempest-ServerBootFromVolumeStableRescueTest-800024217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b65b8307-7292-4108-ba72-331fceb4c3f1 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:53:12 devstack sudo[85993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b65b8307-7292-4108-ba72-331fceb4c3f1 Apr 22 17:53:12 devstack sudo[85993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:53:13 devstack sudo[85983]: pam_unix(sudo:session): session closed for user root Apr 22 17:53:13 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-94b459e0-9817-4c0f-9ca8-3b2d9614474f tempest-SnapshotMetadataTestJSON-177948815 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-ee0221eb-4481-4b96-850f-4ae995b44377.48d942b1-1067-4a06-830f-54172c0d6477" returned: 0 in 0.768s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:53:13 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-94b459e0-9817-4c0f-9ca8-3b2d9614474f tempest-SnapshotMetadataTestJSON-177948815 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ee0221eb-4481-4b96-850f-4ae995b44377(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81771) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 22 17:53:13 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[89782c76-e57d-45a7-8d6f-5b71e41d4f33]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:53:13 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-94b459e0-9817-4c0f-9ca8-3b2d9614474f tempest-SnapshotMetadataTestJSON-177948815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-ee0221eb-4481-4b96-850f-4ae995b44377 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:53:13 devstack sudo[85991]: pam_unix(sudo:session): session closed for user root Apr 22 17:53:13 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-2bc5bb60-1417-4b0d-b8f4-5b2a020970d6 tempest-GroupSnapshotsTest-38718681 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-d74685c0-3558-4643-ae25-2c195bbbd356" returned: 0 in 0.706s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:53:13 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-2bc5bb60-1417-4b0d-b8f4-5b2a020970d6 tempest-GroupSnapshotsTest-38718681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-d74685c0-3558-4643-ae25-2c195bbbd356 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:53:13 devstack sudo[86004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-d74685c0-3558-4643-ae25-2c195bbbd356 Apr 22 17:53:13 devstack sudo[86004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:53:13 devstack sudo[86002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-ee0221eb-4481-4b96-850f-4ae995b44377 Apr 22 17:53:13 devstack sudo[86002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:53:13 devstack sudo[85993]: pam_unix(sudo:session): session closed for user root Apr 22 17:53:13 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [req-84d22fd2-e1dc-475d-ab6d-9963ba54ad85 req-54d5c7cf-b786-4c97-a7e0-e20852845e30 tempest-ServerBootFromVolumeStableRescueTest-800024217 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b65b8307-7292-4108-ba72-331fceb4c3f1" returned: 0 in 0.813s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:53:13 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [req-84d22fd2-e1dc-475d-ab6d-9963ba54ad85 req-54d5c7cf-b786-4c97-a7e0-e20852845e30 tempest-ServerBootFromVolumeStableRescueTest-800024217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b65b8307-7292-4108-ba72-331fceb4c3f1 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:53:13 devstack sudo[86007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b65b8307-7292-4108-ba72-331fceb4c3f1 Apr 22 17:53:13 devstack sudo[86007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:53:13 devstack sudo[86004]: pam_unix(sudo:session): session closed for user root Apr 22 17:53:13 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-2bc5bb60-1417-4b0d-b8f4-5b2a020970d6 tempest-GroupSnapshotsTest-38718681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-d74685c0-3558-4643-ae25-2c195bbbd356" returned: 0 in 0.576s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:53:13 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-2bc5bb60-1417-4b0d-b8f4-5b2a020970d6 tempest-GroupSnapshotsTest-38718681 None] Lock "cinder-quobyte-d74685c0-3558-4643-ae25-2c195bbbd356" released by "delete_volume" :: held 1.357s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:53:13 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-2bc5bb60-1417-4b0d-b8f4-5b2a020970d6 tempest-GroupSnapshotsTest-38718681 None] Created reservations ['333d514f-9e65-45a0-95bc-5749620abee7'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 17:53:13 devstack sudo[86002]: pam_unix(sudo:session): session closed for user root Apr 22 17:53:13 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-94b459e0-9817-4c0f-9ca8-3b2d9614474f tempest-SnapshotMetadataTestJSON-177948815 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-ee0221eb-4481-4b96-850f-4ae995b44377" returned: 0 in 0.717s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:53:13 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-94b459e0-9817-4c0f-9ca8-3b2d9614474f tempest-SnapshotMetadataTestJSON-177948815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-ee0221eb-4481-4b96-850f-4ae995b44377.48d942b1-1067-4a06-830f-54172c0d6477 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:53:13 devstack cinder-volume[81771]: WARNING cinder.quota [None req-2bc5bb60-1417-4b0d-b8f4-5b2a020970d6 tempest-GroupSnapshotsTest-38718681 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-707630089 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-707630089, it is now deprecated. Please use the default quota class for default quota. Apr 22 17:53:13 devstack sudo[86013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-ee0221eb-4481-4b96-850f-4ae995b44377.48d942b1-1067-4a06-830f-54172c0d6477 Apr 22 17:53:13 devstack sudo[86013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:53:13 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-2bc5bb60-1417-4b0d-b8f4-5b2a020970d6 tempest-GroupSnapshotsTest-38718681 None] Created reservations ['7cf83966-f56b-436c-8ff5-0e54b03c8797', '7f9fc454-b957-4787-b898-dae9480c41be', '2f8a7cee-fb4e-4ddc-92d1-865214380361', '1ed17eb0-d42c-46f6-92cf-91fd387576c3'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 17:53:14 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-2bc5bb60-1417-4b0d-b8f4-5b2a020970d6 tempest-GroupSnapshotsTest-38718681 None] Created reservations ['03a66e9e-b26e-49ab-abce-5a4661953265', '9fbc4413-2aba-43d3-92c2-c73ec97745e1', '3bc3675b-82a4-48da-8b2a-c0f75c345b54', '474ec1d6-74ae-4aee-b910-fb3e6c7f715e'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 17:53:14 devstack sudo[86007]: pam_unix(sudo:session): session closed for user root Apr 22 17:53:14 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [req-84d22fd2-e1dc-475d-ab6d-9963ba54ad85 req-54d5c7cf-b786-4c97-a7e0-e20852845e30 tempest-ServerBootFromVolumeStableRescueTest-800024217 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b65b8307-7292-4108-ba72-331fceb4c3f1" returned: 1 in 0.685s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:53:14 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [req-84d22fd2-e1dc-475d-ab6d-9963ba54ad85 req-54d5c7cf-b786-4c97-a7e0-e20852845e30 tempest-ServerBootFromVolumeStableRescueTest-800024217 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b65b8307-7292-4108-ba72-331fceb4c3f1' failed. Not Retrying. {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 22 17:53:14 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [req-84d22fd2-e1dc-475d-ab6d-9963ba54ad85 req-54d5c7cf-b786-4c97-a7e0-e20852845e30 tempest-ServerBootFromVolumeStableRescueTest-800024217 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.542s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:53:14 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [req-84d22fd2-e1dc-475d-ab6d-9963ba54ad85 req-54d5c7cf-b786-4c97-a7e0-e20852845e30 tempest-ServerBootFromVolumeStableRescueTest-800024217 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93', 'name': 'volume-b65b8307-7292-4108-ba72-331fceb4c3f1', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f6b89c4c-36b2-413b-a1df-e8607a8ec57e', 'enforce_multipath': True} {{(pid=81771) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 22 17:53:14 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-2bc5bb60-1417-4b0d-b8f4-5b2a020970d6 tempest-GroupSnapshotsTest-38718681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:53:14 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-2bc5bb60-1417-4b0d-b8f4-5b2a020970d6 tempest-GroupSnapshotsTest-38718681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:53:14 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-2bc5bb60-1417-4b0d-b8f4-5b2a020970d6 tempest-GroupSnapshotsTest-38718681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:53:14 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-2bc5bb60-1417-4b0d-b8f4-5b2a020970d6 tempest-GroupSnapshotsTest-38718681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:53:14 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-2bc5bb60-1417-4b0d-b8f4-5b2a020970d6 tempest-GroupSnapshotsTest-38718681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:53:14 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-2bc5bb60-1417-4b0d-b8f4-5b2a020970d6 tempest-GroupSnapshotsTest-38718681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:53:14 devstack cinder-volume[81771]: INFO cinder.volume.manager [req-84d22fd2-e1dc-475d-ab6d-9963ba54ad85 req-54d5c7cf-b786-4c97-a7e0-e20852845e30 tempest-ServerBootFromVolumeStableRescueTest-800024217 None] attachment_update completed successfully. Apr 22 17:53:14 devstack sudo[86018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 Apr 22 17:53:14 devstack sudo[86018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:53:14 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-8d96badb-3689-4414-b0eb-460286d7d170 tempest-GroupSnapshotsTest-38718681 None] Group tempest-GroupSnapshotsTest-Group-358859715: creating Apr 22 17:53:14 devstack sudo[86018]: pam_unix(sudo:session): session closed for user root Apr 22 17:53:14 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-8d96badb-3689-4414-b0eb-460286d7d170 tempest-GroupSnapshotsTest-38718681 None] Group tempest-GroupSnapshotsTest-Group-358859715: created successfully Apr 22 17:53:14 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-2bc5bb60-1417-4b0d-b8f4-5b2a020970d6 tempest-GroupSnapshotsTest-38718681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33" returned: 0 in 0.732s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:53:14 devstack cinder-volume[81771]: DEBUG cinder.manager [None req-2bc5bb60-1417-4b0d-b8f4-5b2a020970d6 tempest-GroupSnapshotsTest-38718681 None] Notifying Schedulers of capabilities ... {{(pid=81771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 17:53:14 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-8d96badb-3689-4414-b0eb-460286d7d170 tempest-GroupSnapshotsTest-38718681 None] Create group completed successfully. Apr 22 17:53:14 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-2bc5bb60-1417-4b0d-b8f4-5b2a020970d6 tempest-GroupSnapshotsTest-38718681 None] Delete group completed successfully. Apr 22 17:53:14 devstack sudo[86013]: pam_unix(sudo:session): session closed for user root Apr 22 17:53:14 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-94b459e0-9817-4c0f-9ca8-3b2d9614474f tempest-SnapshotMetadataTestJSON-177948815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-ee0221eb-4481-4b96-850f-4ae995b44377.48d942b1-1067-4a06-830f-54172c0d6477" returned: 0 in 1.098s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:53:14 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-94b459e0-9817-4c0f-9ca8-3b2d9614474f tempest-SnapshotMetadataTestJSON-177948815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-ee0221eb-4481-4b96-850f-4ae995b44377.48d942b1-1067-4a06-830f-54172c0d6477 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:53:15 devstack sudo[86024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-ee0221eb-4481-4b96-850f-4ae995b44377.48d942b1-1067-4a06-830f-54172c0d6477 Apr 22 17:53:15 devstack sudo[86024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:53:15 devstack sudo[86024]: pam_unix(sudo:session): session closed for user root Apr 22 17:53:15 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-94b459e0-9817-4c0f-9ca8-3b2d9614474f tempest-SnapshotMetadataTestJSON-177948815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-ee0221eb-4481-4b96-850f-4ae995b44377.48d942b1-1067-4a06-830f-54172c0d6477" returned: 0 in 0.489s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:53:15 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-94b459e0-9817-4c0f-9ca8-3b2d9614474f tempest-SnapshotMetadataTestJSON-177948815 None] Lock "cinder-quobyte-48d942b1-1067-4a06-830f-54172c0d6477" released by "_delete_snapshot" :: held 3.230s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:53:15 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-94b459e0-9817-4c0f-9ca8-3b2d9614474f tempest-SnapshotMetadataTestJSON-177948815 None] Lock "cinder-quobyte-ee0221eb-4481-4b96-850f-4ae995b44377" released by "delete_snapshot" :: held 3.264s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:53:15 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-94b459e0-9817-4c0f-9ca8-3b2d9614474f tempest-SnapshotMetadataTestJSON-177948815 None] Created reservations ['5ad9cf7d-1165-42fe-b391-5b6c557a9c27', '9bcbf84e-7cfd-426b-8c0c-9e9f8ff53984', '1214eba8-e4b9-4731-aab9-dd2de06409db', 'df831e6b-48fe-4196-a191-509632b94a69'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 17:53:15 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-94b459e0-9817-4c0f-9ca8-3b2d9614474f tempest-SnapshotMetadataTestJSON-177948815 None] Delete snapshot completed successfully. Apr 22 17:53:15 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-94b459e0-9817-4c0f-9ca8-3b2d9614474f tempest-SnapshotMetadataTestJSON-177948815 None] Lock "cinder-48d942b1-1067-4a06-830f-54172c0d6477-delete_snapshot" released by "delete_snapshot" :: held 3.452s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:53:15 devstack cinder-volume[81771]: DEBUG cinder.volume.flows.manager.create_volume [None req-48e6e005-4ed1-4ba0-ad78-def14c559f2f tempest-SnapshotsActionsTest-1651779649 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 17:53:15 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-48e6e005-4ed1-4ba0-ad78-def14c559f2f tempest-SnapshotsActionsTest-1651779649 None] Flow 'volume_create_manager' (0b38585f-c136-4f7b-a363-5e1f2d3103e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:53:15 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-48e6e005-4ed1-4ba0-ad78-def14c559f2f tempest-SnapshotsActionsTest-1651779649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (967c460b-85df-4885-a8f4-5e377680fae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:53:15 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-48e6e005-4ed1-4ba0-ad78-def14c559f2f tempest-SnapshotsActionsTest-1651779649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (967c460b-85df-4885-a8f4-5e377680fae1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:53:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-682899711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58cd87d4-3c93-4a3c-a3f7-1bda6cea508d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9fdc4414f524f5a82f769c6e4eb7efd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:53:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:53:16Z,use_quota=True,user_id='7359d377849440db8708e9842c51e524',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:53:15 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-48e6e005-4ed1-4ba0-ad78-def14c559f2f tempest-SnapshotsActionsTest-1651779649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1caa651f-908b-40d2-9708-10312e9cf131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:53:15 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-48e6e005-4ed1-4ba0-ad78-def14c559f2f tempest-SnapshotsActionsTest-1651779649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1caa651f-908b-40d2-9708-10312e9cf131) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:53:15 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-48e6e005-4ed1-4ba0-ad78-def14c559f2f tempest-SnapshotsActionsTest-1651779649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (740cb984-f692-420c-b6e1-03268791d29d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:53:15 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-48e6e005-4ed1-4ba0-ad78-def14c559f2f tempest-SnapshotsActionsTest-1651779649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (740cb984-f692-420c-b6e1-03268791d29d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58cd87d4-3c93-4a3c-a3f7-1bda6cea508d', 'volume_name': 'volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:53:15 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-48e6e005-4ed1-4ba0-ad78-def14c559f2f tempest-SnapshotsActionsTest-1651779649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6577e618-3707-4e39-a543-9293a761f3e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:53:15 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-48e6e005-4ed1-4ba0-ad78-def14c559f2f tempest-SnapshotsActionsTest-1651779649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6577e618-3707-4e39-a543-9293a761f3e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:53:15 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-48e6e005-4ed1-4ba0-ad78-def14c559f2f tempest-SnapshotsActionsTest-1651779649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dce08d95-8297-4720-9edc-5b6fcb5712fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:53:15 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-48e6e005-4ed1-4ba0-ad78-def14c559f2f tempest-SnapshotsActionsTest-1651779649 None] Volume 58cd87d4-3c93-4a3c-a3f7-1bda6cea508d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d', 'volume_size': 1} Apr 22 17:53:15 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-48e6e005-4ed1-4ba0-ad78-def14c559f2f tempest-SnapshotsActionsTest-1651779649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:53:15 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-48e6e005-4ed1-4ba0-ad78-def14c559f2f tempest-SnapshotsActionsTest-1651779649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:53:15 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-48e6e005-4ed1-4ba0-ad78-def14c559f2f tempest-SnapshotsActionsTest-1651779649 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:53:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-682899711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58cd87d4-3c93-4a3c-a3f7-1bda6cea508d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9fdc4414f524f5a82f769c6e4eb7efd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:53:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:53:16Z,use_quota=True,user_id='7359d377849440db8708e9842c51e524',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)}" {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 17:53:15 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-48e6e005-4ed1-4ba0-ad78-def14c559f2f tempest-SnapshotsActionsTest-1651779649 None] Creating volume 58cd87d4-3c93-4a3c-a3f7-1bda6cea508d {{(pid=81771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 17:53:15 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-48e6e005-4ed1-4ba0-ad78-def14c559f2f tempest-SnapshotsActionsTest-1651779649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:53:15 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-48e6e005-4ed1-4ba0-ad78-def14c559f2f tempest-SnapshotsActionsTest-1651779649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:53:15 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-48e6e005-4ed1-4ba0-ad78-def14c559f2f tempest-SnapshotsActionsTest-1651779649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:53:15 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-48e6e005-4ed1-4ba0-ad78-def14c559f2f tempest-SnapshotsActionsTest-1651779649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:53:15 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-48e6e005-4ed1-4ba0-ad78-def14c559f2f tempest-SnapshotsActionsTest-1651779649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:53:15 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-48e6e005-4ed1-4ba0-ad78-def14c559f2f tempest-SnapshotsActionsTest-1651779649 None] Selected osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 as target Quobyte volume. {{(pid=81771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 17:53:15 devstack cinder-volume[81771]: INFO cinder.volume.drivers.remotefs [None req-48e6e005-4ed1-4ba0-ad78-def14c559f2f tempest-SnapshotsActionsTest-1651779649 None] casted to osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 Apr 22 17:53:15 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-48e6e005-4ed1-4ba0-ad78-def14c559f2f tempest-SnapshotsActionsTest-1651779649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d 1073741824 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:53:15 devstack sudo[86027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d 1073741824 Apr 22 17:53:15 devstack sudo[86027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:53:16 devstack cinder-volume[81771]: DEBUG cinder.volume.flows.manager.create_volume [None req-b67f8733-a807-4961-ae75-86bf1d2902c3 tempest-GroupSnapshotsTest-38718681 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 17:53:16 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-b67f8733-a807-4961-ae75-86bf1d2902c3 tempest-GroupSnapshotsTest-38718681 None] Flow 'volume_create_manager' (9bbc9c14-c17c-4ff9-bc81-d02cde17a8ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:53:16 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-b67f8733-a807-4961-ae75-86bf1d2902c3 tempest-GroupSnapshotsTest-38718681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b562e5c0-ae37-46c4-a3b6-88a69221b3d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:53:16 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-b67f8733-a807-4961-ae75-86bf1d2902c3 tempest-GroupSnapshotsTest-38718681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b562e5c0-ae37-46c4-a3b6-88a69221b3d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:53:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1566991046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f39f8b55-6976-4f07-b31b-d38b6f19184a,host='devstack@QuobyteHD#QuobyteHD',id=230319e2-0e34-43c5-af0a-60bbac4e377d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aea1384afd7849769b4b8ff2d3c8f873',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:53:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:53:16Z,use_quota=True,user_id='d11940f42c1645e8818355c2e86db8d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(159e9f35-ecde-41db-b835-d4919a5149a1),volume_type_id=159e9f35-ecde-41db-b835-d4919a5149a1)' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:53:16 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-b67f8733-a807-4961-ae75-86bf1d2902c3 tempest-GroupSnapshotsTest-38718681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f5f103b-8106-453e-a7aa-89a781d2ae57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:53:16 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-b67f8733-a807-4961-ae75-86bf1d2902c3 tempest-GroupSnapshotsTest-38718681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f5f103b-8106-453e-a7aa-89a781d2ae57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:53:16 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-b67f8733-a807-4961-ae75-86bf1d2902c3 tempest-GroupSnapshotsTest-38718681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8e7c5a4-d69a-439b-ae33-49a49c4c8120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:53:16 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-b67f8733-a807-4961-ae75-86bf1d2902c3 tempest-GroupSnapshotsTest-38718681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8e7c5a4-d69a-439b-ae33-49a49c4c8120) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '230319e2-0e34-43c5-af0a-60bbac4e377d', 'volume_name': 'volume-230319e2-0e34-43c5-af0a-60bbac4e377d', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:53:16 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-b67f8733-a807-4961-ae75-86bf1d2902c3 tempest-GroupSnapshotsTest-38718681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4c71d75-31dd-4ae4-99cb-ea2b44051e75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:53:16 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-b67f8733-a807-4961-ae75-86bf1d2902c3 tempest-GroupSnapshotsTest-38718681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4c71d75-31dd-4ae4-99cb-ea2b44051e75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:53:16 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-b67f8733-a807-4961-ae75-86bf1d2902c3 tempest-GroupSnapshotsTest-38718681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c1229e2-ed2d-4e80-ba35-93559494aa45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:53:16 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-b67f8733-a807-4961-ae75-86bf1d2902c3 tempest-GroupSnapshotsTest-38718681 None] Volume 230319e2-0e34-43c5-af0a-60bbac4e377d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-230319e2-0e34-43c5-af0a-60bbac4e377d', 'volume_size': 1} Apr 22 17:53:16 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-b67f8733-a807-4961-ae75-86bf1d2902c3 tempest-GroupSnapshotsTest-38718681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:53:16 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-94a3408c-43a8-4978-94de-793494eaa996 tempest-SnapshotMetadataTestJSON-177948815 None] Acquiring lock "cinder-ee0221eb-4481-4b96-850f-4ae995b44377-delete_volume" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:53:16 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-94a3408c-43a8-4978-94de-793494eaa996 tempest-SnapshotMetadataTestJSON-177948815 None] Lock "cinder-ee0221eb-4481-4b96-850f-4ae995b44377-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:53:16 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-94a3408c-43a8-4978-94de-793494eaa996 tempest-SnapshotMetadataTestJSON-177948815 None] Acquiring lock "cinder-quobyte-ee0221eb-4481-4b96-850f-4ae995b44377" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:53:16 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-94a3408c-43a8-4978-94de-793494eaa996 tempest-SnapshotMetadataTestJSON-177948815 None] Lock "cinder-quobyte-ee0221eb-4481-4b96-850f-4ae995b44377" acquired by "delete_volume" :: waited 0.017s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:53:16 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[22a6564d-bcac-477a-baa5-e63089552466]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:53:16 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-94a3408c-43a8-4978-94de-793494eaa996 tempest-SnapshotMetadataTestJSON-177948815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-ee0221eb-4481-4b96-850f-4ae995b44377 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:53:16 devstack sudo[86032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-ee0221eb-4481-4b96-850f-4ae995b44377 Apr 22 17:53:16 devstack sudo[86032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:53:16 devstack sudo[86027]: pam_unix(sudo:session): session closed for user root Apr 22 17:53:16 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-48e6e005-4ed1-4ba0-ad78-def14c559f2f tempest-SnapshotsActionsTest-1651779649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d 1073741824" returned: 0 in 0.997s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:53:16 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-48e6e005-4ed1-4ba0-ad78-def14c559f2f tempest-SnapshotsActionsTest-1651779649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:53:16 devstack sudo[86035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d Apr 22 17:53:16 devstack sudo[86035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:53:17 devstack sudo[86032]: pam_unix(sudo:session): session closed for user root Apr 22 17:53:17 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-94a3408c-43a8-4978-94de-793494eaa996 tempest-SnapshotMetadataTestJSON-177948815 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-ee0221eb-4481-4b96-850f-4ae995b44377" returned: 0 in 0.651s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:53:17 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-94a3408c-43a8-4978-94de-793494eaa996 tempest-SnapshotMetadataTestJSON-177948815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-ee0221eb-4481-4b96-850f-4ae995b44377 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:53:17 devstack sudo[86045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-ee0221eb-4481-4b96-850f-4ae995b44377 Apr 22 17:53:17 devstack sudo[86045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:53:17 devstack sudo[86035]: pam_unix(sudo:session): session closed for user root Apr 22 17:53:17 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-48e6e005-4ed1-4ba0-ad78-def14c559f2f tempest-SnapshotsActionsTest-1651779649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d" returned: 0 in 0.518s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:53:17 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-48e6e005-4ed1-4ba0-ad78-def14c559f2f tempest-SnapshotsActionsTest-1651779649 None] <== create_volume: return (1557ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'} {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 17:53:17 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-48e6e005-4ed1-4ba0-ad78-def14c559f2f tempest-SnapshotsActionsTest-1651779649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.559s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:53:17 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-b67f8733-a807-4961-ae75-86bf1d2902c3 tempest-GroupSnapshotsTest-38718681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.890s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:53:17 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-b67f8733-a807-4961-ae75-86bf1d2902c3 tempest-GroupSnapshotsTest-38718681 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f39f8b55-6976-4f07-b31b-d38b6f19184a,created_at=2026-04-22T15:53:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1566991046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f39f8b55-6976-4f07-b31b-d38b6f19184a,host='devstack@QuobyteHD#QuobyteHD',id=230319e2-0e34-43c5-af0a-60bbac4e377d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aea1384afd7849769b4b8ff2d3c8f873',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:53:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:53:16Z,use_quota=True,user_id='d11940f42c1645e8818355c2e86db8d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(159e9f35-ecde-41db-b835-d4919a5149a1),volume_type_id=159e9f35-ecde-41db-b835-d4919a5149a1)}" {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 17:53:17 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-b67f8733-a807-4961-ae75-86bf1d2902c3 tempest-GroupSnapshotsTest-38718681 None] Creating volume 230319e2-0e34-43c5-af0a-60bbac4e377d {{(pid=81771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 17:53:17 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-b67f8733-a807-4961-ae75-86bf1d2902c3 tempest-GroupSnapshotsTest-38718681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:53:17 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-b67f8733-a807-4961-ae75-86bf1d2902c3 tempest-GroupSnapshotsTest-38718681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:53:17 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-b67f8733-a807-4961-ae75-86bf1d2902c3 tempest-GroupSnapshotsTest-38718681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:53:17 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-b67f8733-a807-4961-ae75-86bf1d2902c3 tempest-GroupSnapshotsTest-38718681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:53:17 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-b67f8733-a807-4961-ae75-86bf1d2902c3 tempest-GroupSnapshotsTest-38718681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:53:17 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-b67f8733-a807-4961-ae75-86bf1d2902c3 tempest-GroupSnapshotsTest-38718681 None] Selected osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 as target Quobyte volume. {{(pid=81771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 17:53:17 devstack cinder-volume[81771]: INFO cinder.volume.drivers.remotefs [None req-b67f8733-a807-4961-ae75-86bf1d2902c3 tempest-GroupSnapshotsTest-38718681 None] casted to osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 Apr 22 17:53:17 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-b67f8733-a807-4961-ae75-86bf1d2902c3 tempest-GroupSnapshotsTest-38718681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-230319e2-0e34-43c5-af0a-60bbac4e377d 1073741824 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:53:17 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-48e6e005-4ed1-4ba0-ad78-def14c559f2f tempest-SnapshotsActionsTest-1651779649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dce08d95-8297-4720-9edc-5b6fcb5712fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:53:17 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-48e6e005-4ed1-4ba0-ad78-def14c559f2f tempest-SnapshotsActionsTest-1651779649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0dc8e192-523c-4193-a5aa-6cc67c4f0fe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:53:17 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-48e6e005-4ed1-4ba0-ad78-def14c559f2f tempest-SnapshotsActionsTest-1651779649 None] Volume volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d (58cd87d4-3c93-4a3c-a3f7-1bda6cea508d): created successfully Apr 22 17:53:17 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-48e6e005-4ed1-4ba0-ad78-def14c559f2f tempest-SnapshotsActionsTest-1651779649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0dc8e192-523c-4193-a5aa-6cc67c4f0fe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:53:17 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-48e6e005-4ed1-4ba0-ad78-def14c559f2f tempest-SnapshotsActionsTest-1651779649 None] Flow 'volume_create_manager' (0b38585f-c136-4f7b-a363-5e1f2d3103e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:53:17 devstack sudo[86047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-230319e2-0e34-43c5-af0a-60bbac4e377d 1073741824 Apr 22 17:53:17 devstack sudo[86047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:53:17 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-48e6e005-4ed1-4ba0-ad78-def14c559f2f tempest-SnapshotsActionsTest-1651779649 None] Created volume successfully. Apr 22 17:53:17 devstack sudo[86045]: pam_unix(sudo:session): session closed for user root Apr 22 17:53:17 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-94a3408c-43a8-4978-94de-793494eaa996 tempest-SnapshotMetadataTestJSON-177948815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-ee0221eb-4481-4b96-850f-4ae995b44377" returned: 0 in 0.536s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:53:17 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-94a3408c-43a8-4978-94de-793494eaa996 tempest-SnapshotMetadataTestJSON-177948815 None] Lock "cinder-quobyte-ee0221eb-4481-4b96-850f-4ae995b44377" released by "delete_volume" :: held 1.281s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:53:18 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-94a3408c-43a8-4978-94de-793494eaa996 tempest-SnapshotMetadataTestJSON-177948815 None] Created reservations ['fffc915e-f657-4d0d-929b-4769c843ee62', 'da4ee8bf-6b98-4dca-8bcb-3d16d4ab5bf7', '6a9d43af-83ee-4964-b3b0-4fe42f1decbf', 'fdf62afd-8882-4ce6-9fc3-f0ca00da7146'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 17:53:18 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-94a3408c-43a8-4978-94de-793494eaa996 tempest-SnapshotMetadataTestJSON-177948815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:53:18 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-94a3408c-43a8-4978-94de-793494eaa996 tempest-SnapshotMetadataTestJSON-177948815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:53:18 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-94a3408c-43a8-4978-94de-793494eaa996 tempest-SnapshotMetadataTestJSON-177948815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:53:18 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-94a3408c-43a8-4978-94de-793494eaa996 tempest-SnapshotMetadataTestJSON-177948815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:53:18 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-94a3408c-43a8-4978-94de-793494eaa996 tempest-SnapshotMetadataTestJSON-177948815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:53:18 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-94a3408c-43a8-4978-94de-793494eaa996 tempest-SnapshotMetadataTestJSON-177948815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:53:18 devstack sudo[86055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 Apr 22 17:53:18 devstack sudo[86055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:53:18 devstack sudo[86047]: pam_unix(sudo:session): session closed for user root Apr 22 17:53:18 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-b67f8733-a807-4961-ae75-86bf1d2902c3 tempest-GroupSnapshotsTest-38718681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-230319e2-0e34-43c5-af0a-60bbac4e377d 1073741824" returned: 0 in 0.773s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:53:18 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-614cc9ce-d144-4377-bcc1-cf62f2f40285 tempest-SnapshotsActionsTest-1651779649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:53:18 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-b67f8733-a807-4961-ae75-86bf1d2902c3 tempest-GroupSnapshotsTest-38718681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-230319e2-0e34-43c5-af0a-60bbac4e377d {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:53:18 devstack sudo[86057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-230319e2-0e34-43c5-af0a-60bbac4e377d Apr 22 17:53:18 devstack sudo[86057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:53:18 devstack sudo[86055]: pam_unix(sudo:session): session closed for user root Apr 22 17:53:18 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-94a3408c-43a8-4978-94de-793494eaa996 tempest-SnapshotMetadataTestJSON-177948815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33" returned: 0 in 0.527s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:53:18 devstack cinder-volume[81771]: DEBUG cinder.manager [None req-94a3408c-43a8-4978-94de-793494eaa996 tempest-SnapshotMetadataTestJSON-177948815 None] Notifying Schedulers of capabilities ... {{(pid=81771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 17:53:18 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-94a3408c-43a8-4978-94de-793494eaa996 tempest-SnapshotMetadataTestJSON-177948815 None] Deleted volume successfully. Apr 22 17:53:18 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-94a3408c-43a8-4978-94de-793494eaa996 tempest-SnapshotMetadataTestJSON-177948815 None] Lock "cinder-ee0221eb-4481-4b96-850f-4ae995b44377-delete_volume" released by "delete_volume" :: held 2.054s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:53:18 devstack sudo[86057]: pam_unix(sudo:session): session closed for user root Apr 22 17:53:18 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-b67f8733-a807-4961-ae75-86bf1d2902c3 tempest-GroupSnapshotsTest-38718681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-230319e2-0e34-43c5-af0a-60bbac4e377d" returned: 0 in 0.524s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:53:18 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-b67f8733-a807-4961-ae75-86bf1d2902c3 tempest-GroupSnapshotsTest-38718681 None] <== create_volume: return (1336ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'} {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 17:53:18 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-b67f8733-a807-4961-ae75-86bf1d2902c3 tempest-GroupSnapshotsTest-38718681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.340s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:53:18 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-614cc9ce-d144-4377-bcc1-cf62f2f40285 tempest-SnapshotsActionsTest-1651779649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.532s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:53:18 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-b67f8733-a807-4961-ae75-86bf1d2902c3 tempest-GroupSnapshotsTest-38718681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c1229e2-ed2d-4e80-ba35-93559494aa45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-230319e2-0e34-43c5-af0a-60bbac4e377d', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:53:18 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-b67f8733-a807-4961-ae75-86bf1d2902c3 tempest-GroupSnapshotsTest-38718681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c388bf4b-7dff-4b47-8ef4-2dcaa1543c9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:53:18 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-614cc9ce-d144-4377-bcc1-cf62f2f40285 tempest-SnapshotsActionsTest-1651779649 None] Creating offline snapshot 45d921d6-8f00-483b-9870-d8741deb813b of volume 58cd87d4-3c93-4a3c-a3f7-1bda6cea508d {{(pid=81771) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 22 17:53:18 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-b67f8733-a807-4961-ae75-86bf1d2902c3 tempest-GroupSnapshotsTest-38718681 None] Volume volume-230319e2-0e34-43c5-af0a-60bbac4e377d (230319e2-0e34-43c5-af0a-60bbac4e377d): created successfully Apr 22 17:53:18 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-b67f8733-a807-4961-ae75-86bf1d2902c3 tempest-GroupSnapshotsTest-38718681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c388bf4b-7dff-4b47-8ef4-2dcaa1543c9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:53:18 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-b67f8733-a807-4961-ae75-86bf1d2902c3 tempest-GroupSnapshotsTest-38718681 None] Flow 'volume_create_manager' (9bbc9c14-c17c-4ff9-bc81-d02cde17a8ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:53:18 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[04580987-c6c0-48dc-9e11-88ce61542cc6]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:53:18 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-614cc9ce-d144-4377-bcc1-cf62f2f40285 tempest-SnapshotsActionsTest-1651779649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:53:18 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-b67f8733-a807-4961-ae75-86bf1d2902c3 tempest-GroupSnapshotsTest-38718681 None] Created volume successfully. Apr 22 17:53:19 devstack sudo[86061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d Apr 22 17:53:19 devstack sudo[86061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:53:19 devstack sudo[86061]: pam_unix(sudo:session): session closed for user root Apr 22 17:53:19 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-614cc9ce-d144-4377-bcc1-cf62f2f40285 tempest-SnapshotsActionsTest-1651779649 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d" returned: 0 in 0.647s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:53:19 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-614cc9ce-d144-4377-bcc1-cf62f2f40285 tempest-SnapshotsActionsTest-1651779649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.45d921d6-8f00-483b-9870-d8741deb813b 1G {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:53:19 devstack sudo[86072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.45d921d6-8f00-483b-9870-d8741deb813b 1G Apr 22 17:53:19 devstack sudo[86072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:53:20 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-98449b31-3c48-4392-808f-62ba2c1aa5c3 tempest-GroupSnapshotsTest-38718681 None] GroupSnapshot 0b87c521-e9d5-41c3-8bc9-38af60f99ab6: creating. Apr 22 17:53:20 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-98449b31-3c48-4392-808f-62ba2c1aa5c3 tempest-GroupSnapshotsTest-38718681 None] Group snapshot 0b87c521-e9d5-41c3-8bc9-38af60f99ab6: creating. {{(pid=81771) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 22 17:53:20 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-98449b31-3c48-4392-808f-62ba2c1aa5c3 tempest-GroupSnapshotsTest-38718681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:53:20 devstack sudo[86072]: pam_unix(sudo:session): session closed for user root Apr 22 17:53:20 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-614cc9ce-d144-4377-bcc1-cf62f2f40285 tempest-SnapshotsActionsTest-1651779649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.45d921d6-8f00-483b-9870-d8741deb813b 1G" returned: 0 in 0.945s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:53:20 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-614cc9ce-d144-4377-bcc1-cf62f2f40285 tempest-SnapshotsActionsTest-1651779649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d -F qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.45d921d6-8f00-483b-9870-d8741deb813b {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:53:20 devstack sudo[86098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d -F qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.45d921d6-8f00-483b-9870-d8741deb813b Apr 22 17:53:20 devstack sudo[86098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:53:21 devstack sudo[86098]: pam_unix(sudo:session): session closed for user root Apr 22 17:53:21 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-614cc9ce-d144-4377-bcc1-cf62f2f40285 tempest-SnapshotsActionsTest-1651779649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d -F qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.45d921d6-8f00-483b-9870-d8741deb813b" returned: 0 in 0.864s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:53:21 devstack cinder-volume[81771]: WARNING cinder.volume.drivers.remotefs [None req-614cc9ce-d144-4377-bcc1-cf62f2f40285 tempest-SnapshotsActionsTest-1651779649 None] /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.45d921d6-8f00-483b-9870-d8741deb813b is being set with open permissions: ugo+rw Apr 22 17:53:21 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-614cc9ce-d144-4377-bcc1-cf62f2f40285 tempest-SnapshotsActionsTest-1651779649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.45d921d6-8f00-483b-9870-d8741deb813b {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:53:21 devstack sudo[86120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.45d921d6-8f00-483b-9870-d8741deb813b Apr 22 17:53:21 devstack sudo[86120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:53:22 devstack sudo[86120]: pam_unix(sudo:session): session closed for user root Apr 22 17:53:22 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-614cc9ce-d144-4377-bcc1-cf62f2f40285 tempest-SnapshotsActionsTest-1651779649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.45d921d6-8f00-483b-9870-d8741deb813b" returned: 0 in 0.665s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:53:22 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-614cc9ce-d144-4377-bcc1-cf62f2f40285 tempest-SnapshotsActionsTest-1651779649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.info {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:53:22 devstack sudo[86124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.info Apr 22 17:53:22 devstack sudo[86124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:53:22 devstack cinder-volume[81771]: DEBUG cinder.volume.flows.manager.create_volume [None req-69e0fc15-f781-4836-862e-646da9d1c979 tempest-VolumesMetadataTest-1535840800 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 17:53:22 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-69e0fc15-f781-4836-862e-646da9d1c979 tempest-VolumesMetadataTest-1535840800 None] Flow 'volume_create_manager' (618d0c62-138f-4ef3-8cc3-bfe1cc62619d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:53:22 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-69e0fc15-f781-4836-862e-646da9d1c979 tempest-VolumesMetadataTest-1535840800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5f29042-bde6-43f1-9ad5-f2152238e8c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:53:22 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-69e0fc15-f781-4836-862e-646da9d1c979 tempest-VolumesMetadataTest-1535840800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5f29042-bde6-43f1-9ad5-f2152238e8c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:53:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-487863875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e8e3b90-b7ad-4738-9ed4-7818bcad7726,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6f2fb2f148142ca959ba65630d7a2a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:53:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:53:23Z,use_quota=True,user_id='722472a21c0e4d1bb6d56a150496fcb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:53:22 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-69e0fc15-f781-4836-862e-646da9d1c979 tempest-VolumesMetadataTest-1535840800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5393006c-a36a-4ec2-987d-e1e0dcea3aaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:53:22 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-69e0fc15-f781-4836-862e-646da9d1c979 tempest-VolumesMetadataTest-1535840800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5393006c-a36a-4ec2-987d-e1e0dcea3aaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:53:22 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-69e0fc15-f781-4836-862e-646da9d1c979 tempest-VolumesMetadataTest-1535840800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (349b12c0-bdec-459a-9715-df5d8f5010c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:53:22 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-69e0fc15-f781-4836-862e-646da9d1c979 tempest-VolumesMetadataTest-1535840800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (349b12c0-bdec-459a-9715-df5d8f5010c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e8e3b90-b7ad-4738-9ed4-7818bcad7726', 'volume_name': 'volume-5e8e3b90-b7ad-4738-9ed4-7818bcad7726', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:53:22 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-69e0fc15-f781-4836-862e-646da9d1c979 tempest-VolumesMetadataTest-1535840800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23c68cae-46a4-49d7-a271-5bd09346ae92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:53:22 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-69e0fc15-f781-4836-862e-646da9d1c979 tempest-VolumesMetadataTest-1535840800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23c68cae-46a4-49d7-a271-5bd09346ae92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:53:22 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-69e0fc15-f781-4836-862e-646da9d1c979 tempest-VolumesMetadataTest-1535840800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c66ba364-57fb-4581-826e-5fa88d453a69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:53:22 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-69e0fc15-f781-4836-862e-646da9d1c979 tempest-VolumesMetadataTest-1535840800 None] Volume 5e8e3b90-b7ad-4738-9ed4-7818bcad7726: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e8e3b90-b7ad-4738-9ed4-7818bcad7726', 'volume_size': 1} Apr 22 17:53:22 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-69e0fc15-f781-4836-862e-646da9d1c979 tempest-VolumesMetadataTest-1535840800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:53:22 devstack sudo[86124]: pam_unix(sudo:session): session closed for user root Apr 22 17:53:22 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-614cc9ce-d144-4377-bcc1-cf62f2f40285 tempest-SnapshotsActionsTest-1651779649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.info" returned: 0 in 0.650s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:53:22 devstack cinder-volume[81771]: WARNING cinder.volume.drivers.remotefs [None req-614cc9ce-d144-4377-bcc1-cf62f2f40285 tempest-SnapshotsActionsTest-1651779649 None] /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.info is being set with open permissions: ugo+rw Apr 22 17:53:22 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-614cc9ce-d144-4377-bcc1-cf62f2f40285 tempest-SnapshotsActionsTest-1651779649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.info {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:53:22 devstack sudo[86127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.info Apr 22 17:53:22 devstack sudo[86127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:53:23 devstack sudo[86127]: pam_unix(sudo:session): session closed for user root Apr 22 17:53:23 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-614cc9ce-d144-4377-bcc1-cf62f2f40285 tempest-SnapshotsActionsTest-1651779649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.info" returned: 0 in 0.686s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:53:23 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-614cc9ce-d144-4377-bcc1-cf62f2f40285 tempest-SnapshotsActionsTest-1651779649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.604s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:53:23 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-98449b31-3c48-4392-808f-62ba2c1aa5c3 tempest-GroupSnapshotsTest-38718681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.352s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:53:23 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-98449b31-3c48-4392-808f-62ba2c1aa5c3 tempest-GroupSnapshotsTest-38718681 None] Creating offline snapshot fd566f10-0f6a-45cd-a297-11db4fcac56f of volume 230319e2-0e34-43c5-af0a-60bbac4e377d {{(pid=81771) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 22 17:53:23 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-614cc9ce-d144-4377-bcc1-cf62f2f40285 tempest-SnapshotsActionsTest-1651779649 None] Create snapshot completed successfully Apr 22 17:53:23 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[0526cbdf-6fce-4ce4-96bb-475aa9219316]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:53:23 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-98449b31-3c48-4392-808f-62ba2c1aa5c3 tempest-GroupSnapshotsTest-38718681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-230319e2-0e34-43c5-af0a-60bbac4e377d {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:53:23 devstack sudo[86131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-230319e2-0e34-43c5-af0a-60bbac4e377d Apr 22 17:53:23 devstack sudo[86131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:53:24 devstack sudo[86131]: pam_unix(sudo:session): session closed for user root Apr 22 17:53:24 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-98449b31-3c48-4392-808f-62ba2c1aa5c3 tempest-GroupSnapshotsTest-38718681 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-230319e2-0e34-43c5-af0a-60bbac4e377d" returned: 0 in 0.976s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:53:24 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-98449b31-3c48-4392-808f-62ba2c1aa5c3 tempest-GroupSnapshotsTest-38718681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-230319e2-0e34-43c5-af0a-60bbac4e377d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-230319e2-0e34-43c5-af0a-60bbac4e377d.fd566f10-0f6a-45cd-a297-11db4fcac56f 1G {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:53:24 devstack sudo[86136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-230319e2-0e34-43c5-af0a-60bbac4e377d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-230319e2-0e34-43c5-af0a-60bbac4e377d.fd566f10-0f6a-45cd-a297-11db4fcac56f 1G Apr 22 17:53:24 devstack sudo[86136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:53:24 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-9f31fa67-0919-46ae-b74a-21bc237fc573 tempest-SnapshotsActionsTest-1651779649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:53:25 devstack sudo[86136]: pam_unix(sudo:session): session closed for user root Apr 22 17:53:25 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-98449b31-3c48-4392-808f-62ba2c1aa5c3 tempest-GroupSnapshotsTest-38718681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-230319e2-0e34-43c5-af0a-60bbac4e377d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-230319e2-0e34-43c5-af0a-60bbac4e377d.fd566f10-0f6a-45cd-a297-11db4fcac56f 1G" returned: 0 in 0.867s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:53:25 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-98449b31-3c48-4392-808f-62ba2c1aa5c3 tempest-GroupSnapshotsTest-38718681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-230319e2-0e34-43c5-af0a-60bbac4e377d -F qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-230319e2-0e34-43c5-af0a-60bbac4e377d.fd566f10-0f6a-45cd-a297-11db4fcac56f {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:53:25 devstack sudo[86142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-230319e2-0e34-43c5-af0a-60bbac4e377d -F qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-230319e2-0e34-43c5-af0a-60bbac4e377d.fd566f10-0f6a-45cd-a297-11db4fcac56f Apr 22 17:53:25 devstack sudo[86142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:53:25 devstack sudo[86142]: pam_unix(sudo:session): session closed for user root Apr 22 17:53:25 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-98449b31-3c48-4392-808f-62ba2c1aa5c3 tempest-GroupSnapshotsTest-38718681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-230319e2-0e34-43c5-af0a-60bbac4e377d -F qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-230319e2-0e34-43c5-af0a-60bbac4e377d.fd566f10-0f6a-45cd-a297-11db4fcac56f" returned: 0 in 0.573s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:53:25 devstack cinder-volume[81771]: WARNING cinder.volume.drivers.remotefs [None req-98449b31-3c48-4392-808f-62ba2c1aa5c3 tempest-GroupSnapshotsTest-38718681 None] /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-230319e2-0e34-43c5-af0a-60bbac4e377d.fd566f10-0f6a-45cd-a297-11db4fcac56f is being set with open permissions: ugo+rw: NotImplementedError Apr 22 17:53:25 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-98449b31-3c48-4392-808f-62ba2c1aa5c3 tempest-GroupSnapshotsTest-38718681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-230319e2-0e34-43c5-af0a-60bbac4e377d.fd566f10-0f6a-45cd-a297-11db4fcac56f {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:53:25 devstack sudo[86147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-230319e2-0e34-43c5-af0a-60bbac4e377d.fd566f10-0f6a-45cd-a297-11db4fcac56f Apr 22 17:53:25 devstack sudo[86147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:53:26 devstack sudo[86147]: pam_unix(sudo:session): session closed for user root Apr 22 17:53:26 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-98449b31-3c48-4392-808f-62ba2c1aa5c3 tempest-GroupSnapshotsTest-38718681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-230319e2-0e34-43c5-af0a-60bbac4e377d.fd566f10-0f6a-45cd-a297-11db4fcac56f" returned: 0 in 0.554s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:53:26 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-98449b31-3c48-4392-808f-62ba2c1aa5c3 tempest-GroupSnapshotsTest-38718681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-230319e2-0e34-43c5-af0a-60bbac4e377d.info {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:53:26 devstack sudo[86150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-230319e2-0e34-43c5-af0a-60bbac4e377d.info Apr 22 17:53:26 devstack sudo[86150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:53:27 devstack sudo[86150]: pam_unix(sudo:session): session closed for user root Apr 22 17:53:27 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-98449b31-3c48-4392-808f-62ba2c1aa5c3 tempest-GroupSnapshotsTest-38718681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-230319e2-0e34-43c5-af0a-60bbac4e377d.info" returned: 0 in 0.512s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:53:27 devstack cinder-volume[81771]: WARNING cinder.volume.drivers.remotefs [None req-98449b31-3c48-4392-808f-62ba2c1aa5c3 tempest-GroupSnapshotsTest-38718681 None] /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-230319e2-0e34-43c5-af0a-60bbac4e377d.info is being set with open permissions: ugo+rw: NotImplementedError Apr 22 17:53:27 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-98449b31-3c48-4392-808f-62ba2c1aa5c3 tempest-GroupSnapshotsTest-38718681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-230319e2-0e34-43c5-af0a-60bbac4e377d.info {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:53:27 devstack sudo[86154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-230319e2-0e34-43c5-af0a-60bbac4e377d.info Apr 22 17:53:27 devstack sudo[86154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:53:27 devstack sudo[86154]: pam_unix(sudo:session): session closed for user root Apr 22 17:53:27 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-98449b31-3c48-4392-808f-62ba2c1aa5c3 tempest-GroupSnapshotsTest-38718681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-230319e2-0e34-43c5-af0a-60bbac4e377d.info" returned: 0 in 0.443s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:53:27 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-98449b31-3c48-4392-808f-62ba2c1aa5c3 tempest-GroupSnapshotsTest-38718681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.073s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:53:27 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-69e0fc15-f781-4836-862e-646da9d1c979 tempest-VolumesMetadataTest-1535840800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.845s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:53:27 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-69e0fc15-f781-4836-862e-646da9d1c979 tempest-VolumesMetadataTest-1535840800 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:53:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-487863875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e8e3b90-b7ad-4738-9ed4-7818bcad7726,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6f2fb2f148142ca959ba65630d7a2a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:53:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:53:23Z,use_quota=True,user_id='722472a21c0e4d1bb6d56a150496fcb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)}" {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 17:53:27 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-69e0fc15-f781-4836-862e-646da9d1c979 tempest-VolumesMetadataTest-1535840800 None] Creating volume 5e8e3b90-b7ad-4738-9ed4-7818bcad7726 {{(pid=81771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 17:53:27 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-69e0fc15-f781-4836-862e-646da9d1c979 tempest-VolumesMetadataTest-1535840800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:53:27 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-69e0fc15-f781-4836-862e-646da9d1c979 tempest-VolumesMetadataTest-1535840800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:53:27 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-69e0fc15-f781-4836-862e-646da9d1c979 tempest-VolumesMetadataTest-1535840800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:53:27 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-69e0fc15-f781-4836-862e-646da9d1c979 tempest-VolumesMetadataTest-1535840800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:53:27 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-69e0fc15-f781-4836-862e-646da9d1c979 tempest-VolumesMetadataTest-1535840800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:53:27 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-69e0fc15-f781-4836-862e-646da9d1c979 tempest-VolumesMetadataTest-1535840800 None] Selected osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 as target Quobyte volume. {{(pid=81771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 17:53:27 devstack cinder-volume[81771]: INFO cinder.volume.drivers.remotefs [None req-69e0fc15-f781-4836-862e-646da9d1c979 tempest-VolumesMetadataTest-1535840800 None] casted to osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 Apr 22 17:53:27 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-69e0fc15-f781-4836-862e-646da9d1c979 tempest-VolumesMetadataTest-1535840800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-5e8e3b90-b7ad-4738-9ed4-7818bcad7726 1073741824 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:53:27 devstack sudo[86157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-5e8e3b90-b7ad-4738-9ed4-7818bcad7726 1073741824 Apr 22 17:53:27 devstack sudo[86157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:53:27 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-98449b31-3c48-4392-808f-62ba2c1aa5c3 tempest-GroupSnapshotsTest-38718681 None] group_snapshot 0b87c521-e9d5-41c3-8bc9-38af60f99ab6: created successfully Apr 22 17:53:28 devstack sudo[86157]: pam_unix(sudo:session): session closed for user root Apr 22 17:53:28 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-69e0fc15-f781-4836-862e-646da9d1c979 tempest-VolumesMetadataTest-1535840800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-5e8e3b90-b7ad-4738-9ed4-7818bcad7726 1073741824" returned: 0 in 0.643s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:53:28 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-69e0fc15-f781-4836-862e-646da9d1c979 tempest-VolumesMetadataTest-1535840800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-5e8e3b90-b7ad-4738-9ed4-7818bcad7726 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:53:28 devstack sudo[86162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-5e8e3b90-b7ad-4738-9ed4-7818bcad7726 Apr 22 17:53:28 devstack sudo[86162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:53:28 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-6a87a996-3262-4441-aa12-265019b2879a tempest-GroupSnapshotsTest-38718681 None] group_snapshot 0b87c521-e9d5-41c3-8bc9-38af60f99ab6: deleting Apr 22 17:53:28 devstack sudo[86162]: pam_unix(sudo:session): session closed for user root Apr 22 17:53:28 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-69e0fc15-f781-4836-862e-646da9d1c979 tempest-VolumesMetadataTest-1535840800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-5e8e3b90-b7ad-4738-9ed4-7818bcad7726" returned: 0 in 0.561s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:53:28 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-69e0fc15-f781-4836-862e-646da9d1c979 tempest-VolumesMetadataTest-1535840800 None] <== create_volume: return (1261ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'} {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 17:53:28 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-69e0fc15-f781-4836-862e-646da9d1c979 tempest-VolumesMetadataTest-1535840800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.266s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:53:28 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-9f31fa67-0919-46ae-b74a-21bc237fc573 tempest-SnapshotsActionsTest-1651779649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.127s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:53:28 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-6a87a996-3262-4441-aa12-265019b2879a tempest-GroupSnapshotsTest-38718681 None] group_snapshot 0b87c521-e9d5-41c3-8bc9-38af60f99ab6: deleting {{(pid=81771) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 22 17:53:28 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-69e0fc15-f781-4836-862e-646da9d1c979 tempest-VolumesMetadataTest-1535840800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c66ba364-57fb-4581-826e-5fa88d453a69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e8e3b90-b7ad-4738-9ed4-7818bcad7726', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:53:28 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-69e0fc15-f781-4836-862e-646da9d1c979 tempest-VolumesMetadataTest-1535840800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (572dde92-003d-4cdb-9c8d-1113dbf7d833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:53:28 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-6a87a996-3262-4441-aa12-265019b2879a tempest-GroupSnapshotsTest-38718681 None] Acquiring lock "cinder-quobyte-230319e2-0e34-43c5-af0a-60bbac4e377d" by "delete_snapshot" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:53:28 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-9f31fa67-0919-46ae-b74a-21bc237fc573 tempest-SnapshotsActionsTest-1651779649 None] Creating offline snapshot f74f41df-c885-436b-99b1-e01274daf334 of volume 58cd87d4-3c93-4a3c-a3f7-1bda6cea508d {{(pid=81771) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 22 17:53:28 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-69e0fc15-f781-4836-862e-646da9d1c979 tempest-VolumesMetadataTest-1535840800 None] Volume volume-5e8e3b90-b7ad-4738-9ed4-7818bcad7726 (5e8e3b90-b7ad-4738-9ed4-7818bcad7726): created successfully Apr 22 17:53:28 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-69e0fc15-f781-4836-862e-646da9d1c979 tempest-VolumesMetadataTest-1535840800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (572dde92-003d-4cdb-9c8d-1113dbf7d833) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:53:29 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-69e0fc15-f781-4836-862e-646da9d1c979 tempest-VolumesMetadataTest-1535840800 None] Flow 'volume_create_manager' (618d0c62-138f-4ef3-8cc3-bfe1cc62619d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:53:29 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b345f45-f7c0-4509-9905-4858c5ce25a8]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:53:29 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-9f31fa67-0919-46ae-b74a-21bc237fc573 tempest-SnapshotsActionsTest-1651779649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.45d921d6-8f00-483b-9870-d8741deb813b {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:53:29 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-69e0fc15-f781-4836-862e-646da9d1c979 tempest-VolumesMetadataTest-1535840800 None] Created volume successfully. Apr 22 17:53:29 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-6a87a996-3262-4441-aa12-265019b2879a tempest-GroupSnapshotsTest-38718681 None] Lock "cinder-quobyte-230319e2-0e34-43c5-af0a-60bbac4e377d" acquired by "delete_snapshot" :: waited 0.178s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:53:29 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-6a87a996-3262-4441-aa12-265019b2879a tempest-GroupSnapshotsTest-38718681 None] Acquiring lock "cinder-quobyte-fd566f10-0f6a-45cd-a297-11db4fcac56f" by "_delete_snapshot" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:53:29 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-6a87a996-3262-4441-aa12-265019b2879a tempest-GroupSnapshotsTest-38718681 None] Lock "cinder-quobyte-fd566f10-0f6a-45cd-a297-11db4fcac56f" acquired by "_delete_snapshot" :: waited 0.049s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:53:29 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-6a87a996-3262-4441-aa12-265019b2879a tempest-GroupSnapshotsTest-38718681 None] Deleting offline snapshot fd566f10-0f6a-45cd-a297-11db4fcac56f of volume 230319e2-0e34-43c5-af0a-60bbac4e377d {{(pid=81771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 22 17:53:29 devstack sudo[86177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.45d921d6-8f00-483b-9870-d8741deb813b Apr 22 17:53:29 devstack sudo[86177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:53:29 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-6a87a996-3262-4441-aa12-265019b2879a tempest-GroupSnapshotsTest-38718681 None] snapshot_file for this snap is: volume-230319e2-0e34-43c5-af0a-60bbac4e377d.fd566f10-0f6a-45cd-a297-11db4fcac56f {{(pid=81771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 22 17:53:29 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dd6560a-560b-4505-acee-fcd0dcf8e88f]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:53:29 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-6a87a996-3262-4441-aa12-265019b2879a tempest-GroupSnapshotsTest-38718681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-230319e2-0e34-43c5-af0a-60bbac4e377d.fd566f10-0f6a-45cd-a297-11db4fcac56f {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:53:29 devstack sudo[86198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-230319e2-0e34-43c5-af0a-60bbac4e377d.fd566f10-0f6a-45cd-a297-11db4fcac56f Apr 22 17:53:29 devstack sudo[86198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:53:29 devstack sudo[86177]: pam_unix(sudo:session): session closed for user root Apr 22 17:53:29 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-9f31fa67-0919-46ae-b74a-21bc237fc573 tempest-SnapshotsActionsTest-1651779649 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.45d921d6-8f00-483b-9870-d8741deb813b" returned: 0 in 0.678s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:53:29 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-9f31fa67-0919-46ae-b74a-21bc237fc573 tempest-SnapshotsActionsTest-1651779649 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81771) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 22 17:53:29 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-9f31fa67-0919-46ae-b74a-21bc237fc573 tempest-SnapshotsActionsTest-1651779649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.45d921d6-8f00-483b-9870-d8741deb813b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.f74f41df-c885-436b-99b1-e01274daf334 1G {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:53:29 devstack sudo[86212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.45d921d6-8f00-483b-9870-d8741deb813b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.f74f41df-c885-436b-99b1-e01274daf334 1G Apr 22 17:53:29 devstack sudo[86212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:53:29 devstack sudo[86198]: pam_unix(sudo:session): session closed for user root Apr 22 17:53:29 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-6a87a996-3262-4441-aa12-265019b2879a tempest-GroupSnapshotsTest-38718681 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-230319e2-0e34-43c5-af0a-60bbac4e377d.fd566f10-0f6a-45cd-a297-11db4fcac56f" returned: 0 in 0.658s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:53:29 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-6a87a996-3262-4441-aa12-265019b2879a tempest-GroupSnapshotsTest-38718681 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-230319e2-0e34-43c5-af0a-60bbac4e377d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81771) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 22 17:53:29 devstack cinder-volume[81771]: DEBUG oslo_service.periodic_task [None req-1a7bdab5-8190-4e00-a2e2-843e5894ab49 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81771) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 22 17:53:29 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-1a7bdab5-8190-4e00-a2e2-843e5894ab49 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:53:29 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-1a7bdab5-8190-4e00-a2e2-843e5894ab49 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:53:29 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-1a7bdab5-8190-4e00-a2e2-843e5894ab49 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:53:29 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-1a7bdab5-8190-4e00-a2e2-843e5894ab49 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:53:29 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-1a7bdab5-8190-4e00-a2e2-843e5894ab49 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:53:29 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-1a7bdab5-8190-4e00-a2e2-843e5894ab49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:53:29 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[51676014-3a5f-4767-8451-4581f514530e]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:53:29 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-6a87a996-3262-4441-aa12-265019b2879a tempest-GroupSnapshotsTest-38718681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-230319e2-0e34-43c5-af0a-60bbac4e377d {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:53:29 devstack sudo[86215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 Apr 22 17:53:29 devstack sudo[86215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:53:29 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-981ab80e-0205-4074-baad-0aa64754a2b0 tempest-VolumesMetadataTest-1535840800 None] Acquiring lock "cinder-5e8e3b90-b7ad-4738-9ed4-7818bcad7726-delete_volume" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:53:29 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-981ab80e-0205-4074-baad-0aa64754a2b0 tempest-VolumesMetadataTest-1535840800 None] Lock "cinder-5e8e3b90-b7ad-4738-9ed4-7818bcad7726-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:53:30 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-981ab80e-0205-4074-baad-0aa64754a2b0 tempest-VolumesMetadataTest-1535840800 None] Acquiring lock "cinder-quobyte-5e8e3b90-b7ad-4738-9ed4-7818bcad7726" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:53:30 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-981ab80e-0205-4074-baad-0aa64754a2b0 tempest-VolumesMetadataTest-1535840800 None] Lock "cinder-quobyte-5e8e3b90-b7ad-4738-9ed4-7818bcad7726" acquired by "delete_volume" :: waited 0.015s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:53:30 devstack sudo[86216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-230319e2-0e34-43c5-af0a-60bbac4e377d Apr 22 17:53:30 devstack sudo[86216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:53:30 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d5bc2eb-6a00-4bcb-8484-11e123e7d2d1]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:53:30 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-981ab80e-0205-4074-baad-0aa64754a2b0 tempest-VolumesMetadataTest-1535840800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-5e8e3b90-b7ad-4738-9ed4-7818bcad7726 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:53:30 devstack sudo[86219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-5e8e3b90-b7ad-4738-9ed4-7818bcad7726 Apr 22 17:53:30 devstack sudo[86219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:53:30 devstack sudo[86212]: pam_unix(sudo:session): session closed for user root Apr 22 17:53:30 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-9f31fa67-0919-46ae-b74a-21bc237fc573 tempest-SnapshotsActionsTest-1651779649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.45d921d6-8f00-483b-9870-d8741deb813b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.f74f41df-c885-436b-99b1-e01274daf334 1G" returned: 0 in 0.708s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:53:30 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-9f31fa67-0919-46ae-b74a-21bc237fc573 tempest-SnapshotsActionsTest-1651779649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.45d921d6-8f00-483b-9870-d8741deb813b -F qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.f74f41df-c885-436b-99b1-e01274daf334 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:53:30 devstack sudo[86225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.45d921d6-8f00-483b-9870-d8741deb813b -F qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.f74f41df-c885-436b-99b1-e01274daf334 Apr 22 17:53:30 devstack sudo[86225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:53:30 devstack sudo[86215]: pam_unix(sudo:session): session closed for user root Apr 22 17:53:30 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-1a7bdab5-8190-4e00-a2e2-843e5894ab49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33" returned: 0 in 0.718s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:53:30 devstack cinder-volume[81771]: DEBUG cinder.manager [None req-1a7bdab5-8190-4e00-a2e2-843e5894ab49 None None] Notifying Schedulers of capabilities ... {{(pid=81771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 17:53:30 devstack sudo[86216]: pam_unix(sudo:session): session closed for user root Apr 22 17:53:30 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-6a87a996-3262-4441-aa12-265019b2879a tempest-GroupSnapshotsTest-38718681 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-230319e2-0e34-43c5-af0a-60bbac4e377d" returned: 0 in 0.797s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:53:30 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-6a87a996-3262-4441-aa12-265019b2879a tempest-GroupSnapshotsTest-38718681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-230319e2-0e34-43c5-af0a-60bbac4e377d.fd566f10-0f6a-45cd-a297-11db4fcac56f {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:53:30 devstack sudo[86230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-230319e2-0e34-43c5-af0a-60bbac4e377d.fd566f10-0f6a-45cd-a297-11db4fcac56f Apr 22 17:53:30 devstack sudo[86230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:53:30 devstack sudo[86219]: pam_unix(sudo:session): session closed for user root Apr 22 17:53:30 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-981ab80e-0205-4074-baad-0aa64754a2b0 tempest-VolumesMetadataTest-1535840800 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-5e8e3b90-b7ad-4738-9ed4-7818bcad7726" returned: 0 in 0.879s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:53:30 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-981ab80e-0205-4074-baad-0aa64754a2b0 tempest-VolumesMetadataTest-1535840800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-5e8e3b90-b7ad-4738-9ed4-7818bcad7726 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:53:30 devstack sudo[86235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-5e8e3b90-b7ad-4738-9ed4-7818bcad7726 Apr 22 17:53:30 devstack sudo[86235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:53:31 devstack sudo[86225]: pam_unix(sudo:session): session closed for user root Apr 22 17:53:31 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-9f31fa67-0919-46ae-b74a-21bc237fc573 tempest-SnapshotsActionsTest-1651779649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.45d921d6-8f00-483b-9870-d8741deb813b -F qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.f74f41df-c885-436b-99b1-e01274daf334" returned: 0 in 0.729s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:53:31 devstack cinder-volume[81771]: WARNING cinder.volume.drivers.remotefs [None req-9f31fa67-0919-46ae-b74a-21bc237fc573 tempest-SnapshotsActionsTest-1651779649 None] /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.f74f41df-c885-436b-99b1-e01274daf334 is being set with open permissions: ugo+rw Apr 22 17:53:31 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-9f31fa67-0919-46ae-b74a-21bc237fc573 tempest-SnapshotsActionsTest-1651779649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.f74f41df-c885-436b-99b1-e01274daf334 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:53:31 devstack sudo[86246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.f74f41df-c885-436b-99b1-e01274daf334 Apr 22 17:53:31 devstack sudo[86246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:53:31 devstack sudo[86230]: pam_unix(sudo:session): session closed for user root Apr 22 17:53:31 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-6a87a996-3262-4441-aa12-265019b2879a tempest-GroupSnapshotsTest-38718681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-230319e2-0e34-43c5-af0a-60bbac4e377d.fd566f10-0f6a-45cd-a297-11db4fcac56f" returned: 0 in 0.666s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:53:31 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-6a87a996-3262-4441-aa12-265019b2879a tempest-GroupSnapshotsTest-38718681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-230319e2-0e34-43c5-af0a-60bbac4e377d.fd566f10-0f6a-45cd-a297-11db4fcac56f {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:53:31 devstack sudo[86257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-230319e2-0e34-43c5-af0a-60bbac4e377d.fd566f10-0f6a-45cd-a297-11db4fcac56f Apr 22 17:53:31 devstack sudo[86257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:53:31 devstack sudo[86235]: pam_unix(sudo:session): session closed for user root Apr 22 17:53:31 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-981ab80e-0205-4074-baad-0aa64754a2b0 tempest-VolumesMetadataTest-1535840800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-5e8e3b90-b7ad-4738-9ed4-7818bcad7726" returned: 0 in 0.547s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:53:31 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-981ab80e-0205-4074-baad-0aa64754a2b0 tempest-VolumesMetadataTest-1535840800 None] Lock "cinder-quobyte-5e8e3b90-b7ad-4738-9ed4-7818bcad7726" released by "delete_volume" :: held 1.464s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:53:31 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-981ab80e-0205-4074-baad-0aa64754a2b0 tempest-VolumesMetadataTest-1535840800 None] Created reservations ['d6292def-2110-4d8e-a6c9-d6f359cdaac6', '0bbe5c3c-8abf-4051-90ef-4c280ac61318', '47626223-8b79-46ea-8e8c-b5069e4d0f18', '6c9a0258-c94e-4258-a60a-3c91e793638c'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 17:53:31 devstack sudo[86246]: pam_unix(sudo:session): session closed for user root Apr 22 17:53:31 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-9f31fa67-0919-46ae-b74a-21bc237fc573 tempest-SnapshotsActionsTest-1651779649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.f74f41df-c885-436b-99b1-e01274daf334" returned: 0 in 0.503s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:53:31 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-981ab80e-0205-4074-baad-0aa64754a2b0 tempest-VolumesMetadataTest-1535840800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:53:31 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-981ab80e-0205-4074-baad-0aa64754a2b0 tempest-VolumesMetadataTest-1535840800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:53:31 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-981ab80e-0205-4074-baad-0aa64754a2b0 tempest-VolumesMetadataTest-1535840800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:53:31 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-981ab80e-0205-4074-baad-0aa64754a2b0 tempest-VolumesMetadataTest-1535840800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:53:31 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-981ab80e-0205-4074-baad-0aa64754a2b0 tempest-VolumesMetadataTest-1535840800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:53:31 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-981ab80e-0205-4074-baad-0aa64754a2b0 tempest-VolumesMetadataTest-1535840800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:53:31 devstack sudo[86266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 Apr 22 17:53:31 devstack sudo[86266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:53:31 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-9f31fa67-0919-46ae-b74a-21bc237fc573 tempest-SnapshotsActionsTest-1651779649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.906s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:53:31 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-9f31fa67-0919-46ae-b74a-21bc237fc573 tempest-SnapshotsActionsTest-1651779649 None] Create snapshot completed successfully Apr 22 17:53:31 devstack sudo[86257]: pam_unix(sudo:session): session closed for user root Apr 22 17:53:31 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-6a87a996-3262-4441-aa12-265019b2879a tempest-GroupSnapshotsTest-38718681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-230319e2-0e34-43c5-af0a-60bbac4e377d.fd566f10-0f6a-45cd-a297-11db4fcac56f" returned: 0 in 0.543s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:53:31 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-6a87a996-3262-4441-aa12-265019b2879a tempest-GroupSnapshotsTest-38718681 None] Lock "cinder-quobyte-fd566f10-0f6a-45cd-a297-11db4fcac56f" released by "_delete_snapshot" :: held 2.811s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:53:31 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-6a87a996-3262-4441-aa12-265019b2879a tempest-GroupSnapshotsTest-38718681 None] Lock "cinder-quobyte-230319e2-0e34-43c5-af0a-60bbac4e377d" released by "delete_snapshot" :: held 2.871s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:53:32 devstack cinder-volume[81771]: WARNING cinder.quota [None req-6a87a996-3262-4441-aa12-265019b2879a tempest-GroupSnapshotsTest-38718681 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-595194811 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-595194811, it is now deprecated. Please use the default quota class for default quota. Apr 22 17:53:32 devstack cinder-volume[81771]: WARNING cinder.quota [None req-6a87a996-3262-4441-aa12-265019b2879a tempest-GroupSnapshotsTest-38718681 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-595194811 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-595194811, it is now deprecated. Please use the default quota class for default quota. Apr 22 17:53:32 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-6a87a996-3262-4441-aa12-265019b2879a tempest-GroupSnapshotsTest-38718681 None] Created reservations ['bbbd1877-45a6-48c6-ac84-fb491eff8fb0', '6c38fa60-6424-4018-9590-fc706d71b350', 'e604124f-e80e-4535-9f30-e0f492cbde1a', '01de60d6-881c-45f9-9e26-8eb6be91d971'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 17:53:32 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-6a87a996-3262-4441-aa12-265019b2879a tempest-GroupSnapshotsTest-38718681 None] group_snapshot 0b87c521-e9d5-41c3-8bc9-38af60f99ab6: deleted successfully Apr 22 17:53:32 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-698dbc66-58af-49de-97c1-02a9f000fe85 tempest-SnapshotsActionsTest-13922162 None] Acquiring lock "cinder-f74f41df-c885-436b-99b1-e01274daf334-delete_snapshot" by "delete_snapshot" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:53:32 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-698dbc66-58af-49de-97c1-02a9f000fe85 tempest-SnapshotsActionsTest-13922162 None] Lock "cinder-f74f41df-c885-436b-99b1-e01274daf334-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:53:32 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-698dbc66-58af-49de-97c1-02a9f000fe85 tempest-SnapshotsActionsTest-13922162 None] Acquiring lock "cinder-quobyte-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d" by "delete_snapshot" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:53:32 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-698dbc66-58af-49de-97c1-02a9f000fe85 tempest-SnapshotsActionsTest-13922162 None] Lock "cinder-quobyte-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d" acquired by "delete_snapshot" :: waited 0.018s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:53:32 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-698dbc66-58af-49de-97c1-02a9f000fe85 tempest-SnapshotsActionsTest-13922162 None] Acquiring lock "cinder-quobyte-f74f41df-c885-436b-99b1-e01274daf334" by "_delete_snapshot" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:53:32 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-698dbc66-58af-49de-97c1-02a9f000fe85 tempest-SnapshotsActionsTest-13922162 None] Lock "cinder-quobyte-f74f41df-c885-436b-99b1-e01274daf334" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:53:32 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-698dbc66-58af-49de-97c1-02a9f000fe85 tempest-SnapshotsActionsTest-13922162 None] Deleting offline snapshot f74f41df-c885-436b-99b1-e01274daf334 of volume 58cd87d4-3c93-4a3c-a3f7-1bda6cea508d {{(pid=81771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 22 17:53:32 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-698dbc66-58af-49de-97c1-02a9f000fe85 tempest-SnapshotsActionsTest-13922162 None] snapshot_file for this snap is: volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.f74f41df-c885-436b-99b1-e01274daf334 {{(pid=81771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 22 17:53:32 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ab07af7-9cdb-42c0-a9c7-9d16b084e342]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:53:32 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-698dbc66-58af-49de-97c1-02a9f000fe85 tempest-SnapshotsActionsTest-13922162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.f74f41df-c885-436b-99b1-e01274daf334 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:53:32 devstack sudo[86266]: pam_unix(sudo:session): session closed for user root Apr 22 17:53:32 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-981ab80e-0205-4074-baad-0aa64754a2b0 tempest-VolumesMetadataTest-1535840800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33" returned: 0 in 0.604s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:53:32 devstack cinder-volume[81771]: DEBUG cinder.manager [None req-981ab80e-0205-4074-baad-0aa64754a2b0 tempest-VolumesMetadataTest-1535840800 None] Notifying Schedulers of capabilities ... {{(pid=81771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 17:53:32 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-981ab80e-0205-4074-baad-0aa64754a2b0 tempest-VolumesMetadataTest-1535840800 None] Deleted volume successfully. Apr 22 17:53:32 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-981ab80e-0205-4074-baad-0aa64754a2b0 tempest-VolumesMetadataTest-1535840800 None] Lock "cinder-5e8e3b90-b7ad-4738-9ed4-7818bcad7726-delete_volume" released by "delete_volume" :: held 2.330s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:53:32 devstack sudo[86270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.f74f41df-c885-436b-99b1-e01274daf334 Apr 22 17:53:32 devstack sudo[86270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:53:32 devstack sudo[86270]: pam_unix(sudo:session): session closed for user root Apr 22 17:53:32 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-698dbc66-58af-49de-97c1-02a9f000fe85 tempest-SnapshotsActionsTest-13922162 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.f74f41df-c885-436b-99b1-e01274daf334" returned: 0 in 0.645s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:53:32 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-698dbc66-58af-49de-97c1-02a9f000fe85 tempest-SnapshotsActionsTest-13922162 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81771) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 22 17:53:32 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[50e0eaf3-8581-4356-a194-ee331407cb7d]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:53:32 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-698dbc66-58af-49de-97c1-02a9f000fe85 tempest-SnapshotsActionsTest-13922162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.45d921d6-8f00-483b-9870-d8741deb813b {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:53:32 devstack sudo[86275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.45d921d6-8f00-483b-9870-d8741deb813b Apr 22 17:53:32 devstack sudo[86275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:53:33 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-0f859880-2abb-473d-ba04-e3774ac73047 tempest-GroupSnapshotsTest-38718681 None] Acquiring lock "cinder-quobyte-230319e2-0e34-43c5-af0a-60bbac4e377d" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:53:33 devstack sudo[86275]: pam_unix(sudo:session): session closed for user root Apr 22 17:53:33 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-698dbc66-58af-49de-97c1-02a9f000fe85 tempest-SnapshotsActionsTest-13922162 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.45d921d6-8f00-483b-9870-d8741deb813b" returned: 0 in 0.643s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:53:33 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-0f859880-2abb-473d-ba04-e3774ac73047 tempest-GroupSnapshotsTest-38718681 None] Lock "cinder-quobyte-230319e2-0e34-43c5-af0a-60bbac4e377d" acquired by "delete_volume" :: waited 0.024s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:53:33 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-698dbc66-58af-49de-97c1-02a9f000fe85 tempest-SnapshotsActionsTest-13922162 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81771) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 22 17:53:33 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-698dbc66-58af-49de-97c1-02a9f000fe85 tempest-SnapshotsActionsTest-13922162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.f74f41df-c885-436b-99b1-e01274daf334 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:53:33 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[c526711b-b5b8-4e35-9752-1691e3a47d0b]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:53:33 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-0f859880-2abb-473d-ba04-e3774ac73047 tempest-GroupSnapshotsTest-38718681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-230319e2-0e34-43c5-af0a-60bbac4e377d {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:53:33 devstack sudo[86280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.f74f41df-c885-436b-99b1-e01274daf334 Apr 22 17:53:33 devstack sudo[86280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:53:33 devstack sudo[86281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-230319e2-0e34-43c5-af0a-60bbac4e377d Apr 22 17:53:33 devstack sudo[86281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:53:34 devstack sudo[86281]: pam_unix(sudo:session): session closed for user root Apr 22 17:53:34 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-0f859880-2abb-473d-ba04-e3774ac73047 tempest-GroupSnapshotsTest-38718681 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-230319e2-0e34-43c5-af0a-60bbac4e377d" returned: 0 in 0.670s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:53:34 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-0f859880-2abb-473d-ba04-e3774ac73047 tempest-GroupSnapshotsTest-38718681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-230319e2-0e34-43c5-af0a-60bbac4e377d {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:53:34 devstack sudo[86292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-230319e2-0e34-43c5-af0a-60bbac4e377d Apr 22 17:53:34 devstack sudo[86292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:53:34 devstack sudo[86280]: pam_unix(sudo:session): session closed for user root Apr 22 17:53:34 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-698dbc66-58af-49de-97c1-02a9f000fe85 tempest-SnapshotsActionsTest-13922162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.f74f41df-c885-436b-99b1-e01274daf334" returned: 0 in 0.757s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:53:34 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-698dbc66-58af-49de-97c1-02a9f000fe85 tempest-SnapshotsActionsTest-13922162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.f74f41df-c885-436b-99b1-e01274daf334 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:53:34 devstack sudo[86294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.f74f41df-c885-436b-99b1-e01274daf334 Apr 22 17:53:34 devstack sudo[86294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:53:34 devstack sudo[86292]: pam_unix(sudo:session): session closed for user root Apr 22 17:53:34 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-0f859880-2abb-473d-ba04-e3774ac73047 tempest-GroupSnapshotsTest-38718681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-230319e2-0e34-43c5-af0a-60bbac4e377d" returned: 0 in 0.580s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:53:34 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-0f859880-2abb-473d-ba04-e3774ac73047 tempest-GroupSnapshotsTest-38718681 None] Lock "cinder-quobyte-230319e2-0e34-43c5-af0a-60bbac4e377d" released by "delete_volume" :: held 1.332s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:53:34 devstack sudo[86294]: pam_unix(sudo:session): session closed for user root Apr 22 17:53:34 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-698dbc66-58af-49de-97c1-02a9f000fe85 tempest-SnapshotsActionsTest-13922162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.f74f41df-c885-436b-99b1-e01274daf334" returned: 0 in 0.594s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:53:34 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-0f859880-2abb-473d-ba04-e3774ac73047 tempest-GroupSnapshotsTest-38718681 None] Created reservations ['1941f8ee-75d9-44e3-863b-570dbbc73cd6'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 17:53:34 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-698dbc66-58af-49de-97c1-02a9f000fe85 tempest-SnapshotsActionsTest-13922162 None] Lock "cinder-quobyte-f74f41df-c885-436b-99b1-e01274daf334" released by "_delete_snapshot" :: held 2.793s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:53:34 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-698dbc66-58af-49de-97c1-02a9f000fe85 tempest-SnapshotsActionsTest-13922162 None] Lock "cinder-quobyte-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d" released by "delete_snapshot" :: held 2.823s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:53:35 devstack cinder-volume[81771]: WARNING cinder.quota [None req-0f859880-2abb-473d-ba04-e3774ac73047 tempest-GroupSnapshotsTest-38718681 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-595194811 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-595194811, it is now deprecated. Please use the default quota class for default quota. Apr 22 17:53:35 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-0f859880-2abb-473d-ba04-e3774ac73047 tempest-GroupSnapshotsTest-38718681 None] Created reservations ['a5649059-3aa9-4d27-98a6-9ebf0db717f0', 'a4a45418-79a3-4bfc-961b-b7e47153f02f', '49c90a69-c1f1-4159-aead-282bccd375dc', '5e7d6b15-d435-4265-a899-296e2f5113e8'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 17:53:35 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-698dbc66-58af-49de-97c1-02a9f000fe85 tempest-SnapshotsActionsTest-13922162 None] Created reservations ['13da3d25-022b-473c-bbfa-da464621634e', '5d8c5635-94c7-40de-8f15-90af41781b01', '9b7c23aa-956c-488b-898c-e45ddd07993d', 'e5fdf796-4edc-4121-84c7-d755ffc4dd88'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 17:53:35 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-698dbc66-58af-49de-97c1-02a9f000fe85 tempest-SnapshotsActionsTest-13922162 None] Delete snapshot completed successfully. Apr 22 17:53:35 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-698dbc66-58af-49de-97c1-02a9f000fe85 tempest-SnapshotsActionsTest-13922162 None] Lock "cinder-f74f41df-c885-436b-99b1-e01274daf334-delete_snapshot" released by "delete_snapshot" :: held 3.029s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:53:35 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-0f859880-2abb-473d-ba04-e3774ac73047 tempest-GroupSnapshotsTest-38718681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:53:35 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-0f859880-2abb-473d-ba04-e3774ac73047 tempest-GroupSnapshotsTest-38718681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:53:35 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-0f859880-2abb-473d-ba04-e3774ac73047 tempest-GroupSnapshotsTest-38718681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:53:35 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-0f859880-2abb-473d-ba04-e3774ac73047 tempest-GroupSnapshotsTest-38718681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:53:35 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-0f859880-2abb-473d-ba04-e3774ac73047 tempest-GroupSnapshotsTest-38718681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:53:35 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-0f859880-2abb-473d-ba04-e3774ac73047 tempest-GroupSnapshotsTest-38718681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:53:35 devstack sudo[86298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 Apr 22 17:53:35 devstack sudo[86298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:53:35 devstack cinder-volume[81771]: DEBUG dbcounter [-] [81771] Writing DB stats cinder:UPDATE=168,cinder:SELECT=165,cinder:INSERT=43,cinder:DELETE=8 {{(pid=81771) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 22 17:53:35 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-0e99feb5-d632-4fff-b1e3-d500ec9b5ca0 tempest-SnapshotsActionsTest-1651779649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:53:35 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-0e99feb5-d632-4fff-b1e3-d500ec9b5ca0 tempest-SnapshotsActionsTest-1651779649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:53:35 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-0e99feb5-d632-4fff-b1e3-d500ec9b5ca0 tempest-SnapshotsActionsTest-1651779649 None] Creating offline snapshot bb93b9a3-be87-48e2-9bb5-7d7f7da8fbd7 of volume 58cd87d4-3c93-4a3c-a3f7-1bda6cea508d {{(pid=81771) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 22 17:53:35 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[76d9d3f2-3eaa-48f9-a293-3528b673b51c]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:53:35 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-0e99feb5-d632-4fff-b1e3-d500ec9b5ca0 tempest-SnapshotsActionsTest-1651779649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.45d921d6-8f00-483b-9870-d8741deb813b {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:53:35 devstack sudo[86298]: pam_unix(sudo:session): session closed for user root Apr 22 17:53:35 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-0f859880-2abb-473d-ba04-e3774ac73047 tempest-GroupSnapshotsTest-38718681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33" returned: 0 in 0.711s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:53:35 devstack cinder-volume[81771]: DEBUG cinder.manager [None req-0f859880-2abb-473d-ba04-e3774ac73047 tempest-GroupSnapshotsTest-38718681 None] Notifying Schedulers of capabilities ... {{(pid=81771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 17:53:35 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-0f859880-2abb-473d-ba04-e3774ac73047 tempest-GroupSnapshotsTest-38718681 None] Delete group completed successfully. Apr 22 17:53:35 devstack sudo[86304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.45d921d6-8f00-483b-9870-d8741deb813b Apr 22 17:53:35 devstack sudo[86304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:53:36 devstack sudo[86304]: pam_unix(sudo:session): session closed for user root Apr 22 17:53:36 devstack cinder-volume[81771]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e1d2a38-191a-4f28-9fbb-7e96a00a2650 tempest-VolumesTransfersTest-738560256 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 17:53:36 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-4e1d2a38-191a-4f28-9fbb-7e96a00a2650 tempest-VolumesTransfersTest-738560256 None] Flow 'volume_create_manager' (1bc4fee2-acb0-45c0-af91-52e06178c499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:53:36 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-4e1d2a38-191a-4f28-9fbb-7e96a00a2650 tempest-VolumesTransfersTest-738560256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ddb4589-aa63-4d92-b296-5b6d04c93c66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:53:36 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-0e99feb5-d632-4fff-b1e3-d500ec9b5ca0 tempest-SnapshotsActionsTest-1651779649 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.45d921d6-8f00-483b-9870-d8741deb813b" returned: 0 in 0.986s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:53:36 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-0e99feb5-d632-4fff-b1e3-d500ec9b5ca0 tempest-SnapshotsActionsTest-1651779649 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81771) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 22 17:53:36 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-0e99feb5-d632-4fff-b1e3-d500ec9b5ca0 tempest-SnapshotsActionsTest-1651779649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.45d921d6-8f00-483b-9870-d8741deb813b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.bb93b9a3-be87-48e2-9bb5-7d7f7da8fbd7 1G {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:53:36 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-4e1d2a38-191a-4f28-9fbb-7e96a00a2650 tempest-VolumesTransfersTest-738560256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ddb4589-aa63-4d92-b296-5b6d04c93c66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:53:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-282647861',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7803c47-e239-4dc9-a5ad-a6f58601c936,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9620d4ba8bdc4b2589e1328abeaa223f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:53:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:53:37Z,use_quota=True,user_id='201b8128e1774df0bff616b57f0c4609',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:53:36 devstack sudo[86318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.45d921d6-8f00-483b-9870-d8741deb813b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.bb93b9a3-be87-48e2-9bb5-7d7f7da8fbd7 1G Apr 22 17:53:36 devstack sudo[86318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:53:36 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-4e1d2a38-191a-4f28-9fbb-7e96a00a2650 tempest-VolumesTransfersTest-738560256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96216251-9c6f-4b99-8e51-aad838ea22a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:53:36 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-4e1d2a38-191a-4f28-9fbb-7e96a00a2650 tempest-VolumesTransfersTest-738560256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96216251-9c6f-4b99-8e51-aad838ea22a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:53:36 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-4e1d2a38-191a-4f28-9fbb-7e96a00a2650 tempest-VolumesTransfersTest-738560256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2ff4c14-8e65-48ad-b407-1cddbd8e7b1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:53:36 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-4e1d2a38-191a-4f28-9fbb-7e96a00a2650 tempest-VolumesTransfersTest-738560256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2ff4c14-8e65-48ad-b407-1cddbd8e7b1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7803c47-e239-4dc9-a5ad-a6f58601c936', 'volume_name': 'volume-b7803c47-e239-4dc9-a5ad-a6f58601c936', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:53:36 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-4e1d2a38-191a-4f28-9fbb-7e96a00a2650 tempest-VolumesTransfersTest-738560256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (390510c0-9f47-4280-a2ce-5bf602ac22c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:53:36 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-4e1d2a38-191a-4f28-9fbb-7e96a00a2650 tempest-VolumesTransfersTest-738560256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (390510c0-9f47-4280-a2ce-5bf602ac22c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:53:36 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-4e1d2a38-191a-4f28-9fbb-7e96a00a2650 tempest-VolumesTransfersTest-738560256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d6263da-908c-42e1-a6d6-143db31440b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:53:36 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-4e1d2a38-191a-4f28-9fbb-7e96a00a2650 tempest-VolumesTransfersTest-738560256 None] Volume b7803c47-e239-4dc9-a5ad-a6f58601c936: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7803c47-e239-4dc9-a5ad-a6f58601c936', 'volume_size': 1} Apr 22 17:53:36 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-4e1d2a38-191a-4f28-9fbb-7e96a00a2650 tempest-VolumesTransfersTest-738560256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:53:37 devstack sudo[86318]: pam_unix(sudo:session): session closed for user root Apr 22 17:53:37 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-0e99feb5-d632-4fff-b1e3-d500ec9b5ca0 tempest-SnapshotsActionsTest-1651779649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.45d921d6-8f00-483b-9870-d8741deb813b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.bb93b9a3-be87-48e2-9bb5-7d7f7da8fbd7 1G" returned: 0 in 1.058s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:53:37 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-0e99feb5-d632-4fff-b1e3-d500ec9b5ca0 tempest-SnapshotsActionsTest-1651779649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.45d921d6-8f00-483b-9870-d8741deb813b -F qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.bb93b9a3-be87-48e2-9bb5-7d7f7da8fbd7 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:53:37 devstack sudo[86357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.45d921d6-8f00-483b-9870-d8741deb813b -F qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.bb93b9a3-be87-48e2-9bb5-7d7f7da8fbd7 Apr 22 17:53:37 devstack sudo[86357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:53:38 devstack sudo[86357]: pam_unix(sudo:session): session closed for user root Apr 22 17:53:38 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-0e99feb5-d632-4fff-b1e3-d500ec9b5ca0 tempest-SnapshotsActionsTest-1651779649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.45d921d6-8f00-483b-9870-d8741deb813b -F qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.bb93b9a3-be87-48e2-9bb5-7d7f7da8fbd7" returned: 0 in 0.811s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:53:38 devstack cinder-volume[81771]: WARNING cinder.volume.drivers.remotefs [None req-0e99feb5-d632-4fff-b1e3-d500ec9b5ca0 tempest-SnapshotsActionsTest-1651779649 None] /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.bb93b9a3-be87-48e2-9bb5-7d7f7da8fbd7 is being set with open permissions: ugo+rw Apr 22 17:53:38 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-0e99feb5-d632-4fff-b1e3-d500ec9b5ca0 tempest-SnapshotsActionsTest-1651779649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.bb93b9a3-be87-48e2-9bb5-7d7f7da8fbd7 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:53:38 devstack sudo[86363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.bb93b9a3-be87-48e2-9bb5-7d7f7da8fbd7 Apr 22 17:53:38 devstack sudo[86363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:53:39 devstack sudo[86363]: pam_unix(sudo:session): session closed for user root Apr 22 17:53:39 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-0e99feb5-d632-4fff-b1e3-d500ec9b5ca0 tempest-SnapshotsActionsTest-1651779649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.bb93b9a3-be87-48e2-9bb5-7d7f7da8fbd7" returned: 0 in 0.873s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:53:39 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-0e99feb5-d632-4fff-b1e3-d500ec9b5ca0 tempest-SnapshotsActionsTest-1651779649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.921s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:53:39 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-4e1d2a38-191a-4f28-9fbb-7e96a00a2650 tempest-VolumesTransfersTest-738560256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.785s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:53:39 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-4e1d2a38-191a-4f28-9fbb-7e96a00a2650 tempest-VolumesTransfersTest-738560256 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:53:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-282647861',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7803c47-e239-4dc9-a5ad-a6f58601c936,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9620d4ba8bdc4b2589e1328abeaa223f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:53:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:53:37Z,use_quota=True,user_id='201b8128e1774df0bff616b57f0c4609',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)}" {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 17:53:39 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-4e1d2a38-191a-4f28-9fbb-7e96a00a2650 tempest-VolumesTransfersTest-738560256 None] Creating volume b7803c47-e239-4dc9-a5ad-a6f58601c936 {{(pid=81771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 17:53:39 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-4e1d2a38-191a-4f28-9fbb-7e96a00a2650 tempest-VolumesTransfersTest-738560256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:53:39 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-4e1d2a38-191a-4f28-9fbb-7e96a00a2650 tempest-VolumesTransfersTest-738560256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:53:39 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-4e1d2a38-191a-4f28-9fbb-7e96a00a2650 tempest-VolumesTransfersTest-738560256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:53:39 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-4e1d2a38-191a-4f28-9fbb-7e96a00a2650 tempest-VolumesTransfersTest-738560256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:53:39 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-4e1d2a38-191a-4f28-9fbb-7e96a00a2650 tempest-VolumesTransfersTest-738560256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:53:39 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-4e1d2a38-191a-4f28-9fbb-7e96a00a2650 tempest-VolumesTransfersTest-738560256 None] Selected osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 as target Quobyte volume. {{(pid=81771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 17:53:39 devstack cinder-volume[81771]: INFO cinder.volume.drivers.remotefs [None req-4e1d2a38-191a-4f28-9fbb-7e96a00a2650 tempest-VolumesTransfersTest-738560256 None] casted to osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 Apr 22 17:53:39 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-4e1d2a38-191a-4f28-9fbb-7e96a00a2650 tempest-VolumesTransfersTest-738560256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b7803c47-e239-4dc9-a5ad-a6f58601c936 1073741824 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:53:39 devstack sudo[86367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b7803c47-e239-4dc9-a5ad-a6f58601c936 1073741824 Apr 22 17:53:39 devstack sudo[86367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:53:39 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-0e99feb5-d632-4fff-b1e3-d500ec9b5ca0 tempest-SnapshotsActionsTest-1651779649 None] Create snapshot completed successfully Apr 22 17:53:40 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-4133d643-f7dd-4e80-b47f-3d2ceff57dde tempest-SnapshotsActionsTest-13922162 None] Acquiring lock "cinder-bb93b9a3-be87-48e2-9bb5-7d7f7da8fbd7-delete_snapshot" by "delete_snapshot" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:53:40 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-4133d643-f7dd-4e80-b47f-3d2ceff57dde tempest-SnapshotsActionsTest-13922162 None] Lock "cinder-bb93b9a3-be87-48e2-9bb5-7d7f7da8fbd7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:53:40 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-4133d643-f7dd-4e80-b47f-3d2ceff57dde tempest-SnapshotsActionsTest-13922162 None] Acquiring lock "cinder-quobyte-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d" by "delete_snapshot" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:53:40 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-4133d643-f7dd-4e80-b47f-3d2ceff57dde tempest-SnapshotsActionsTest-13922162 None] Lock "cinder-quobyte-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d" acquired by "delete_snapshot" :: waited 0.019s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:53:40 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-4133d643-f7dd-4e80-b47f-3d2ceff57dde tempest-SnapshotsActionsTest-13922162 None] Acquiring lock "cinder-quobyte-bb93b9a3-be87-48e2-9bb5-7d7f7da8fbd7" by "_delete_snapshot" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:53:40 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-4133d643-f7dd-4e80-b47f-3d2ceff57dde tempest-SnapshotsActionsTest-13922162 None] Lock "cinder-quobyte-bb93b9a3-be87-48e2-9bb5-7d7f7da8fbd7" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:53:40 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-4133d643-f7dd-4e80-b47f-3d2ceff57dde tempest-SnapshotsActionsTest-13922162 None] Deleting offline snapshot bb93b9a3-be87-48e2-9bb5-7d7f7da8fbd7 of volume 58cd87d4-3c93-4a3c-a3f7-1bda6cea508d {{(pid=81771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 22 17:53:40 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-4133d643-f7dd-4e80-b47f-3d2ceff57dde tempest-SnapshotsActionsTest-13922162 None] snapshot_file for this snap is: volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.bb93b9a3-be87-48e2-9bb5-7d7f7da8fbd7 {{(pid=81771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 22 17:53:40 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf17586c-bc87-4af2-a644-7c70395e7edf]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:53:40 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-4133d643-f7dd-4e80-b47f-3d2ceff57dde tempest-SnapshotsActionsTest-13922162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.bb93b9a3-be87-48e2-9bb5-7d7f7da8fbd7 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:53:40 devstack sudo[86372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.bb93b9a3-be87-48e2-9bb5-7d7f7da8fbd7 Apr 22 17:53:40 devstack sudo[86372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:53:40 devstack sudo[86367]: pam_unix(sudo:session): session closed for user root Apr 22 17:53:40 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-4e1d2a38-191a-4f28-9fbb-7e96a00a2650 tempest-VolumesTransfersTest-738560256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b7803c47-e239-4dc9-a5ad-a6f58601c936 1073741824" returned: 0 in 1.135s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:53:40 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-4e1d2a38-191a-4f28-9fbb-7e96a00a2650 tempest-VolumesTransfersTest-738560256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b7803c47-e239-4dc9-a5ad-a6f58601c936 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:53:40 devstack sudo[86374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b7803c47-e239-4dc9-a5ad-a6f58601c936 Apr 22 17:53:40 devstack sudo[86374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:53:41 devstack sudo[86372]: pam_unix(sudo:session): session closed for user root Apr 22 17:53:41 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-4133d643-f7dd-4e80-b47f-3d2ceff57dde tempest-SnapshotsActionsTest-13922162 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.bb93b9a3-be87-48e2-9bb5-7d7f7da8fbd7" returned: 0 in 1.068s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:53:41 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-4133d643-f7dd-4e80-b47f-3d2ceff57dde tempest-SnapshotsActionsTest-13922162 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81771) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 22 17:53:41 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[233bba76-2bc4-4959-b6c2-8c373ad79bbf]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:53:41 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-4133d643-f7dd-4e80-b47f-3d2ceff57dde tempest-SnapshotsActionsTest-13922162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.45d921d6-8f00-483b-9870-d8741deb813b {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:53:41 devstack sudo[86379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.45d921d6-8f00-483b-9870-d8741deb813b Apr 22 17:53:41 devstack sudo[86379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:53:41 devstack sudo[86374]: pam_unix(sudo:session): session closed for user root Apr 22 17:53:41 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-4e1d2a38-191a-4f28-9fbb-7e96a00a2650 tempest-VolumesTransfersTest-738560256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b7803c47-e239-4dc9-a5ad-a6f58601c936" returned: 0 in 0.886s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:53:41 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-4e1d2a38-191a-4f28-9fbb-7e96a00a2650 tempest-VolumesTransfersTest-738560256 None] <== create_volume: return (2076ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'} {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 17:53:41 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-4e1d2a38-191a-4f28-9fbb-7e96a00a2650 tempest-VolumesTransfersTest-738560256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.081s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:53:41 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-4e1d2a38-191a-4f28-9fbb-7e96a00a2650 tempest-VolumesTransfersTest-738560256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d6263da-908c-42e1-a6d6-143db31440b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7803c47-e239-4dc9-a5ad-a6f58601c936', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:53:41 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-4e1d2a38-191a-4f28-9fbb-7e96a00a2650 tempest-VolumesTransfersTest-738560256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77485764-e59f-45c1-a9a1-b218e287c96e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:53:41 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-4e1d2a38-191a-4f28-9fbb-7e96a00a2650 tempest-VolumesTransfersTest-738560256 None] Volume volume-b7803c47-e239-4dc9-a5ad-a6f58601c936 (b7803c47-e239-4dc9-a5ad-a6f58601c936): created successfully Apr 22 17:53:41 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-4e1d2a38-191a-4f28-9fbb-7e96a00a2650 tempest-VolumesTransfersTest-738560256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77485764-e59f-45c1-a9a1-b218e287c96e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:53:41 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-4e1d2a38-191a-4f28-9fbb-7e96a00a2650 tempest-VolumesTransfersTest-738560256 None] Flow 'volume_create_manager' (1bc4fee2-acb0-45c0-af91-52e06178c499) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:53:41 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-4e1d2a38-191a-4f28-9fbb-7e96a00a2650 tempest-VolumesTransfersTest-738560256 None] Created volume successfully. Apr 22 17:53:42 devstack sudo[86379]: pam_unix(sudo:session): session closed for user root Apr 22 17:53:42 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-4133d643-f7dd-4e80-b47f-3d2ceff57dde tempest-SnapshotsActionsTest-13922162 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.45d921d6-8f00-483b-9870-d8741deb813b" returned: 0 in 0.699s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:53:42 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-4133d643-f7dd-4e80-b47f-3d2ceff57dde tempest-SnapshotsActionsTest-13922162 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81771) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 22 17:53:42 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-4133d643-f7dd-4e80-b47f-3d2ceff57dde tempest-SnapshotsActionsTest-13922162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.bb93b9a3-be87-48e2-9bb5-7d7f7da8fbd7 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:53:42 devstack sudo[86386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.bb93b9a3-be87-48e2-9bb5-7d7f7da8fbd7 Apr 22 17:53:42 devstack sudo[86386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:53:43 devstack sudo[86386]: pam_unix(sudo:session): session closed for user root Apr 22 17:53:43 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-4133d643-f7dd-4e80-b47f-3d2ceff57dde tempest-SnapshotsActionsTest-13922162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.bb93b9a3-be87-48e2-9bb5-7d7f7da8fbd7" returned: 0 in 0.974s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:53:43 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-4133d643-f7dd-4e80-b47f-3d2ceff57dde tempest-SnapshotsActionsTest-13922162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.bb93b9a3-be87-48e2-9bb5-7d7f7da8fbd7 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:53:43 devstack sudo[86424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.bb93b9a3-be87-48e2-9bb5-7d7f7da8fbd7 Apr 22 17:53:43 devstack sudo[86424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:53:43 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-7f1beee9-d21a-47b2-b8ce-bfc9b91808e5 tempest-VolumesTransfersTest-1824095406 None] Transfer volume completed successfully. Apr 22 17:53:43 devstack sudo[86424]: pam_unix(sudo:session): session closed for user root Apr 22 17:53:43 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-4133d643-f7dd-4e80-b47f-3d2ceff57dde tempest-SnapshotsActionsTest-13922162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.bb93b9a3-be87-48e2-9bb5-7d7f7da8fbd7" returned: 0 in 0.597s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:53:43 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-4133d643-f7dd-4e80-b47f-3d2ceff57dde tempest-SnapshotsActionsTest-13922162 None] Lock "cinder-quobyte-bb93b9a3-be87-48e2-9bb5-7d7f7da8fbd7" released by "_delete_snapshot" :: held 3.478s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:53:43 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-4133d643-f7dd-4e80-b47f-3d2ceff57dde tempest-SnapshotsActionsTest-13922162 None] Lock "cinder-quobyte-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d" released by "delete_snapshot" :: held 3.522s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:53:43 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-4133d643-f7dd-4e80-b47f-3d2ceff57dde tempest-SnapshotsActionsTest-13922162 None] Created reservations ['91e308d2-09db-466e-84b7-a859aed4243f', '9b2784f5-c43a-4e7c-9d56-818958b6cbcf', 'ed7004c6-2eff-4730-94a3-973226b3759c', '9bc77bd8-4d88-457a-b8da-de0e90b23e35'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 17:53:43 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-4133d643-f7dd-4e80-b47f-3d2ceff57dde tempest-SnapshotsActionsTest-13922162 None] Delete snapshot completed successfully. Apr 22 17:53:43 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-4133d643-f7dd-4e80-b47f-3d2ceff57dde tempest-SnapshotsActionsTest-13922162 None] Lock "cinder-bb93b9a3-be87-48e2-9bb5-7d7f7da8fbd7-delete_snapshot" released by "delete_snapshot" :: held 3.755s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:53:44 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-1ee27f33-aef2-4ded-81d4-a23c379fee9f tempest-VolumesTransfersTest-332508716 None] Acquiring lock "cinder-b7803c47-e239-4dc9-a5ad-a6f58601c936-delete_volume" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:53:44 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-1ee27f33-aef2-4ded-81d4-a23c379fee9f tempest-VolumesTransfersTest-332508716 None] Lock "cinder-b7803c47-e239-4dc9-a5ad-a6f58601c936-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:53:45 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-1ee27f33-aef2-4ded-81d4-a23c379fee9f tempest-VolumesTransfersTest-332508716 None] Acquiring lock "cinder-quobyte-b7803c47-e239-4dc9-a5ad-a6f58601c936" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:53:45 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-84ea9531-fd54-4b7c-8265-76ca81713362 tempest-SnapshotsActionsTest-1651779649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:53:45 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-84ea9531-fd54-4b7c-8265-76ca81713362 tempest-SnapshotsActionsTest-1651779649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:53:45 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-1ee27f33-aef2-4ded-81d4-a23c379fee9f tempest-VolumesTransfersTest-332508716 None] Lock "cinder-quobyte-b7803c47-e239-4dc9-a5ad-a6f58601c936" acquired by "delete_volume" :: waited 0.048s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:53:45 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-84ea9531-fd54-4b7c-8265-76ca81713362 tempest-SnapshotsActionsTest-1651779649 None] Creating offline snapshot b8ab4e63-84af-4fc8-8ec1-4d4bc6c3ee19 of volume 58cd87d4-3c93-4a3c-a3f7-1bda6cea508d {{(pid=81771) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 22 17:53:45 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c09f4e3-2e96-48de-a1ab-0295356f6747]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:53:45 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-1ee27f33-aef2-4ded-81d4-a23c379fee9f tempest-VolumesTransfersTest-332508716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b7803c47-e239-4dc9-a5ad-a6f58601c936 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:53:45 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[e19dc498-0a86-404a-a018-4c68a232ebf4]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:53:45 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-84ea9531-fd54-4b7c-8265-76ca81713362 tempest-SnapshotsActionsTest-1651779649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.45d921d6-8f00-483b-9870-d8741deb813b {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:53:45 devstack sudo[86472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b7803c47-e239-4dc9-a5ad-a6f58601c936 Apr 22 17:53:45 devstack sudo[86472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:53:45 devstack sudo[86475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.45d921d6-8f00-483b-9870-d8741deb813b Apr 22 17:53:45 devstack sudo[86475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:53:46 devstack sudo[86475]: pam_unix(sudo:session): session closed for user root Apr 22 17:53:46 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-84ea9531-fd54-4b7c-8265-76ca81713362 tempest-SnapshotsActionsTest-1651779649 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.45d921d6-8f00-483b-9870-d8741deb813b" returned: 0 in 1.169s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:53:46 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-84ea9531-fd54-4b7c-8265-76ca81713362 tempest-SnapshotsActionsTest-1651779649 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81771) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 22 17:53:46 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-84ea9531-fd54-4b7c-8265-76ca81713362 tempest-SnapshotsActionsTest-1651779649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.45d921d6-8f00-483b-9870-d8741deb813b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.b8ab4e63-84af-4fc8-8ec1-4d4bc6c3ee19 1G {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:53:46 devstack sudo[86490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.45d921d6-8f00-483b-9870-d8741deb813b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.b8ab4e63-84af-4fc8-8ec1-4d4bc6c3ee19 1G Apr 22 17:53:46 devstack sudo[86490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:53:46 devstack sudo[86472]: pam_unix(sudo:session): session closed for user root Apr 22 17:53:46 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-1ee27f33-aef2-4ded-81d4-a23c379fee9f tempest-VolumesTransfersTest-332508716 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b7803c47-e239-4dc9-a5ad-a6f58601c936" returned: 0 in 1.689s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:53:46 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-1ee27f33-aef2-4ded-81d4-a23c379fee9f tempest-VolumesTransfersTest-332508716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b7803c47-e239-4dc9-a5ad-a6f58601c936 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:53:46 devstack sudo[86497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b7803c47-e239-4dc9-a5ad-a6f58601c936 Apr 22 17:53:46 devstack sudo[86497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:53:47 devstack sudo[86490]: pam_unix(sudo:session): session closed for user root Apr 22 17:53:47 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-84ea9531-fd54-4b7c-8265-76ca81713362 tempest-SnapshotsActionsTest-1651779649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.45d921d6-8f00-483b-9870-d8741deb813b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.b8ab4e63-84af-4fc8-8ec1-4d4bc6c3ee19 1G" returned: 0 in 1.106s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:53:47 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-84ea9531-fd54-4b7c-8265-76ca81713362 tempest-SnapshotsActionsTest-1651779649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.45d921d6-8f00-483b-9870-d8741deb813b -F qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.b8ab4e63-84af-4fc8-8ec1-4d4bc6c3ee19 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:53:47 devstack sudo[86502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.45d921d6-8f00-483b-9870-d8741deb813b -F qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.b8ab4e63-84af-4fc8-8ec1-4d4bc6c3ee19 Apr 22 17:53:47 devstack sudo[86502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:53:48 devstack sudo[86497]: pam_unix(sudo:session): session closed for user root Apr 22 17:53:48 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-1ee27f33-aef2-4ded-81d4-a23c379fee9f tempest-VolumesTransfersTest-332508716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b7803c47-e239-4dc9-a5ad-a6f58601c936" returned: 0 in 1.294s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:53:48 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-1ee27f33-aef2-4ded-81d4-a23c379fee9f tempest-VolumesTransfersTest-332508716 None] Lock "cinder-quobyte-b7803c47-e239-4dc9-a5ad-a6f58601c936" released by "delete_volume" :: held 3.128s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:53:48 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-1ee27f33-aef2-4ded-81d4-a23c379fee9f tempest-VolumesTransfersTest-332508716 None] Created reservations ['403f7064-0111-4db3-a0c9-4d83baa82f2b', '02574ebe-1213-4837-8169-cb825d6b24eb', '7e7366ef-15c0-4bb2-bd8c-484873338da8', '83be4984-52e6-4843-ad19-cb022e05f135'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 17:53:48 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-1ee27f33-aef2-4ded-81d4-a23c379fee9f tempest-VolumesTransfersTest-332508716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:53:48 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-1ee27f33-aef2-4ded-81d4-a23c379fee9f tempest-VolumesTransfersTest-332508716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:53:48 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-1ee27f33-aef2-4ded-81d4-a23c379fee9f tempest-VolumesTransfersTest-332508716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:53:48 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-1ee27f33-aef2-4ded-81d4-a23c379fee9f tempest-VolumesTransfersTest-332508716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:53:48 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-1ee27f33-aef2-4ded-81d4-a23c379fee9f tempest-VolumesTransfersTest-332508716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:53:48 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-1ee27f33-aef2-4ded-81d4-a23c379fee9f tempest-VolumesTransfersTest-332508716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:53:48 devstack sudo[86509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 Apr 22 17:53:48 devstack sudo[86509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:53:48 devstack sudo[86502]: pam_unix(sudo:session): session closed for user root Apr 22 17:53:48 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-84ea9531-fd54-4b7c-8265-76ca81713362 tempest-SnapshotsActionsTest-1651779649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.45d921d6-8f00-483b-9870-d8741deb813b -F qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.b8ab4e63-84af-4fc8-8ec1-4d4bc6c3ee19" returned: 0 in 1.313s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:53:48 devstack cinder-volume[81771]: WARNING cinder.volume.drivers.remotefs [None req-84ea9531-fd54-4b7c-8265-76ca81713362 tempest-SnapshotsActionsTest-1651779649 None] /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.b8ab4e63-84af-4fc8-8ec1-4d4bc6c3ee19 is being set with open permissions: ugo+rw Apr 22 17:53:48 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-84ea9531-fd54-4b7c-8265-76ca81713362 tempest-SnapshotsActionsTest-1651779649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.b8ab4e63-84af-4fc8-8ec1-4d4bc6c3ee19 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:53:48 devstack sudo[86511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.b8ab4e63-84af-4fc8-8ec1-4d4bc6c3ee19 Apr 22 17:53:48 devstack sudo[86511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:53:49 devstack sudo[86509]: pam_unix(sudo:session): session closed for user root Apr 22 17:53:49 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-1ee27f33-aef2-4ded-81d4-a23c379fee9f tempest-VolumesTransfersTest-332508716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33" returned: 0 in 0.916s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:53:49 devstack cinder-volume[81771]: DEBUG cinder.manager [None req-1ee27f33-aef2-4ded-81d4-a23c379fee9f tempest-VolumesTransfersTest-332508716 None] Notifying Schedulers of capabilities ... {{(pid=81771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 17:53:49 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-1ee27f33-aef2-4ded-81d4-a23c379fee9f tempest-VolumesTransfersTest-332508716 None] Deleted volume successfully. Apr 22 17:53:49 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-1ee27f33-aef2-4ded-81d4-a23c379fee9f tempest-VolumesTransfersTest-332508716 None] Lock "cinder-b7803c47-e239-4dc9-a5ad-a6f58601c936-delete_volume" released by "delete_volume" :: held 4.502s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:53:49 devstack sudo[86511]: pam_unix(sudo:session): session closed for user root Apr 22 17:53:49 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-84ea9531-fd54-4b7c-8265-76ca81713362 tempest-SnapshotsActionsTest-1651779649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.b8ab4e63-84af-4fc8-8ec1-4d4bc6c3ee19" returned: 0 in 1.098s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:53:50 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-84ea9531-fd54-4b7c-8265-76ca81713362 tempest-SnapshotsActionsTest-1651779649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.885s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:53:50 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-84ea9531-fd54-4b7c-8265-76ca81713362 tempest-SnapshotsActionsTest-1651779649 None] Create snapshot completed successfully Apr 22 17:53:50 devstack cinder-volume[81771]: DEBUG cinder.volume.flows.manager.create_volume [None req-2763328d-c972-4b02-8355-f5c4363108d1 tempest-VolumesTransfersTest-738560256 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 17:53:50 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-2763328d-c972-4b02-8355-f5c4363108d1 tempest-VolumesTransfersTest-738560256 None] Flow 'volume_create_manager' (54a23302-7b96-4ecb-9ef9-1e7d2d5a5994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:53:50 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-2763328d-c972-4b02-8355-f5c4363108d1 tempest-VolumesTransfersTest-738560256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7c63480-0b0f-49ef-b5a3-f01df5926e98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:53:50 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-2763328d-c972-4b02-8355-f5c4363108d1 tempest-VolumesTransfersTest-738560256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7c63480-0b0f-49ef-b5a3-f01df5926e98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:53:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-499105267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65f27590-0b6b-46a0-b3cd-03cab813c0bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9620d4ba8bdc4b2589e1328abeaa223f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:53:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:53:50Z,use_quota=True,user_id='201b8128e1774df0bff616b57f0c4609',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:53:50 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-2763328d-c972-4b02-8355-f5c4363108d1 tempest-VolumesTransfersTest-738560256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84ead6c0-cfd8-4046-8508-8e2a5fd9457b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:53:50 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-2763328d-c972-4b02-8355-f5c4363108d1 tempest-VolumesTransfersTest-738560256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84ead6c0-cfd8-4046-8508-8e2a5fd9457b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:53:50 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-2763328d-c972-4b02-8355-f5c4363108d1 tempest-VolumesTransfersTest-738560256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a88d2c7e-fbea-4798-bba4-3fd0b2b4a8f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:53:50 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-2763328d-c972-4b02-8355-f5c4363108d1 tempest-VolumesTransfersTest-738560256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a88d2c7e-fbea-4798-bba4-3fd0b2b4a8f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65f27590-0b6b-46a0-b3cd-03cab813c0bc', 'volume_name': 'volume-65f27590-0b6b-46a0-b3cd-03cab813c0bc', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:53:50 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-2763328d-c972-4b02-8355-f5c4363108d1 tempest-VolumesTransfersTest-738560256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1da9df2-64d0-4021-9d1d-79811cdd1be7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:53:50 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-2763328d-c972-4b02-8355-f5c4363108d1 tempest-VolumesTransfersTest-738560256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1da9df2-64d0-4021-9d1d-79811cdd1be7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:53:50 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-2763328d-c972-4b02-8355-f5c4363108d1 tempest-VolumesTransfersTest-738560256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a90d064-8df7-45fa-b6d7-f3158aa2938e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:53:50 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-2763328d-c972-4b02-8355-f5c4363108d1 tempest-VolumesTransfersTest-738560256 None] Volume 65f27590-0b6b-46a0-b3cd-03cab813c0bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65f27590-0b6b-46a0-b3cd-03cab813c0bc', 'volume_size': 1} Apr 22 17:53:50 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-2763328d-c972-4b02-8355-f5c4363108d1 tempest-VolumesTransfersTest-738560256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:53:50 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-2763328d-c972-4b02-8355-f5c4363108d1 tempest-VolumesTransfersTest-738560256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:53:50 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-2763328d-c972-4b02-8355-f5c4363108d1 tempest-VolumesTransfersTest-738560256 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:53:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-499105267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65f27590-0b6b-46a0-b3cd-03cab813c0bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9620d4ba8bdc4b2589e1328abeaa223f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:53:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:53:50Z,use_quota=True,user_id='201b8128e1774df0bff616b57f0c4609',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)}" {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 17:53:50 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-2763328d-c972-4b02-8355-f5c4363108d1 tempest-VolumesTransfersTest-738560256 None] Creating volume 65f27590-0b6b-46a0-b3cd-03cab813c0bc {{(pid=81771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 17:53:50 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-2763328d-c972-4b02-8355-f5c4363108d1 tempest-VolumesTransfersTest-738560256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:53:50 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-2763328d-c972-4b02-8355-f5c4363108d1 tempest-VolumesTransfersTest-738560256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:53:50 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-2763328d-c972-4b02-8355-f5c4363108d1 tempest-VolumesTransfersTest-738560256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:53:50 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-2763328d-c972-4b02-8355-f5c4363108d1 tempest-VolumesTransfersTest-738560256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:53:50 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-2763328d-c972-4b02-8355-f5c4363108d1 tempest-VolumesTransfersTest-738560256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:53:50 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-2763328d-c972-4b02-8355-f5c4363108d1 tempest-VolumesTransfersTest-738560256 None] Selected osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 as target Quobyte volume. {{(pid=81771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 17:53:50 devstack cinder-volume[81771]: INFO cinder.volume.drivers.remotefs [None req-2763328d-c972-4b02-8355-f5c4363108d1 tempest-VolumesTransfersTest-738560256 None] casted to osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 Apr 22 17:53:50 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-2763328d-c972-4b02-8355-f5c4363108d1 tempest-VolumesTransfersTest-738560256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-65f27590-0b6b-46a0-b3cd-03cab813c0bc 1073741824 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:53:50 devstack sudo[86544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-65f27590-0b6b-46a0-b3cd-03cab813c0bc 1073741824 Apr 22 17:53:50 devstack sudo[86544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:53:50 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-276030f5-b536-467b-90f7-4174408de84b tempest-SnapshotsActionsTest-13922162 None] Acquiring lock "cinder-b8ab4e63-84af-4fc8-8ec1-4d4bc6c3ee19-delete_snapshot" by "delete_snapshot" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:53:50 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-276030f5-b536-467b-90f7-4174408de84b tempest-SnapshotsActionsTest-13922162 None] Lock "cinder-b8ab4e63-84af-4fc8-8ec1-4d4bc6c3ee19-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:53:50 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-276030f5-b536-467b-90f7-4174408de84b tempest-SnapshotsActionsTest-13922162 None] Acquiring lock "cinder-quobyte-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d" by "delete_snapshot" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:53:50 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-276030f5-b536-467b-90f7-4174408de84b tempest-SnapshotsActionsTest-13922162 None] Lock "cinder-quobyte-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d" acquired by "delete_snapshot" :: waited 0.027s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:53:50 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-276030f5-b536-467b-90f7-4174408de84b tempest-SnapshotsActionsTest-13922162 None] Acquiring lock "cinder-quobyte-b8ab4e63-84af-4fc8-8ec1-4d4bc6c3ee19" by "_delete_snapshot" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:53:50 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-276030f5-b536-467b-90f7-4174408de84b tempest-SnapshotsActionsTest-13922162 None] Lock "cinder-quobyte-b8ab4e63-84af-4fc8-8ec1-4d4bc6c3ee19" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:53:50 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-276030f5-b536-467b-90f7-4174408de84b tempest-SnapshotsActionsTest-13922162 None] Deleting offline snapshot b8ab4e63-84af-4fc8-8ec1-4d4bc6c3ee19 of volume 58cd87d4-3c93-4a3c-a3f7-1bda6cea508d {{(pid=81771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 22 17:53:50 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-276030f5-b536-467b-90f7-4174408de84b tempest-SnapshotsActionsTest-13922162 None] snapshot_file for this snap is: volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.b8ab4e63-84af-4fc8-8ec1-4d4bc6c3ee19 {{(pid=81771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 22 17:53:50 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[083929aa-118d-4e73-a8cc-f6ef55141d12]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:53:50 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-276030f5-b536-467b-90f7-4174408de84b tempest-SnapshotsActionsTest-13922162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.b8ab4e63-84af-4fc8-8ec1-4d4bc6c3ee19 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:53:50 devstack sudo[86547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.b8ab4e63-84af-4fc8-8ec1-4d4bc6c3ee19 Apr 22 17:53:50 devstack sudo[86547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:53:51 devstack sudo[86544]: pam_unix(sudo:session): session closed for user root Apr 22 17:53:51 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-2763328d-c972-4b02-8355-f5c4363108d1 tempest-VolumesTransfersTest-738560256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-65f27590-0b6b-46a0-b3cd-03cab813c0bc 1073741824" returned: 0 in 0.837s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:53:51 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-2763328d-c972-4b02-8355-f5c4363108d1 tempest-VolumesTransfersTest-738560256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-65f27590-0b6b-46a0-b3cd-03cab813c0bc {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:53:51 devstack sudo[86555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-65f27590-0b6b-46a0-b3cd-03cab813c0bc Apr 22 17:53:51 devstack sudo[86555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:53:51 devstack sudo[86547]: pam_unix(sudo:session): session closed for user root Apr 22 17:53:51 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-276030f5-b536-467b-90f7-4174408de84b tempest-SnapshotsActionsTest-13922162 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.b8ab4e63-84af-4fc8-8ec1-4d4bc6c3ee19" returned: 0 in 0.736s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:53:51 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-276030f5-b536-467b-90f7-4174408de84b tempest-SnapshotsActionsTest-13922162 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81771) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 22 17:53:51 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[19011af8-e3dd-4458-be9d-0746a6fe6857]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:53:51 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-276030f5-b536-467b-90f7-4174408de84b tempest-SnapshotsActionsTest-13922162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.45d921d6-8f00-483b-9870-d8741deb813b {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:53:51 devstack sudo[86558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.45d921d6-8f00-483b-9870-d8741deb813b Apr 22 17:53:51 devstack sudo[86558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:53:52 devstack sudo[86555]: pam_unix(sudo:session): session closed for user root Apr 22 17:53:52 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-2763328d-c972-4b02-8355-f5c4363108d1 tempest-VolumesTransfersTest-738560256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-65f27590-0b6b-46a0-b3cd-03cab813c0bc" returned: 0 in 0.758s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:53:52 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-2763328d-c972-4b02-8355-f5c4363108d1 tempest-VolumesTransfersTest-738560256 None] <== create_volume: return (1648ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'} {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 17:53:52 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-2763328d-c972-4b02-8355-f5c4363108d1 tempest-VolumesTransfersTest-738560256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.651s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:53:52 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-2763328d-c972-4b02-8355-f5c4363108d1 tempest-VolumesTransfersTest-738560256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a90d064-8df7-45fa-b6d7-f3158aa2938e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65f27590-0b6b-46a0-b3cd-03cab813c0bc', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:53:52 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-2763328d-c972-4b02-8355-f5c4363108d1 tempest-VolumesTransfersTest-738560256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (062f15de-ad46-4904-8952-fed112e2b199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:53:52 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-2763328d-c972-4b02-8355-f5c4363108d1 tempest-VolumesTransfersTest-738560256 None] Volume volume-65f27590-0b6b-46a0-b3cd-03cab813c0bc (65f27590-0b6b-46a0-b3cd-03cab813c0bc): created successfully Apr 22 17:53:52 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-2763328d-c972-4b02-8355-f5c4363108d1 tempest-VolumesTransfersTest-738560256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (062f15de-ad46-4904-8952-fed112e2b199) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:53:52 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-2763328d-c972-4b02-8355-f5c4363108d1 tempest-VolumesTransfersTest-738560256 None] Flow 'volume_create_manager' (54a23302-7b96-4ecb-9ef9-1e7d2d5a5994) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:53:52 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-2763328d-c972-4b02-8355-f5c4363108d1 tempest-VolumesTransfersTest-738560256 None] Created volume successfully. Apr 22 17:53:52 devstack sudo[86558]: pam_unix(sudo:session): session closed for user root Apr 22 17:53:52 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-276030f5-b536-467b-90f7-4174408de84b tempest-SnapshotsActionsTest-13922162 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.45d921d6-8f00-483b-9870-d8741deb813b" returned: 0 in 0.757s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:53:52 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-276030f5-b536-467b-90f7-4174408de84b tempest-SnapshotsActionsTest-13922162 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81771) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 22 17:53:52 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-276030f5-b536-467b-90f7-4174408de84b tempest-SnapshotsActionsTest-13922162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.b8ab4e63-84af-4fc8-8ec1-4d4bc6c3ee19 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:53:52 devstack sudo[86565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.b8ab4e63-84af-4fc8-8ec1-4d4bc6c3ee19 Apr 22 17:53:52 devstack sudo[86565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:53:52 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-27d227c4-e8e4-4934-b16a-49404716747d tempest-VolumesTransfersTest-332508716 None] Acquiring lock "cinder-65f27590-0b6b-46a0-b3cd-03cab813c0bc-delete_volume" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:53:52 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-27d227c4-e8e4-4934-b16a-49404716747d tempest-VolumesTransfersTest-332508716 None] Lock "cinder-65f27590-0b6b-46a0-b3cd-03cab813c0bc-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:53:52 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-27d227c4-e8e4-4934-b16a-49404716747d tempest-VolumesTransfersTest-332508716 None] Acquiring lock "cinder-quobyte-65f27590-0b6b-46a0-b3cd-03cab813c0bc" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:53:52 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-27d227c4-e8e4-4934-b16a-49404716747d tempest-VolumesTransfersTest-332508716 None] Lock "cinder-quobyte-65f27590-0b6b-46a0-b3cd-03cab813c0bc" acquired by "delete_volume" :: waited 0.025s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:53:52 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed181e2f-ec8f-40b9-b6bc-474cf12d28c7]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:53:52 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-27d227c4-e8e4-4934-b16a-49404716747d tempest-VolumesTransfersTest-332508716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-65f27590-0b6b-46a0-b3cd-03cab813c0bc {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:53:53 devstack cinder-volume[81771]: INFO cinder.volume.manager [req-12ea80af-2b44-4b77-811d-b9d0c1271812 req-9d9a45b8-0d05-43ea-9cf2-b0b057da9054 tempest-ServerBootFromVolumeStableRescueTest-800024217 None] Terminate volume connection completed successfully. Apr 22 17:53:53 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [req-12ea80af-2b44-4b77-811d-b9d0c1271812 req-9d9a45b8-0d05-43ea-9cf2-b0b057da9054 tempest-ServerBootFromVolumeStableRescueTest-800024217 None] Deleting attachment f6b89c4c-36b2-413b-a1df-e8607a8ec57e. {{(pid=81771) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 22 17:53:53 devstack sudo[86570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-65f27590-0b6b-46a0-b3cd-03cab813c0bc Apr 22 17:53:53 devstack sudo[86570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:53:53 devstack sudo[86565]: pam_unix(sudo:session): session closed for user root Apr 22 17:53:53 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-276030f5-b536-467b-90f7-4174408de84b tempest-SnapshotsActionsTest-13922162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.b8ab4e63-84af-4fc8-8ec1-4d4bc6c3ee19" returned: 0 in 0.891s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:53:53 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-276030f5-b536-467b-90f7-4174408de84b tempest-SnapshotsActionsTest-13922162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.b8ab4e63-84af-4fc8-8ec1-4d4bc6c3ee19 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:53:53 devstack sudo[86572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.b8ab4e63-84af-4fc8-8ec1-4d4bc6c3ee19 Apr 22 17:53:53 devstack sudo[86572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:53:53 devstack sudo[86570]: pam_unix(sudo:session): session closed for user root Apr 22 17:53:53 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-27d227c4-e8e4-4934-b16a-49404716747d tempest-VolumesTransfersTest-332508716 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-65f27590-0b6b-46a0-b3cd-03cab813c0bc" returned: 0 in 0.711s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:53:53 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-27d227c4-e8e4-4934-b16a-49404716747d tempest-VolumesTransfersTest-332508716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-65f27590-0b6b-46a0-b3cd-03cab813c0bc {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:53:53 devstack sudo[86578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-65f27590-0b6b-46a0-b3cd-03cab813c0bc Apr 22 17:53:53 devstack sudo[86578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:53:53 devstack cinder-volume[81771]: DEBUG cinder.coordination [req-12ea80af-2b44-4b77-811d-b9d0c1271812 req-45757885-49e6-4cff-bff2-1fa0403ddc22 tempest-ServerBootFromVolumeStableRescueTest-800024217 None] Acquiring lock "cinder-b65b8307-7292-4108-ba72-331fceb4c3f1-delete_volume" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:53:53 devstack cinder-volume[81771]: DEBUG cinder.coordination [req-12ea80af-2b44-4b77-811d-b9d0c1271812 req-45757885-49e6-4cff-bff2-1fa0403ddc22 tempest-ServerBootFromVolumeStableRescueTest-800024217 None] Lock "cinder-b65b8307-7292-4108-ba72-331fceb4c3f1-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:53:53 devstack sudo[86572]: pam_unix(sudo:session): session closed for user root Apr 22 17:53:53 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-276030f5-b536-467b-90f7-4174408de84b tempest-SnapshotsActionsTest-13922162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.b8ab4e63-84af-4fc8-8ec1-4d4bc6c3ee19" returned: 0 in 0.643s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:53:53 devstack cinder-volume[81771]: DEBUG cinder.coordination [req-12ea80af-2b44-4b77-811d-b9d0c1271812 req-45757885-49e6-4cff-bff2-1fa0403ddc22 tempest-ServerBootFromVolumeStableRescueTest-800024217 None] Acquiring lock "cinder-quobyte-b65b8307-7292-4108-ba72-331fceb4c3f1" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:53:53 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-276030f5-b536-467b-90f7-4174408de84b tempest-SnapshotsActionsTest-13922162 None] Lock "cinder-quobyte-b8ab4e63-84af-4fc8-8ec1-4d4bc6c3ee19" released by "_delete_snapshot" :: held 3.198s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:53:53 devstack cinder-volume[81771]: DEBUG cinder.coordination [req-12ea80af-2b44-4b77-811d-b9d0c1271812 req-45757885-49e6-4cff-bff2-1fa0403ddc22 tempest-ServerBootFromVolumeStableRescueTest-800024217 None] Lock "cinder-quobyte-b65b8307-7292-4108-ba72-331fceb4c3f1" acquired by "delete_volume" :: waited 0.040s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:53:53 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-276030f5-b536-467b-90f7-4174408de84b tempest-SnapshotsActionsTest-13922162 None] Lock "cinder-quobyte-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d" released by "delete_snapshot" :: held 3.273s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:53:53 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[a730ad64-e34e-4196-83f7-fb1745eb6a30]: (4, 'raw') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:53:53 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [req-12ea80af-2b44-4b77-811d-b9d0c1271812 req-45757885-49e6-4cff-bff2-1fa0403ddc22 tempest-ServerBootFromVolumeStableRescueTest-800024217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b65b8307-7292-4108-ba72-331fceb4c3f1 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:53:54 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-276030f5-b536-467b-90f7-4174408de84b tempest-SnapshotsActionsTest-13922162 None] Created reservations ['8815d52a-8cf7-464e-96c5-909fda888455', 'ba84e960-3a54-4c36-b386-fc5bdb0c33fa', '6aeef3ec-2bc2-4cf4-864f-cf91d8d5c463', 'abd7a886-6151-4ccd-b189-3e3c853f3764'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 17:53:54 devstack sudo[86580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b65b8307-7292-4108-ba72-331fceb4c3f1 Apr 22 17:53:54 devstack sudo[86580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:53:54 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-276030f5-b536-467b-90f7-4174408de84b tempest-SnapshotsActionsTest-13922162 None] Delete snapshot completed successfully. Apr 22 17:53:54 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-276030f5-b536-467b-90f7-4174408de84b tempest-SnapshotsActionsTest-13922162 None] Lock "cinder-b8ab4e63-84af-4fc8-8ec1-4d4bc6c3ee19-delete_snapshot" released by "delete_snapshot" :: held 3.503s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:53:54 devstack sudo[86578]: pam_unix(sudo:session): session closed for user root Apr 22 17:53:54 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-27d227c4-e8e4-4934-b16a-49404716747d tempest-VolumesTransfersTest-332508716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-65f27590-0b6b-46a0-b3cd-03cab813c0bc" returned: 0 in 0.734s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:53:54 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-27d227c4-e8e4-4934-b16a-49404716747d tempest-VolumesTransfersTest-332508716 None] Lock "cinder-quobyte-65f27590-0b6b-46a0-b3cd-03cab813c0bc" released by "delete_volume" :: held 1.509s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:53:54 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-27d227c4-e8e4-4934-b16a-49404716747d tempest-VolumesTransfersTest-332508716 None] Created reservations ['ac059cf4-a181-4fb6-a85f-496ec28040fa', 'fc570aeb-27f9-4eaf-80db-f2c785293797', '2eaa85a9-e3b1-42f8-ab13-096faf123682', 'b746417e-1d82-4cce-8d09-7a98ffc43596'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 17:53:54 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-27d227c4-e8e4-4934-b16a-49404716747d tempest-VolumesTransfersTest-332508716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:53:54 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-27d227c4-e8e4-4934-b16a-49404716747d tempest-VolumesTransfersTest-332508716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:53:54 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-27d227c4-e8e4-4934-b16a-49404716747d tempest-VolumesTransfersTest-332508716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:53:54 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-27d227c4-e8e4-4934-b16a-49404716747d tempest-VolumesTransfersTest-332508716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:53:54 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-27d227c4-e8e4-4934-b16a-49404716747d tempest-VolumesTransfersTest-332508716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:53:54 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-27d227c4-e8e4-4934-b16a-49404716747d tempest-VolumesTransfersTest-332508716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:53:54 devstack sudo[86584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 Apr 22 17:53:54 devstack sudo[86584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:53:54 devstack sudo[86580]: pam_unix(sudo:session): session closed for user root Apr 22 17:53:54 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [req-12ea80af-2b44-4b77-811d-b9d0c1271812 req-45757885-49e6-4cff-bff2-1fa0403ddc22 tempest-ServerBootFromVolumeStableRescueTest-800024217 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b65b8307-7292-4108-ba72-331fceb4c3f1" returned: 0 in 0.765s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:53:54 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [req-12ea80af-2b44-4b77-811d-b9d0c1271812 req-45757885-49e6-4cff-bff2-1fa0403ddc22 tempest-ServerBootFromVolumeStableRescueTest-800024217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b65b8307-7292-4108-ba72-331fceb4c3f1 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:53:54 devstack sudo[86587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b65b8307-7292-4108-ba72-331fceb4c3f1 Apr 22 17:53:54 devstack sudo[86587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:53:55 devstack sudo[86584]: pam_unix(sudo:session): session closed for user root Apr 22 17:53:55 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-27d227c4-e8e4-4934-b16a-49404716747d tempest-VolumesTransfersTest-332508716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33" returned: 0 in 0.654s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:53:55 devstack cinder-volume[81771]: DEBUG cinder.manager [None req-27d227c4-e8e4-4934-b16a-49404716747d tempest-VolumesTransfersTest-332508716 None] Notifying Schedulers of capabilities ... {{(pid=81771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 17:53:55 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-27d227c4-e8e4-4934-b16a-49404716747d tempest-VolumesTransfersTest-332508716 None] Deleted volume successfully. Apr 22 17:53:55 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-27d227c4-e8e4-4934-b16a-49404716747d tempest-VolumesTransfersTest-332508716 None] Lock "cinder-65f27590-0b6b-46a0-b3cd-03cab813c0bc-delete_volume" released by "delete_volume" :: held 2.454s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:53:55 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-c04cf24a-c52c-454d-a2a0-f3402af8b3dc tempest-SnapshotsActionsTest-1651779649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:53:55 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-c04cf24a-c52c-454d-a2a0-f3402af8b3dc tempest-SnapshotsActionsTest-1651779649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:53:55 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-c04cf24a-c52c-454d-a2a0-f3402af8b3dc tempest-SnapshotsActionsTest-1651779649 None] Creating offline snapshot 6ca1b7fe-c168-48c8-8ccf-8ee483def4ad of volume 58cd87d4-3c93-4a3c-a3f7-1bda6cea508d {{(pid=81771) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 22 17:53:55 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[da7c9dfd-6d8a-4c3a-9a96-4ac8264ae978]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:53:55 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-c04cf24a-c52c-454d-a2a0-f3402af8b3dc tempest-SnapshotsActionsTest-1651779649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.45d921d6-8f00-483b-9870-d8741deb813b {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:53:55 devstack sudo[86587]: pam_unix(sudo:session): session closed for user root Apr 22 17:53:55 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [req-12ea80af-2b44-4b77-811d-b9d0c1271812 req-45757885-49e6-4cff-bff2-1fa0403ddc22 tempest-ServerBootFromVolumeStableRescueTest-800024217 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b65b8307-7292-4108-ba72-331fceb4c3f1" returned: 1 in 0.808s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:53:55 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [req-12ea80af-2b44-4b77-811d-b9d0c1271812 req-45757885-49e6-4cff-bff2-1fa0403ddc22 tempest-ServerBootFromVolumeStableRescueTest-800024217 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b65b8307-7292-4108-ba72-331fceb4c3f1' failed. Not Retrying. {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 22 17:53:55 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [req-12ea80af-2b44-4b77-811d-b9d0c1271812 req-45757885-49e6-4cff-bff2-1fa0403ddc22 tempest-ServerBootFromVolumeStableRescueTest-800024217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b65b8307-7292-4108-ba72-331fceb4c3f1 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:53:55 devstack sudo[86606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b65b8307-7292-4108-ba72-331fceb4c3f1 Apr 22 17:53:55 devstack sudo[86606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:53:55 devstack sudo[86593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.45d921d6-8f00-483b-9870-d8741deb813b Apr 22 17:53:55 devstack sudo[86593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:53:56 devstack sudo[86606]: pam_unix(sudo:session): session closed for user root Apr 22 17:53:56 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [req-12ea80af-2b44-4b77-811d-b9d0c1271812 req-45757885-49e6-4cff-bff2-1fa0403ddc22 tempest-ServerBootFromVolumeStableRescueTest-800024217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b65b8307-7292-4108-ba72-331fceb4c3f1" returned: 0 in 0.689s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:53:56 devstack cinder-volume[81771]: DEBUG cinder.coordination [req-12ea80af-2b44-4b77-811d-b9d0c1271812 req-45757885-49e6-4cff-bff2-1fa0403ddc22 tempest-ServerBootFromVolumeStableRescueTest-800024217 None] Lock "cinder-quobyte-b65b8307-7292-4108-ba72-331fceb4c3f1" released by "delete_volume" :: held 2.353s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:53:56 devstack cinder-volume[81771]: DEBUG cinder.quota [req-12ea80af-2b44-4b77-811d-b9d0c1271812 req-45757885-49e6-4cff-bff2-1fa0403ddc22 tempest-ServerBootFromVolumeStableRescueTest-800024217 None] Created reservations ['bb12af8a-47a8-4cb5-9a1a-4ed185ba2be4', 'f646abcb-efd6-47b8-bdca-53f43d61bfeb', 'd6279024-4951-4a19-8d25-eb13d006b25f', 'ec7549a1-946a-4d66-8d4d-cf870fa0b008'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 17:53:56 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [req-12ea80af-2b44-4b77-811d-b9d0c1271812 req-45757885-49e6-4cff-bff2-1fa0403ddc22 tempest-ServerBootFromVolumeStableRescueTest-800024217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:53:56 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [req-12ea80af-2b44-4b77-811d-b9d0c1271812 req-45757885-49e6-4cff-bff2-1fa0403ddc22 tempest-ServerBootFromVolumeStableRescueTest-800024217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:53:56 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [req-12ea80af-2b44-4b77-811d-b9d0c1271812 req-45757885-49e6-4cff-bff2-1fa0403ddc22 tempest-ServerBootFromVolumeStableRescueTest-800024217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:53:56 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [req-12ea80af-2b44-4b77-811d-b9d0c1271812 req-45757885-49e6-4cff-bff2-1fa0403ddc22 tempest-ServerBootFromVolumeStableRescueTest-800024217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:53:56 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [req-12ea80af-2b44-4b77-811d-b9d0c1271812 req-45757885-49e6-4cff-bff2-1fa0403ddc22 tempest-ServerBootFromVolumeStableRescueTest-800024217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:53:56 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [req-12ea80af-2b44-4b77-811d-b9d0c1271812 req-45757885-49e6-4cff-bff2-1fa0403ddc22 tempest-ServerBootFromVolumeStableRescueTest-800024217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:53:56 devstack sudo[86635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 Apr 22 17:53:56 devstack sudo[86635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:53:56 devstack sudo[86593]: pam_unix(sudo:session): session closed for user root Apr 22 17:53:56 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-c04cf24a-c52c-454d-a2a0-f3402af8b3dc tempest-SnapshotsActionsTest-1651779649 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.45d921d6-8f00-483b-9870-d8741deb813b" returned: 0 in 1.022s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:53:56 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-c04cf24a-c52c-454d-a2a0-f3402af8b3dc tempest-SnapshotsActionsTest-1651779649 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81771) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 22 17:53:56 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-c04cf24a-c52c-454d-a2a0-f3402af8b3dc tempest-SnapshotsActionsTest-1651779649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.45d921d6-8f00-483b-9870-d8741deb813b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.6ca1b7fe-c168-48c8-8ccf-8ee483def4ad 1G {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:53:56 devstack sudo[86637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.45d921d6-8f00-483b-9870-d8741deb813b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.6ca1b7fe-c168-48c8-8ccf-8ee483def4ad 1G Apr 22 17:53:56 devstack sudo[86637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:53:57 devstack sudo[86635]: pam_unix(sudo:session): session closed for user root Apr 22 17:53:57 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [req-12ea80af-2b44-4b77-811d-b9d0c1271812 req-45757885-49e6-4cff-bff2-1fa0403ddc22 tempest-ServerBootFromVolumeStableRescueTest-800024217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33" returned: 0 in 0.643s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:53:57 devstack cinder-volume[81771]: DEBUG cinder.manager [req-12ea80af-2b44-4b77-811d-b9d0c1271812 req-45757885-49e6-4cff-bff2-1fa0403ddc22 tempest-ServerBootFromVolumeStableRescueTest-800024217 None] Notifying Schedulers of capabilities ... {{(pid=81771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 17:53:57 devstack cinder-volume[81771]: INFO cinder.volume.manager [req-12ea80af-2b44-4b77-811d-b9d0c1271812 req-45757885-49e6-4cff-bff2-1fa0403ddc22 tempest-ServerBootFromVolumeStableRescueTest-800024217 None] Deleted volume successfully. Apr 22 17:53:57 devstack cinder-volume[81771]: DEBUG cinder.coordination [req-12ea80af-2b44-4b77-811d-b9d0c1271812 req-45757885-49e6-4cff-bff2-1fa0403ddc22 tempest-ServerBootFromVolumeStableRescueTest-800024217 None] Lock "cinder-b65b8307-7292-4108-ba72-331fceb4c3f1-delete_volume" released by "delete_volume" :: held 3.320s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:53:57 devstack sudo[86637]: pam_unix(sudo:session): session closed for user root Apr 22 17:53:57 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-c04cf24a-c52c-454d-a2a0-f3402af8b3dc tempest-SnapshotsActionsTest-1651779649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.45d921d6-8f00-483b-9870-d8741deb813b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.6ca1b7fe-c168-48c8-8ccf-8ee483def4ad 1G" returned: 0 in 1.267s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:53:57 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-c04cf24a-c52c-454d-a2a0-f3402af8b3dc tempest-SnapshotsActionsTest-1651779649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.45d921d6-8f00-483b-9870-d8741deb813b -F qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.6ca1b7fe-c168-48c8-8ccf-8ee483def4ad {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:53:57 devstack sudo[86645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.45d921d6-8f00-483b-9870-d8741deb813b -F qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.6ca1b7fe-c168-48c8-8ccf-8ee483def4ad Apr 22 17:53:57 devstack sudo[86645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:53:58 devstack sudo[86645]: pam_unix(sudo:session): session closed for user root Apr 22 17:53:58 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-c04cf24a-c52c-454d-a2a0-f3402af8b3dc tempest-SnapshotsActionsTest-1651779649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.45d921d6-8f00-483b-9870-d8741deb813b -F qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.6ca1b7fe-c168-48c8-8ccf-8ee483def4ad" returned: 0 in 0.754s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:53:58 devstack cinder-volume[81771]: WARNING cinder.volume.drivers.remotefs [None req-c04cf24a-c52c-454d-a2a0-f3402af8b3dc tempest-SnapshotsActionsTest-1651779649 None] /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.6ca1b7fe-c168-48c8-8ccf-8ee483def4ad is being set with open permissions: ugo+rw Apr 22 17:53:58 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-c04cf24a-c52c-454d-a2a0-f3402af8b3dc tempest-SnapshotsActionsTest-1651779649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.6ca1b7fe-c168-48c8-8ccf-8ee483def4ad {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:53:58 devstack sudo[86658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.6ca1b7fe-c168-48c8-8ccf-8ee483def4ad Apr 22 17:53:58 devstack sudo[86658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:53:59 devstack sudo[86658]: pam_unix(sudo:session): session closed for user root Apr 22 17:53:59 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-c04cf24a-c52c-454d-a2a0-f3402af8b3dc tempest-SnapshotsActionsTest-1651779649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.6ca1b7fe-c168-48c8-8ccf-8ee483def4ad" returned: 0 in 0.952s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:53:59 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-c04cf24a-c52c-454d-a2a0-f3402af8b3dc tempest-SnapshotsActionsTest-1651779649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.139s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:53:59 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-c04cf24a-c52c-454d-a2a0-f3402af8b3dc tempest-SnapshotsActionsTest-1651779649 None] Create snapshot completed successfully Apr 22 17:54:00 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-4a12ce2f-dac4-477f-9dd8-cac6ee6b27b3 tempest-SnapshotsActionsTest-13922162 None] Acquiring lock "cinder-6ca1b7fe-c168-48c8-8ccf-8ee483def4ad-delete_snapshot" by "delete_snapshot" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:54:00 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-4a12ce2f-dac4-477f-9dd8-cac6ee6b27b3 tempest-SnapshotsActionsTest-13922162 None] Lock "cinder-6ca1b7fe-c168-48c8-8ccf-8ee483def4ad-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:54:00 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-4a12ce2f-dac4-477f-9dd8-cac6ee6b27b3 tempest-SnapshotsActionsTest-13922162 None] Acquiring lock "cinder-quobyte-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d" by "delete_snapshot" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:54:00 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-4a12ce2f-dac4-477f-9dd8-cac6ee6b27b3 tempest-SnapshotsActionsTest-13922162 None] Lock "cinder-quobyte-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d" acquired by "delete_snapshot" :: waited 0.038s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:54:00 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-4a12ce2f-dac4-477f-9dd8-cac6ee6b27b3 tempest-SnapshotsActionsTest-13922162 None] Acquiring lock "cinder-quobyte-6ca1b7fe-c168-48c8-8ccf-8ee483def4ad" by "_delete_snapshot" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:54:00 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-4a12ce2f-dac4-477f-9dd8-cac6ee6b27b3 tempest-SnapshotsActionsTest-13922162 None] Lock "cinder-quobyte-6ca1b7fe-c168-48c8-8ccf-8ee483def4ad" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:54:00 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-4a12ce2f-dac4-477f-9dd8-cac6ee6b27b3 tempest-SnapshotsActionsTest-13922162 None] Deleting offline snapshot 6ca1b7fe-c168-48c8-8ccf-8ee483def4ad of volume 58cd87d4-3c93-4a3c-a3f7-1bda6cea508d {{(pid=81771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 22 17:54:01 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-4a12ce2f-dac4-477f-9dd8-cac6ee6b27b3 tempest-SnapshotsActionsTest-13922162 None] snapshot_file for this snap is: volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.6ca1b7fe-c168-48c8-8ccf-8ee483def4ad {{(pid=81771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 22 17:54:01 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdb26b36-357c-4f68-9778-de3393730c95]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:54:01 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-4a12ce2f-dac4-477f-9dd8-cac6ee6b27b3 tempest-SnapshotsActionsTest-13922162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.6ca1b7fe-c168-48c8-8ccf-8ee483def4ad {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:54:01 devstack sudo[86685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.6ca1b7fe-c168-48c8-8ccf-8ee483def4ad Apr 22 17:54:01 devstack sudo[86685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:54:01 devstack sudo[86685]: pam_unix(sudo:session): session closed for user root Apr 22 17:54:01 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-4a12ce2f-dac4-477f-9dd8-cac6ee6b27b3 tempest-SnapshotsActionsTest-13922162 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.6ca1b7fe-c168-48c8-8ccf-8ee483def4ad" returned: 0 in 0.773s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:54:01 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-4a12ce2f-dac4-477f-9dd8-cac6ee6b27b3 tempest-SnapshotsActionsTest-13922162 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81771) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 22 17:54:01 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c0273a2-bacd-491d-86cb-d2d749e6aab7]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:54:01 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-4a12ce2f-dac4-477f-9dd8-cac6ee6b27b3 tempest-SnapshotsActionsTest-13922162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.45d921d6-8f00-483b-9870-d8741deb813b {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:54:02 devstack sudo[86691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.45d921d6-8f00-483b-9870-d8741deb813b Apr 22 17:54:02 devstack sudo[86691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:54:02 devstack sudo[86691]: pam_unix(sudo:session): session closed for user root Apr 22 17:54:02 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-4a12ce2f-dac4-477f-9dd8-cac6ee6b27b3 tempest-SnapshotsActionsTest-13922162 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.45d921d6-8f00-483b-9870-d8741deb813b" returned: 0 in 0.844s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:54:02 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-4a12ce2f-dac4-477f-9dd8-cac6ee6b27b3 tempest-SnapshotsActionsTest-13922162 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81771) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 22 17:54:02 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-4a12ce2f-dac4-477f-9dd8-cac6ee6b27b3 tempest-SnapshotsActionsTest-13922162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.6ca1b7fe-c168-48c8-8ccf-8ee483def4ad {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:54:02 devstack sudo[86697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.6ca1b7fe-c168-48c8-8ccf-8ee483def4ad Apr 22 17:54:02 devstack sudo[86697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:54:03 devstack sudo[86697]: pam_unix(sudo:session): session closed for user root Apr 22 17:54:03 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-4a12ce2f-dac4-477f-9dd8-cac6ee6b27b3 tempest-SnapshotsActionsTest-13922162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.6ca1b7fe-c168-48c8-8ccf-8ee483def4ad" returned: 0 in 0.868s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:54:03 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-4a12ce2f-dac4-477f-9dd8-cac6ee6b27b3 tempest-SnapshotsActionsTest-13922162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.6ca1b7fe-c168-48c8-8ccf-8ee483def4ad {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:54:03 devstack sudo[86702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.6ca1b7fe-c168-48c8-8ccf-8ee483def4ad Apr 22 17:54:03 devstack sudo[86702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:54:04 devstack sudo[86702]: pam_unix(sudo:session): session closed for user root Apr 22 17:54:04 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-4a12ce2f-dac4-477f-9dd8-cac6ee6b27b3 tempest-SnapshotsActionsTest-13922162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.6ca1b7fe-c168-48c8-8ccf-8ee483def4ad" returned: 0 in 0.650s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:54:04 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-4a12ce2f-dac4-477f-9dd8-cac6ee6b27b3 tempest-SnapshotsActionsTest-13922162 None] Lock "cinder-quobyte-6ca1b7fe-c168-48c8-8ccf-8ee483def4ad" released by "_delete_snapshot" :: held 3.296s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:54:04 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-4a12ce2f-dac4-477f-9dd8-cac6ee6b27b3 tempest-SnapshotsActionsTest-13922162 None] Lock "cinder-quobyte-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d" released by "delete_snapshot" :: held 3.327s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:54:04 devstack cinder-volume[81771]: DEBUG dbcounter [-] [81771] Writing DB stats cinder:SELECT=152,cinder:UPDATE=162,cinder:INSERT=44,cinder:DELETE=10 {{(pid=81771) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 22 17:54:04 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-4a12ce2f-dac4-477f-9dd8-cac6ee6b27b3 tempest-SnapshotsActionsTest-13922162 None] Created reservations ['5c40a87e-f9d9-47f6-b3ed-5ed4d780260e', 'f85b31a2-c3c1-47da-9d7c-2e1707d11c61', '7ae4e998-e839-4908-8a46-e1bb93145360', 'ae8d244d-ba84-48e5-a793-f29bd4df02cc'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 17:54:04 devstack cinder-volume[81771]: DEBUG cinder.volume.flows.manager.create_volume [None req-08b978c1-960a-4a32-b727-7806fb38d5f4 tempest-VolumesTransfersV355Test-1495773409 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 17:54:04 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-08b978c1-960a-4a32-b727-7806fb38d5f4 tempest-VolumesTransfersV355Test-1495773409 None] Flow 'volume_create_manager' (472b529b-42b1-4c18-bad3-3151757d3414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:54:04 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-08b978c1-960a-4a32-b727-7806fb38d5f4 tempest-VolumesTransfersV355Test-1495773409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0c5a73d-ccbc-40a9-8980-5ca581e8f1e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:54:04 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-08b978c1-960a-4a32-b727-7806fb38d5f4 tempest-VolumesTransfersV355Test-1495773409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0c5a73d-ccbc-40a9-8980-5ca581e8f1e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:54:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-416320080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97292ad6-522c-4c83-85f5-0046487da997,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43a05551c74748f985dc64e35be066e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:54:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:54:04Z,use_quota=True,user_id='e54571368b2d4d589e0727fb254964ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:54:04 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-08b978c1-960a-4a32-b727-7806fb38d5f4 tempest-VolumesTransfersV355Test-1495773409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15902eac-30d2-4d5d-b68f-193360a3b15b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:54:04 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-08b978c1-960a-4a32-b727-7806fb38d5f4 tempest-VolumesTransfersV355Test-1495773409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15902eac-30d2-4d5d-b68f-193360a3b15b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:54:04 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-08b978c1-960a-4a32-b727-7806fb38d5f4 tempest-VolumesTransfersV355Test-1495773409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c4f6191-8c58-49b8-8623-8d636e50d829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:54:04 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-08b978c1-960a-4a32-b727-7806fb38d5f4 tempest-VolumesTransfersV355Test-1495773409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c4f6191-8c58-49b8-8623-8d636e50d829) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97292ad6-522c-4c83-85f5-0046487da997', 'volume_name': 'volume-97292ad6-522c-4c83-85f5-0046487da997', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:54:04 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-08b978c1-960a-4a32-b727-7806fb38d5f4 tempest-VolumesTransfersV355Test-1495773409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (855aa09a-092d-465b-9d7a-ed8432c515a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:54:04 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-08b978c1-960a-4a32-b727-7806fb38d5f4 tempest-VolumesTransfersV355Test-1495773409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (855aa09a-092d-465b-9d7a-ed8432c515a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:54:04 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-08b978c1-960a-4a32-b727-7806fb38d5f4 tempest-VolumesTransfersV355Test-1495773409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91013708-d01b-4172-af76-c5432c6bfaa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:54:04 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-08b978c1-960a-4a32-b727-7806fb38d5f4 tempest-VolumesTransfersV355Test-1495773409 None] Volume 97292ad6-522c-4c83-85f5-0046487da997: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97292ad6-522c-4c83-85f5-0046487da997', 'volume_size': 1} Apr 22 17:54:04 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-08b978c1-960a-4a32-b727-7806fb38d5f4 tempest-VolumesTransfersV355Test-1495773409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:54:04 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-08b978c1-960a-4a32-b727-7806fb38d5f4 tempest-VolumesTransfersV355Test-1495773409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:54:04 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-08b978c1-960a-4a32-b727-7806fb38d5f4 tempest-VolumesTransfersV355Test-1495773409 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:54:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-416320080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97292ad6-522c-4c83-85f5-0046487da997,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43a05551c74748f985dc64e35be066e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:54:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:54:04Z,use_quota=True,user_id='e54571368b2d4d589e0727fb254964ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)}" {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 17:54:04 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-08b978c1-960a-4a32-b727-7806fb38d5f4 tempest-VolumesTransfersV355Test-1495773409 None] Creating volume 97292ad6-522c-4c83-85f5-0046487da997 {{(pid=81771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 17:54:04 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-08b978c1-960a-4a32-b727-7806fb38d5f4 tempest-VolumesTransfersV355Test-1495773409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:54:04 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-08b978c1-960a-4a32-b727-7806fb38d5f4 tempest-VolumesTransfersV355Test-1495773409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:54:04 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-08b978c1-960a-4a32-b727-7806fb38d5f4 tempest-VolumesTransfersV355Test-1495773409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:54:04 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-08b978c1-960a-4a32-b727-7806fb38d5f4 tempest-VolumesTransfersV355Test-1495773409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:54:04 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-08b978c1-960a-4a32-b727-7806fb38d5f4 tempest-VolumesTransfersV355Test-1495773409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:54:04 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-08b978c1-960a-4a32-b727-7806fb38d5f4 tempest-VolumesTransfersV355Test-1495773409 None] Selected osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 as target Quobyte volume. {{(pid=81771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 17:54:04 devstack cinder-volume[81771]: INFO cinder.volume.drivers.remotefs [None req-08b978c1-960a-4a32-b727-7806fb38d5f4 tempest-VolumesTransfersV355Test-1495773409 None] casted to osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 Apr 22 17:54:04 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-08b978c1-960a-4a32-b727-7806fb38d5f4 tempest-VolumesTransfersV355Test-1495773409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-97292ad6-522c-4c83-85f5-0046487da997 1073741824 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:54:04 devstack sudo[86705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-97292ad6-522c-4c83-85f5-0046487da997 1073741824 Apr 22 17:54:04 devstack sudo[86705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:54:04 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-4a12ce2f-dac4-477f-9dd8-cac6ee6b27b3 tempest-SnapshotsActionsTest-13922162 None] Delete snapshot completed successfully. Apr 22 17:54:04 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-4a12ce2f-dac4-477f-9dd8-cac6ee6b27b3 tempest-SnapshotsActionsTest-13922162 None] Lock "cinder-6ca1b7fe-c168-48c8-8ccf-8ee483def4ad-delete_snapshot" released by "delete_snapshot" :: held 3.690s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:54:05 devstack sudo[86705]: pam_unix(sudo:session): session closed for user root Apr 22 17:54:05 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-08b978c1-960a-4a32-b727-7806fb38d5f4 tempest-VolumesTransfersV355Test-1495773409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-97292ad6-522c-4c83-85f5-0046487da997 1073741824" returned: 0 in 0.829s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:54:05 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-08b978c1-960a-4a32-b727-7806fb38d5f4 tempest-VolumesTransfersV355Test-1495773409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-97292ad6-522c-4c83-85f5-0046487da997 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:54:05 devstack sudo[86710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-97292ad6-522c-4c83-85f5-0046487da997 Apr 22 17:54:05 devstack sudo[86710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:54:05 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-026ea463-907b-406b-a51f-706a7fe76f3d tempest-SnapshotsActionsTest-1651779649 None] Acquiring lock "cinder-45d921d6-8f00-483b-9870-d8741deb813b-delete_snapshot" by "delete_snapshot" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:54:05 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-026ea463-907b-406b-a51f-706a7fe76f3d tempest-SnapshotsActionsTest-1651779649 None] Lock "cinder-45d921d6-8f00-483b-9870-d8741deb813b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.053s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:54:05 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-026ea463-907b-406b-a51f-706a7fe76f3d tempest-SnapshotsActionsTest-1651779649 None] Acquiring lock "cinder-quobyte-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d" by "delete_snapshot" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:54:05 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-026ea463-907b-406b-a51f-706a7fe76f3d tempest-SnapshotsActionsTest-1651779649 None] Lock "cinder-quobyte-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d" acquired by "delete_snapshot" :: waited 0.025s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:54:05 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-026ea463-907b-406b-a51f-706a7fe76f3d tempest-SnapshotsActionsTest-1651779649 None] Acquiring lock "cinder-quobyte-45d921d6-8f00-483b-9870-d8741deb813b" by "_delete_snapshot" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:54:05 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-026ea463-907b-406b-a51f-706a7fe76f3d tempest-SnapshotsActionsTest-1651779649 None] Lock "cinder-quobyte-45d921d6-8f00-483b-9870-d8741deb813b" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:54:05 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-026ea463-907b-406b-a51f-706a7fe76f3d tempest-SnapshotsActionsTest-1651779649 None] Deleting offline snapshot 45d921d6-8f00-483b-9870-d8741deb813b of volume 58cd87d4-3c93-4a3c-a3f7-1bda6cea508d {{(pid=81771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 22 17:54:05 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-026ea463-907b-406b-a51f-706a7fe76f3d tempest-SnapshotsActionsTest-1651779649 None] snapshot_file for this snap is: volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.45d921d6-8f00-483b-9870-d8741deb813b {{(pid=81771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 22 17:54:05 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[0530efd0-b0e1-45d8-9973-c9d4922ede8e]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:54:05 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-026ea463-907b-406b-a51f-706a7fe76f3d tempest-SnapshotsActionsTest-1651779649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.45d921d6-8f00-483b-9870-d8741deb813b {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:54:05 devstack cinder-volume[81771]: DEBUG cinder.volume.flows.manager.create_volume [None req-581f72c5-bce2-4915-ab59-25c6c8a1d838 tempest-VolumeRetypeWithoutMigrationTest-2062300280 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 17:54:05 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-581f72c5-bce2-4915-ab59-25c6c8a1d838 tempest-VolumeRetypeWithoutMigrationTest-2062300280 None] Flow 'volume_create_manager' (a7a862f0-cecf-453a-85c1-0a30f1b1134b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:54:05 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-581f72c5-bce2-4915-ab59-25c6c8a1d838 tempest-VolumeRetypeWithoutMigrationTest-2062300280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a489687-495b-4d66-bb6f-c4536e357162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:54:05 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-581f72c5-bce2-4915-ab59-25c6c8a1d838 tempest-VolumeRetypeWithoutMigrationTest-2062300280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a489687-495b-4d66-bb6f-c4536e357162) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:54:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-890825416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=377105f6-d8c2-41d4-bb04-87f2a3d31da5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be821082c0504ecb80ef43ca5242416b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:54:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:54:06Z,use_quota=True,user_id='2d93a4e00d104de78be41b4cf10f07d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f78b4483-ea2b-4878-9b2e-f86e8f625ae6),volume_type_id=f78b4483-ea2b-4878-9b2e-f86e8f625ae6)' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:54:05 devstack sudo[86712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.45d921d6-8f00-483b-9870-d8741deb813b Apr 22 17:54:05 devstack sudo[86712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:54:05 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-581f72c5-bce2-4915-ab59-25c6c8a1d838 tempest-VolumeRetypeWithoutMigrationTest-2062300280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a0773cc-d56e-4429-953b-18f2a9d136db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:54:05 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-581f72c5-bce2-4915-ab59-25c6c8a1d838 tempest-VolumeRetypeWithoutMigrationTest-2062300280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a0773cc-d56e-4429-953b-18f2a9d136db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:54:05 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-581f72c5-bce2-4915-ab59-25c6c8a1d838 tempest-VolumeRetypeWithoutMigrationTest-2062300280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23396d63-bb2d-4de9-a275-c88c720e9901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:54:05 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-581f72c5-bce2-4915-ab59-25c6c8a1d838 tempest-VolumeRetypeWithoutMigrationTest-2062300280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23396d63-bb2d-4de9-a275-c88c720e9901) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '377105f6-d8c2-41d4-bb04-87f2a3d31da5', 'volume_name': 'volume-377105f6-d8c2-41d4-bb04-87f2a3d31da5', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:54:05 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-581f72c5-bce2-4915-ab59-25c6c8a1d838 tempest-VolumeRetypeWithoutMigrationTest-2062300280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22691889-70fe-421c-80d8-191fe09d5e15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:54:05 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-581f72c5-bce2-4915-ab59-25c6c8a1d838 tempest-VolumeRetypeWithoutMigrationTest-2062300280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22691889-70fe-421c-80d8-191fe09d5e15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:54:05 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-581f72c5-bce2-4915-ab59-25c6c8a1d838 tempest-VolumeRetypeWithoutMigrationTest-2062300280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d45b491-5172-4dbc-a682-f0e83c28d542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:54:05 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-581f72c5-bce2-4915-ab59-25c6c8a1d838 tempest-VolumeRetypeWithoutMigrationTest-2062300280 None] Volume 377105f6-d8c2-41d4-bb04-87f2a3d31da5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-377105f6-d8c2-41d4-bb04-87f2a3d31da5', 'volume_size': 1} Apr 22 17:54:05 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-581f72c5-bce2-4915-ab59-25c6c8a1d838 tempest-VolumeRetypeWithoutMigrationTest-2062300280 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:54:06 devstack sudo[86710]: pam_unix(sudo:session): session closed for user root Apr 22 17:54:06 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-08b978c1-960a-4a32-b727-7806fb38d5f4 tempest-VolumesTransfersV355Test-1495773409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-97292ad6-522c-4c83-85f5-0046487da997" returned: 0 in 0.612s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:54:06 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-08b978c1-960a-4a32-b727-7806fb38d5f4 tempest-VolumesTransfersV355Test-1495773409 None] <== create_volume: return (1481ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'} {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 17:54:06 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-08b978c1-960a-4a32-b727-7806fb38d5f4 tempest-VolumesTransfersV355Test-1495773409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.483s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:54:06 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-581f72c5-bce2-4915-ab59-25c6c8a1d838 tempest-VolumeRetypeWithoutMigrationTest-2062300280 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.071s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:54:06 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-581f72c5-bce2-4915-ab59-25c6c8a1d838 tempest-VolumeRetypeWithoutMigrationTest-2062300280 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:54:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-890825416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=377105f6-d8c2-41d4-bb04-87f2a3d31da5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be821082c0504ecb80ef43ca5242416b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:54:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:54:06Z,use_quota=True,user_id='2d93a4e00d104de78be41b4cf10f07d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f78b4483-ea2b-4878-9b2e-f86e8f625ae6),volume_type_id=f78b4483-ea2b-4878-9b2e-f86e8f625ae6)}" {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 17:54:06 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-581f72c5-bce2-4915-ab59-25c6c8a1d838 tempest-VolumeRetypeWithoutMigrationTest-2062300280 None] Creating volume 377105f6-d8c2-41d4-bb04-87f2a3d31da5 {{(pid=81771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 17:54:06 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-581f72c5-bce2-4915-ab59-25c6c8a1d838 tempest-VolumeRetypeWithoutMigrationTest-2062300280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:54:06 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-581f72c5-bce2-4915-ab59-25c6c8a1d838 tempest-VolumeRetypeWithoutMigrationTest-2062300280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:54:06 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-581f72c5-bce2-4915-ab59-25c6c8a1d838 tempest-VolumeRetypeWithoutMigrationTest-2062300280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:54:06 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-581f72c5-bce2-4915-ab59-25c6c8a1d838 tempest-VolumeRetypeWithoutMigrationTest-2062300280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:54:06 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-581f72c5-bce2-4915-ab59-25c6c8a1d838 tempest-VolumeRetypeWithoutMigrationTest-2062300280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:54:06 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-581f72c5-bce2-4915-ab59-25c6c8a1d838 tempest-VolumeRetypeWithoutMigrationTest-2062300280 None] Selected osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 as target Quobyte volume. {{(pid=81771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 17:54:06 devstack cinder-volume[81771]: INFO cinder.volume.drivers.remotefs [None req-581f72c5-bce2-4915-ab59-25c6c8a1d838 tempest-VolumeRetypeWithoutMigrationTest-2062300280 None] casted to osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 Apr 22 17:54:06 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-581f72c5-bce2-4915-ab59-25c6c8a1d838 tempest-VolumeRetypeWithoutMigrationTest-2062300280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-377105f6-d8c2-41d4-bb04-87f2a3d31da5 1073741824 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:54:06 devstack sudo[86715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-377105f6-d8c2-41d4-bb04-87f2a3d31da5 1073741824 Apr 22 17:54:06 devstack sudo[86715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:54:06 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-08b978c1-960a-4a32-b727-7806fb38d5f4 tempest-VolumesTransfersV355Test-1495773409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91013708-d01b-4172-af76-c5432c6bfaa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97292ad6-522c-4c83-85f5-0046487da997', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:54:06 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-08b978c1-960a-4a32-b727-7806fb38d5f4 tempest-VolumesTransfersV355Test-1495773409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4513349d-1d45-404d-bb18-0799659f94a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:54:06 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-08b978c1-960a-4a32-b727-7806fb38d5f4 tempest-VolumesTransfersV355Test-1495773409 None] Volume volume-97292ad6-522c-4c83-85f5-0046487da997 (97292ad6-522c-4c83-85f5-0046487da997): created successfully Apr 22 17:54:06 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-08b978c1-960a-4a32-b727-7806fb38d5f4 tempest-VolumesTransfersV355Test-1495773409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4513349d-1d45-404d-bb18-0799659f94a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:54:06 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-08b978c1-960a-4a32-b727-7806fb38d5f4 tempest-VolumesTransfersV355Test-1495773409 None] Flow 'volume_create_manager' (472b529b-42b1-4c18-bad3-3151757d3414) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:54:06 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-08b978c1-960a-4a32-b727-7806fb38d5f4 tempest-VolumesTransfersV355Test-1495773409 None] Created volume successfully. Apr 22 17:54:06 devstack sudo[86712]: pam_unix(sudo:session): session closed for user root Apr 22 17:54:06 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-026ea463-907b-406b-a51f-706a7fe76f3d tempest-SnapshotsActionsTest-1651779649 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.45d921d6-8f00-483b-9870-d8741deb813b" returned: 0 in 0.595s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:54:06 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-026ea463-907b-406b-a51f-706a7fe76f3d tempest-SnapshotsActionsTest-1651779649 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81771) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 22 17:54:06 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0e4fe22-2c2b-4c8f-aec6-1ed701f3749a]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:54:06 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-026ea463-907b-406b-a51f-706a7fe76f3d tempest-SnapshotsActionsTest-1651779649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:54:06 devstack sudo[86723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d Apr 22 17:54:06 devstack sudo[86723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:54:06 devstack sudo[86715]: pam_unix(sudo:session): session closed for user root Apr 22 17:54:06 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-581f72c5-bce2-4915-ab59-25c6c8a1d838 tempest-VolumeRetypeWithoutMigrationTest-2062300280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-377105f6-d8c2-41d4-bb04-87f2a3d31da5 1073741824" returned: 0 in 0.819s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:54:06 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-581f72c5-bce2-4915-ab59-25c6c8a1d838 tempest-VolumeRetypeWithoutMigrationTest-2062300280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-377105f6-d8c2-41d4-bb04-87f2a3d31da5 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:54:06 devstack sudo[86726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-377105f6-d8c2-41d4-bb04-87f2a3d31da5 Apr 22 17:54:06 devstack sudo[86726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:54:07 devstack sudo[86723]: pam_unix(sudo:session): session closed for user root Apr 22 17:54:07 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-026ea463-907b-406b-a51f-706a7fe76f3d tempest-SnapshotsActionsTest-1651779649 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d" returned: 0 in 0.787s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:54:07 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-026ea463-907b-406b-a51f-706a7fe76f3d tempest-SnapshotsActionsTest-1651779649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.45d921d6-8f00-483b-9870-d8741deb813b {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:54:07 devstack sudo[86732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.45d921d6-8f00-483b-9870-d8741deb813b Apr 22 17:54:07 devstack sudo[86732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:54:07 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-24403347-0706-492d-b731-0145648c0b51 tempest-VolumesTransfersV355Test-402474969 None] Transfer volume completed successfully. Apr 22 17:54:07 devstack sudo[86726]: pam_unix(sudo:session): session closed for user root Apr 22 17:54:07 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-581f72c5-bce2-4915-ab59-25c6c8a1d838 tempest-VolumeRetypeWithoutMigrationTest-2062300280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-377105f6-d8c2-41d4-bb04-87f2a3d31da5" returned: 0 in 0.593s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:54:07 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-581f72c5-bce2-4915-ab59-25c6c8a1d838 tempest-VolumeRetypeWithoutMigrationTest-2062300280 None] <== create_volume: return (1462ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'} {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 17:54:07 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-581f72c5-bce2-4915-ab59-25c6c8a1d838 tempest-VolumeRetypeWithoutMigrationTest-2062300280 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.465s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:54:07 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-581f72c5-bce2-4915-ab59-25c6c8a1d838 tempest-VolumeRetypeWithoutMigrationTest-2062300280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d45b491-5172-4dbc-a682-f0e83c28d542) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-377105f6-d8c2-41d4-bb04-87f2a3d31da5', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:54:07 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-581f72c5-bce2-4915-ab59-25c6c8a1d838 tempest-VolumeRetypeWithoutMigrationTest-2062300280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (219e22a0-cc99-434c-b92c-73e9a676f4df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:54:07 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-581f72c5-bce2-4915-ab59-25c6c8a1d838 tempest-VolumeRetypeWithoutMigrationTest-2062300280 None] Volume volume-377105f6-d8c2-41d4-bb04-87f2a3d31da5 (377105f6-d8c2-41d4-bb04-87f2a3d31da5): created successfully Apr 22 17:54:07 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-581f72c5-bce2-4915-ab59-25c6c8a1d838 tempest-VolumeRetypeWithoutMigrationTest-2062300280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (219e22a0-cc99-434c-b92c-73e9a676f4df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:54:07 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-581f72c5-bce2-4915-ab59-25c6c8a1d838 tempest-VolumeRetypeWithoutMigrationTest-2062300280 None] Flow 'volume_create_manager' (a7a862f0-cecf-453a-85c1-0a30f1b1134b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:54:07 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-581f72c5-bce2-4915-ab59-25c6c8a1d838 tempest-VolumeRetypeWithoutMigrationTest-2062300280 None] Created volume successfully. Apr 22 17:54:08 devstack sudo[86732]: pam_unix(sudo:session): session closed for user root Apr 22 17:54:08 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-026ea463-907b-406b-a51f-706a7fe76f3d tempest-SnapshotsActionsTest-1651779649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.45d921d6-8f00-483b-9870-d8741deb813b" returned: 0 in 0.911s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:54:08 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-026ea463-907b-406b-a51f-706a7fe76f3d tempest-SnapshotsActionsTest-1651779649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.45d921d6-8f00-483b-9870-d8741deb813b {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:54:08 devstack sudo[86763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.45d921d6-8f00-483b-9870-d8741deb813b Apr 22 17:54:08 devstack sudo[86763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:54:08 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-b8de1b51-391b-410f-b944-19d1e5a61b0a tempest-VolumeRetypeWithoutMigrationTest-2062300280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:54:08 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-b8de1b51-391b-410f-b944-19d1e5a61b0a tempest-VolumeRetypeWithoutMigrationTest-2062300280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:54:08 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-b8de1b51-391b-410f-b944-19d1e5a61b0a tempest-VolumeRetypeWithoutMigrationTest-2062300280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:54:08 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-b8de1b51-391b-410f-b944-19d1e5a61b0a tempest-VolumeRetypeWithoutMigrationTest-2062300280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:54:08 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-b8de1b51-391b-410f-b944-19d1e5a61b0a tempest-VolumeRetypeWithoutMigrationTest-2062300280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:54:08 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-b8de1b51-391b-410f-b944-19d1e5a61b0a tempest-VolumeRetypeWithoutMigrationTest-2062300280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:54:08 devstack sudo[86767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 Apr 22 17:54:08 devstack sudo[86767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:54:08 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-c82f49af-aa56-4864-8f6f-82d13b3a06fa tempest-VolumesTransfersV355Test-359152681 None] Acquiring lock "cinder-97292ad6-522c-4c83-85f5-0046487da997-delete_volume" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:54:08 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-c82f49af-aa56-4864-8f6f-82d13b3a06fa tempest-VolumesTransfersV355Test-359152681 None] Lock "cinder-97292ad6-522c-4c83-85f5-0046487da997-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:54:08 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-c82f49af-aa56-4864-8f6f-82d13b3a06fa tempest-VolumesTransfersV355Test-359152681 None] Acquiring lock "cinder-quobyte-97292ad6-522c-4c83-85f5-0046487da997" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:54:08 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-c82f49af-aa56-4864-8f6f-82d13b3a06fa tempest-VolumesTransfersV355Test-359152681 None] Lock "cinder-quobyte-97292ad6-522c-4c83-85f5-0046487da997" acquired by "delete_volume" :: waited 0.025s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:54:08 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[e15deadd-0841-46b8-a6e9-2ee2818f79d5]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:54:08 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-c82f49af-aa56-4864-8f6f-82d13b3a06fa tempest-VolumesTransfersV355Test-359152681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-97292ad6-522c-4c83-85f5-0046487da997 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:54:08 devstack sudo[86763]: pam_unix(sudo:session): session closed for user root Apr 22 17:54:08 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-026ea463-907b-406b-a51f-706a7fe76f3d tempest-SnapshotsActionsTest-1651779649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d.45d921d6-8f00-483b-9870-d8741deb813b" returned: 0 in 0.691s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:54:08 devstack sudo[86770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-97292ad6-522c-4c83-85f5-0046487da997 Apr 22 17:54:08 devstack sudo[86770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:54:08 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-026ea463-907b-406b-a51f-706a7fe76f3d tempest-SnapshotsActionsTest-1651779649 None] Lock "cinder-quobyte-45d921d6-8f00-483b-9870-d8741deb813b" released by "_delete_snapshot" :: held 3.143s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:54:08 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-026ea463-907b-406b-a51f-706a7fe76f3d tempest-SnapshotsActionsTest-1651779649 None] Lock "cinder-quobyte-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d" released by "delete_snapshot" :: held 3.177s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:54:08 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-026ea463-907b-406b-a51f-706a7fe76f3d tempest-SnapshotsActionsTest-1651779649 None] Created reservations ['c91fb378-1150-4bd5-a133-e38ef2664742', '7b9aa145-cc64-4d53-8795-5d76e09f0099', 'a328f1c3-7f55-451a-a873-fd8f4b29ed60', '4312d721-14f0-4594-8366-e0c9c4063f42'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 17:54:09 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-026ea463-907b-406b-a51f-706a7fe76f3d tempest-SnapshotsActionsTest-1651779649 None] Delete snapshot completed successfully. Apr 22 17:54:09 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-026ea463-907b-406b-a51f-706a7fe76f3d tempest-SnapshotsActionsTest-1651779649 None] Lock "cinder-45d921d6-8f00-483b-9870-d8741deb813b-delete_snapshot" released by "delete_snapshot" :: held 3.327s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:54:09 devstack sudo[86767]: pam_unix(sudo:session): session closed for user root Apr 22 17:54:09 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-b8de1b51-391b-410f-b944-19d1e5a61b0a tempest-VolumeRetypeWithoutMigrationTest-2062300280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33" returned: 0 in 0.566s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:54:09 devstack cinder-volume[81771]: DEBUG cinder.manager [None req-b8de1b51-391b-410f-b944-19d1e5a61b0a tempest-VolumeRetypeWithoutMigrationTest-2062300280 None] Notifying Schedulers of capabilities ... {{(pid=81771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 17:54:09 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-b8de1b51-391b-410f-b944-19d1e5a61b0a tempest-VolumeRetypeWithoutMigrationTest-2062300280 None] Retype volume completed successfully. Apr 22 17:54:09 devstack sudo[86770]: pam_unix(sudo:session): session closed for user root Apr 22 17:54:09 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-c82f49af-aa56-4864-8f6f-82d13b3a06fa tempest-VolumesTransfersV355Test-359152681 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-97292ad6-522c-4c83-85f5-0046487da997" returned: 0 in 0.570s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:54:09 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-c82f49af-aa56-4864-8f6f-82d13b3a06fa tempest-VolumesTransfersV355Test-359152681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-97292ad6-522c-4c83-85f5-0046487da997 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:54:09 devstack sudo[86777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-97292ad6-522c-4c83-85f5-0046487da997 Apr 22 17:54:09 devstack sudo[86777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:54:09 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-a5f1900f-f07c-47f5-902a-448d32a02430 tempest-VolumeRetypeWithoutMigrationTest-2062300280 None] Acquiring lock "cinder-377105f6-d8c2-41d4-bb04-87f2a3d31da5-delete_volume" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:54:09 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-a5f1900f-f07c-47f5-902a-448d32a02430 tempest-VolumeRetypeWithoutMigrationTest-2062300280 None] Lock "cinder-377105f6-d8c2-41d4-bb04-87f2a3d31da5-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:54:10 devstack sudo[86777]: pam_unix(sudo:session): session closed for user root Apr 22 17:54:10 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-a5f1900f-f07c-47f5-902a-448d32a02430 tempest-VolumeRetypeWithoutMigrationTest-2062300280 None] Acquiring lock "cinder-quobyte-377105f6-d8c2-41d4-bb04-87f2a3d31da5" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:54:10 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-c82f49af-aa56-4864-8f6f-82d13b3a06fa tempest-VolumesTransfersV355Test-359152681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-97292ad6-522c-4c83-85f5-0046487da997" returned: 0 in 0.607s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:54:10 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-c8ec6758-6ce2-47f8-8f5f-5fd0634afeb7 tempest-SnapshotsActionsTest-1651779649 None] Acquiring lock "cinder-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d-delete_volume" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:54:10 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-c82f49af-aa56-4864-8f6f-82d13b3a06fa tempest-VolumesTransfersV355Test-359152681 None] Lock "cinder-quobyte-97292ad6-522c-4c83-85f5-0046487da997" released by "delete_volume" :: held 1.236s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:54:10 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-a5f1900f-f07c-47f5-902a-448d32a02430 tempest-VolumeRetypeWithoutMigrationTest-2062300280 None] Lock "cinder-quobyte-377105f6-d8c2-41d4-bb04-87f2a3d31da5" acquired by "delete_volume" :: waited 0.042s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:54:10 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bebd317-f855-4a39-b5bc-d13b2a9d9c91]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:54:10 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-a5f1900f-f07c-47f5-902a-448d32a02430 tempest-VolumeRetypeWithoutMigrationTest-2062300280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-377105f6-d8c2-41d4-bb04-87f2a3d31da5 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:54:10 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-c8ec6758-6ce2-47f8-8f5f-5fd0634afeb7 tempest-SnapshotsActionsTest-1651779649 None] Lock "cinder-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:54:10 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-c8ec6758-6ce2-47f8-8f5f-5fd0634afeb7 tempest-SnapshotsActionsTest-1651779649 None] Acquiring lock "cinder-quobyte-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:54:10 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-c82f49af-aa56-4864-8f6f-82d13b3a06fa tempest-VolumesTransfersV355Test-359152681 None] Created reservations ['1d012730-33bf-43b4-8dd7-fe708c24be0f', 'd8298758-d2e3-4767-9dc6-a755de122591', 'c3accfad-15c7-400c-8f99-2508dfee309d', '0ac60a44-bf00-44ca-8c3c-53b9f4ddef30'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 17:54:10 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-c8ec6758-6ce2-47f8-8f5f-5fd0634afeb7 tempest-SnapshotsActionsTest-1651779649 None] Lock "cinder-quobyte-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d" acquired by "delete_volume" :: waited 0.021s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:54:10 devstack sudo[86781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-377105f6-d8c2-41d4-bb04-87f2a3d31da5 Apr 22 17:54:10 devstack sudo[86781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:54:10 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[e762fa83-8acd-4719-834f-1cb79568dd35]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:54:10 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-c8ec6758-6ce2-47f8-8f5f-5fd0634afeb7 tempest-SnapshotsActionsTest-1651779649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:54:10 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-c82f49af-aa56-4864-8f6f-82d13b3a06fa tempest-VolumesTransfersV355Test-359152681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:54:10 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-c82f49af-aa56-4864-8f6f-82d13b3a06fa tempest-VolumesTransfersV355Test-359152681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:54:10 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-c82f49af-aa56-4864-8f6f-82d13b3a06fa tempest-VolumesTransfersV355Test-359152681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:54:10 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-c82f49af-aa56-4864-8f6f-82d13b3a06fa tempest-VolumesTransfersV355Test-359152681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:54:10 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-c82f49af-aa56-4864-8f6f-82d13b3a06fa tempest-VolumesTransfersV355Test-359152681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:54:10 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-c82f49af-aa56-4864-8f6f-82d13b3a06fa tempest-VolumesTransfersV355Test-359152681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:54:10 devstack sudo[86784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 Apr 22 17:54:10 devstack sudo[86784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:54:10 devstack sudo[86783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d Apr 22 17:54:10 devstack sudo[86783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:54:10 devstack sudo[86781]: pam_unix(sudo:session): session closed for user root Apr 22 17:54:10 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-a5f1900f-f07c-47f5-902a-448d32a02430 tempest-VolumeRetypeWithoutMigrationTest-2062300280 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-377105f6-d8c2-41d4-bb04-87f2a3d31da5" returned: 0 in 0.616s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:54:10 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-a5f1900f-f07c-47f5-902a-448d32a02430 tempest-VolumeRetypeWithoutMigrationTest-2062300280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-377105f6-d8c2-41d4-bb04-87f2a3d31da5 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:54:10 devstack cinder-volume[81771]: INFO cinder.volume.manager [req-3ad72566-8ab4-4195-a088-44d5513694b4 req-3389031c-0902-4445-b9ef-75ed5f7dfc0b tempest-ServerBootFromVolumeStableRescueTest-800024217 None] Terminate volume connection completed successfully. Apr 22 17:54:10 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [req-3ad72566-8ab4-4195-a088-44d5513694b4 req-3389031c-0902-4445-b9ef-75ed5f7dfc0b tempest-ServerBootFromVolumeStableRescueTest-800024217 None] Deleting attachment 9af4eda2-f7a1-46c1-9723-3a441c24d971. {{(pid=81771) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 22 17:54:10 devstack sudo[86794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-377105f6-d8c2-41d4-bb04-87f2a3d31da5 Apr 22 17:54:10 devstack sudo[86794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:54:10 devstack sudo[86784]: pam_unix(sudo:session): session closed for user root Apr 22 17:54:10 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-c82f49af-aa56-4864-8f6f-82d13b3a06fa tempest-VolumesTransfersV355Test-359152681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33" returned: 0 in 0.509s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:54:10 devstack cinder-volume[81771]: DEBUG cinder.manager [None req-c82f49af-aa56-4864-8f6f-82d13b3a06fa tempest-VolumesTransfersV355Test-359152681 None] Notifying Schedulers of capabilities ... {{(pid=81771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 17:54:10 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-c82f49af-aa56-4864-8f6f-82d13b3a06fa tempest-VolumesTransfersV355Test-359152681 None] Deleted volume successfully. Apr 22 17:54:10 devstack sudo[86783]: pam_unix(sudo:session): session closed for user root Apr 22 17:54:10 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-c82f49af-aa56-4864-8f6f-82d13b3a06fa tempest-VolumesTransfersV355Test-359152681 None] Lock "cinder-97292ad6-522c-4c83-85f5-0046487da997-delete_volume" released by "delete_volume" :: held 2.100s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:54:10 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-c8ec6758-6ce2-47f8-8f5f-5fd0634afeb7 tempest-SnapshotsActionsTest-1651779649 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d" returned: 0 in 0.596s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:54:10 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-c8ec6758-6ce2-47f8-8f5f-5fd0634afeb7 tempest-SnapshotsActionsTest-1651779649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:54:10 devstack sudo[86796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d Apr 22 17:54:10 devstack sudo[86796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:54:11 devstack sudo[86794]: pam_unix(sudo:session): session closed for user root Apr 22 17:54:11 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-a5f1900f-f07c-47f5-902a-448d32a02430 tempest-VolumeRetypeWithoutMigrationTest-2062300280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-377105f6-d8c2-41d4-bb04-87f2a3d31da5" returned: 0 in 0.531s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:54:11 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-a5f1900f-f07c-47f5-902a-448d32a02430 tempest-VolumeRetypeWithoutMigrationTest-2062300280 None] Lock "cinder-quobyte-377105f6-d8c2-41d4-bb04-87f2a3d31da5" released by "delete_volume" :: held 1.196s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:54:11 devstack cinder-volume[81771]: WARNING cinder.quota [None req-a5f1900f-f07c-47f5-902a-448d32a02430 tempest-VolumeRetypeWithoutMigrationTest-2062300280 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 22 17:54:11 devstack cinder-volume[81771]: WARNING cinder.quota [None req-a5f1900f-f07c-47f5-902a-448d32a02430 tempest-VolumeRetypeWithoutMigrationTest-2062300280 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 22 17:54:11 devstack sudo[86796]: pam_unix(sudo:session): session closed for user root Apr 22 17:54:11 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-a5f1900f-f07c-47f5-902a-448d32a02430 tempest-VolumeRetypeWithoutMigrationTest-2062300280 None] Created reservations ['ecd6c158-7f07-4ac0-ab39-349629309a7a', '2a8a0597-de86-4158-b530-1276f54303a1', '8559366a-c2cc-4d1c-86e4-fc7c0695a8a0', '8e0e77a1-f630-4b73-9ef3-a9805f3ac71b'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 17:54:11 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-c8ec6758-6ce2-47f8-8f5f-5fd0634afeb7 tempest-SnapshotsActionsTest-1651779649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d" returned: 0 in 0.507s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:54:11 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-c8ec6758-6ce2-47f8-8f5f-5fd0634afeb7 tempest-SnapshotsActionsTest-1651779649 None] Lock "cinder-quobyte-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d" released by "delete_volume" :: held 1.188s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:54:11 devstack cinder-volume[81771]: DEBUG cinder.volume.flows.manager.create_volume [None req-0bd01f96-45e2-4115-9926-bcddf5cfb4ec tempest-VolumesTransfersV355Test-1495773409 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 17:54:11 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-0bd01f96-45e2-4115-9926-bcddf5cfb4ec tempest-VolumesTransfersV355Test-1495773409 None] Flow 'volume_create_manager' (177b7dda-29c7-4e8d-bfbf-6ed3dfff6f6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:54:11 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-0bd01f96-45e2-4115-9926-bcddf5cfb4ec tempest-VolumesTransfersV355Test-1495773409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3faf5d4-69f7-497c-9e8a-07d75259b9cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:54:11 devstack cinder-volume[81771]: DEBUG cinder.coordination [req-3ad72566-8ab4-4195-a088-44d5513694b4 req-de6c07b1-a28f-4a81-88a4-46323752c399 tempest-ServerBootFromVolumeStableRescueTest-800024217 None] Acquiring lock "cinder-a7107516-205a-44b0-b159-4965c9ded840-delete_volume" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:54:11 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-0bd01f96-45e2-4115-9926-bcddf5cfb4ec tempest-VolumesTransfersV355Test-1495773409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3faf5d4-69f7-497c-9e8a-07d75259b9cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:54:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1505357457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bead13c-929b-4e72-8595-e50ac02bbdff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43a05551c74748f985dc64e35be066e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:54:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:54:11Z,use_quota=True,user_id='e54571368b2d4d589e0727fb254964ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:54:11 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-0bd01f96-45e2-4115-9926-bcddf5cfb4ec tempest-VolumesTransfersV355Test-1495773409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9214435-d8ce-42c7-8441-7a1fd03c6ed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:54:11 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-0bd01f96-45e2-4115-9926-bcddf5cfb4ec tempest-VolumesTransfersV355Test-1495773409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9214435-d8ce-42c7-8441-7a1fd03c6ed1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:54:11 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-0bd01f96-45e2-4115-9926-bcddf5cfb4ec tempest-VolumesTransfersV355Test-1495773409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1539a606-cfd8-4b04-948b-ee5420bc1e81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:54:11 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-0bd01f96-45e2-4115-9926-bcddf5cfb4ec tempest-VolumesTransfersV355Test-1495773409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1539a606-cfd8-4b04-948b-ee5420bc1e81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3bead13c-929b-4e72-8595-e50ac02bbdff', 'volume_name': 'volume-3bead13c-929b-4e72-8595-e50ac02bbdff', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:54:11 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-0bd01f96-45e2-4115-9926-bcddf5cfb4ec tempest-VolumesTransfersV355Test-1495773409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a24aa652-df95-4089-a1c0-610b0f75bd42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:54:11 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-0bd01f96-45e2-4115-9926-bcddf5cfb4ec tempest-VolumesTransfersV355Test-1495773409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a24aa652-df95-4089-a1c0-610b0f75bd42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:54:11 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-0bd01f96-45e2-4115-9926-bcddf5cfb4ec tempest-VolumesTransfersV355Test-1495773409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6c0807b-49be-46af-ab6f-a16b9ad1b683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:54:11 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-0bd01f96-45e2-4115-9926-bcddf5cfb4ec tempest-VolumesTransfersV355Test-1495773409 None] Volume 3bead13c-929b-4e72-8595-e50ac02bbdff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3bead13c-929b-4e72-8595-e50ac02bbdff', 'volume_size': 1} Apr 22 17:54:11 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-0bd01f96-45e2-4115-9926-bcddf5cfb4ec tempest-VolumesTransfersV355Test-1495773409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:54:11 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-0bd01f96-45e2-4115-9926-bcddf5cfb4ec tempest-VolumesTransfersV355Test-1495773409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:54:11 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-0bd01f96-45e2-4115-9926-bcddf5cfb4ec tempest-VolumesTransfersV355Test-1495773409 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:54:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1505357457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bead13c-929b-4e72-8595-e50ac02bbdff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43a05551c74748f985dc64e35be066e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:54:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:54:11Z,use_quota=True,user_id='e54571368b2d4d589e0727fb254964ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)}" {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 17:54:11 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-0bd01f96-45e2-4115-9926-bcddf5cfb4ec tempest-VolumesTransfersV355Test-1495773409 None] Creating volume 3bead13c-929b-4e72-8595-e50ac02bbdff {{(pid=81771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 17:54:11 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-0bd01f96-45e2-4115-9926-bcddf5cfb4ec tempest-VolumesTransfersV355Test-1495773409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:54:11 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-0bd01f96-45e2-4115-9926-bcddf5cfb4ec tempest-VolumesTransfersV355Test-1495773409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:54:11 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-0bd01f96-45e2-4115-9926-bcddf5cfb4ec tempest-VolumesTransfersV355Test-1495773409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:54:11 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-0bd01f96-45e2-4115-9926-bcddf5cfb4ec tempest-VolumesTransfersV355Test-1495773409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:54:11 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-0bd01f96-45e2-4115-9926-bcddf5cfb4ec tempest-VolumesTransfersV355Test-1495773409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:54:11 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-0bd01f96-45e2-4115-9926-bcddf5cfb4ec tempest-VolumesTransfersV355Test-1495773409 None] Selected osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 as target Quobyte volume. {{(pid=81771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 17:54:11 devstack cinder-volume[81771]: INFO cinder.volume.drivers.remotefs [None req-0bd01f96-45e2-4115-9926-bcddf5cfb4ec tempest-VolumesTransfersV355Test-1495773409 None] casted to osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 Apr 22 17:54:11 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-0bd01f96-45e2-4115-9926-bcddf5cfb4ec tempest-VolumesTransfersV355Test-1495773409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-3bead13c-929b-4e72-8595-e50ac02bbdff 1073741824 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:54:11 devstack sudo[86800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-3bead13c-929b-4e72-8595-e50ac02bbdff 1073741824 Apr 22 17:54:11 devstack sudo[86800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:54:11 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-a5f1900f-f07c-47f5-902a-448d32a02430 tempest-VolumeRetypeWithoutMigrationTest-2062300280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:54:11 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-a5f1900f-f07c-47f5-902a-448d32a02430 tempest-VolumeRetypeWithoutMigrationTest-2062300280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:54:11 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-a5f1900f-f07c-47f5-902a-448d32a02430 tempest-VolumeRetypeWithoutMigrationTest-2062300280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:54:11 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-a5f1900f-f07c-47f5-902a-448d32a02430 tempest-VolumeRetypeWithoutMigrationTest-2062300280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:54:11 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-a5f1900f-f07c-47f5-902a-448d32a02430 tempest-VolumeRetypeWithoutMigrationTest-2062300280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:54:11 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-a5f1900f-f07c-47f5-902a-448d32a02430 tempest-VolumeRetypeWithoutMigrationTest-2062300280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:54:11 devstack cinder-volume[81771]: DEBUG cinder.coordination [req-3ad72566-8ab4-4195-a088-44d5513694b4 req-de6c07b1-a28f-4a81-88a4-46323752c399 tempest-ServerBootFromVolumeStableRescueTest-800024217 None] Lock "cinder-a7107516-205a-44b0-b159-4965c9ded840-delete_volume" acquired by "delete_volume" :: waited 0.123s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:54:11 devstack sudo[86802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 Apr 22 17:54:11 devstack sudo[86802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:54:11 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-c8ec6758-6ce2-47f8-8f5f-5fd0634afeb7 tempest-SnapshotsActionsTest-1651779649 None] Created reservations ['1973f839-dcec-4416-88c2-d5f0cbfd6d68', 'ae5b87c4-cde5-4e28-a46e-cd86626a6db6', '2ec7f6b8-48a6-490f-8296-35b1d0cad97b', '85e6a93d-0865-4f84-82ca-76a09166121b'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 17:54:11 devstack cinder-volume[81771]: DEBUG cinder.coordination [req-3ad72566-8ab4-4195-a088-44d5513694b4 req-de6c07b1-a28f-4a81-88a4-46323752c399 tempest-ServerBootFromVolumeStableRescueTest-800024217 None] Acquiring lock "cinder-quobyte-a7107516-205a-44b0-b159-4965c9ded840" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:54:11 devstack cinder-volume[81771]: DEBUG cinder.coordination [req-3ad72566-8ab4-4195-a088-44d5513694b4 req-de6c07b1-a28f-4a81-88a4-46323752c399 tempest-ServerBootFromVolumeStableRescueTest-800024217 None] Lock "cinder-quobyte-a7107516-205a-44b0-b159-4965c9ded840" acquired by "delete_volume" :: waited 0.018s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:54:11 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d033aab-9c46-4056-9664-91652ccc606e]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:54:11 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [req-3ad72566-8ab4-4195-a088-44d5513694b4 req-de6c07b1-a28f-4a81-88a4-46323752c399 tempest-ServerBootFromVolumeStableRescueTest-800024217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a7107516-205a-44b0-b159-4965c9ded840 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:54:11 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-c8ec6758-6ce2-47f8-8f5f-5fd0634afeb7 tempest-SnapshotsActionsTest-1651779649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:54:11 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-c8ec6758-6ce2-47f8-8f5f-5fd0634afeb7 tempest-SnapshotsActionsTest-1651779649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:54:11 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-c8ec6758-6ce2-47f8-8f5f-5fd0634afeb7 tempest-SnapshotsActionsTest-1651779649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:54:11 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-c8ec6758-6ce2-47f8-8f5f-5fd0634afeb7 tempest-SnapshotsActionsTest-1651779649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:54:11 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-c8ec6758-6ce2-47f8-8f5f-5fd0634afeb7 tempest-SnapshotsActionsTest-1651779649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:54:11 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-c8ec6758-6ce2-47f8-8f5f-5fd0634afeb7 tempest-SnapshotsActionsTest-1651779649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:54:11 devstack sudo[86805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 Apr 22 17:54:11 devstack sudo[86805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:54:11 devstack sudo[86804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a7107516-205a-44b0-b159-4965c9ded840 Apr 22 17:54:11 devstack sudo[86804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:54:12 devstack sudo[86802]: pam_unix(sudo:session): session closed for user root Apr 22 17:54:12 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-a5f1900f-f07c-47f5-902a-448d32a02430 tempest-VolumeRetypeWithoutMigrationTest-2062300280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33" returned: 0 in 0.602s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:54:12 devstack cinder-volume[81771]: DEBUG cinder.manager [None req-a5f1900f-f07c-47f5-902a-448d32a02430 tempest-VolumeRetypeWithoutMigrationTest-2062300280 None] Notifying Schedulers of capabilities ... {{(pid=81771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 17:54:12 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-a5f1900f-f07c-47f5-902a-448d32a02430 tempest-VolumeRetypeWithoutMigrationTest-2062300280 None] Deleted volume successfully. Apr 22 17:54:12 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-a5f1900f-f07c-47f5-902a-448d32a02430 tempest-VolumeRetypeWithoutMigrationTest-2062300280 None] Lock "cinder-377105f6-d8c2-41d4-bb04-87f2a3d31da5-delete_volume" released by "delete_volume" :: held 2.272s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:54:12 devstack sudo[86800]: pam_unix(sudo:session): session closed for user root Apr 22 17:54:12 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-0bd01f96-45e2-4115-9926-bcddf5cfb4ec tempest-VolumesTransfersV355Test-1495773409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-3bead13c-929b-4e72-8595-e50ac02bbdff 1073741824" returned: 0 in 0.765s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:54:12 devstack sudo[86805]: pam_unix(sudo:session): session closed for user root Apr 22 17:54:12 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-0bd01f96-45e2-4115-9926-bcddf5cfb4ec tempest-VolumesTransfersV355Test-1495773409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-3bead13c-929b-4e72-8595-e50ac02bbdff {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:54:12 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-c8ec6758-6ce2-47f8-8f5f-5fd0634afeb7 tempest-SnapshotsActionsTest-1651779649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33" returned: 0 in 0.613s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:54:12 devstack cinder-volume[81771]: DEBUG cinder.manager [None req-c8ec6758-6ce2-47f8-8f5f-5fd0634afeb7 tempest-SnapshotsActionsTest-1651779649 None] Notifying Schedulers of capabilities ... {{(pid=81771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 17:54:12 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-c8ec6758-6ce2-47f8-8f5f-5fd0634afeb7 tempest-SnapshotsActionsTest-1651779649 None] Deleted volume successfully. Apr 22 17:54:12 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-c8ec6758-6ce2-47f8-8f5f-5fd0634afeb7 tempest-SnapshotsActionsTest-1651779649 None] Lock "cinder-58cd87d4-3c93-4a3c-a3f7-1bda6cea508d-delete_volume" released by "delete_volume" :: held 2.290s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:54:12 devstack sudo[86816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-3bead13c-929b-4e72-8595-e50ac02bbdff Apr 22 17:54:12 devstack sudo[86816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:54:12 devstack sudo[86804]: pam_unix(sudo:session): session closed for user root Apr 22 17:54:12 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [req-3ad72566-8ab4-4195-a088-44d5513694b4 req-de6c07b1-a28f-4a81-88a4-46323752c399 tempest-ServerBootFromVolumeStableRescueTest-800024217 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a7107516-205a-44b0-b159-4965c9ded840" returned: 0 in 0.777s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:54:12 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [req-3ad72566-8ab4-4195-a088-44d5513694b4 req-de6c07b1-a28f-4a81-88a4-46323752c399 tempest-ServerBootFromVolumeStableRescueTest-800024217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a7107516-205a-44b0-b159-4965c9ded840 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:54:12 devstack sudo[86818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a7107516-205a-44b0-b159-4965c9ded840 Apr 22 17:54:12 devstack sudo[86818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:54:13 devstack sudo[86818]: pam_unix(sudo:session): session closed for user root Apr 22 17:54:13 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [req-3ad72566-8ab4-4195-a088-44d5513694b4 req-de6c07b1-a28f-4a81-88a4-46323752c399 tempest-ServerBootFromVolumeStableRescueTest-800024217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a7107516-205a-44b0-b159-4965c9ded840" returned: 0 in 0.578s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:54:13 devstack cinder-volume[81771]: DEBUG cinder.coordination [req-3ad72566-8ab4-4195-a088-44d5513694b4 req-de6c07b1-a28f-4a81-88a4-46323752c399 tempest-ServerBootFromVolumeStableRescueTest-800024217 None] Lock "cinder-quobyte-a7107516-205a-44b0-b159-4965c9ded840" released by "delete_volume" :: held 1.399s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:54:13 devstack sudo[86816]: pam_unix(sudo:session): session closed for user root Apr 22 17:54:13 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-0bd01f96-45e2-4115-9926-bcddf5cfb4ec tempest-VolumesTransfersV355Test-1495773409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-3bead13c-929b-4e72-8595-e50ac02bbdff" returned: 0 in 0.783s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:54:13 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-0bd01f96-45e2-4115-9926-bcddf5cfb4ec tempest-VolumesTransfersV355Test-1495773409 None] <== create_volume: return (1599ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'} {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 17:54:13 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-0bd01f96-45e2-4115-9926-bcddf5cfb4ec tempest-VolumesTransfersV355Test-1495773409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.603s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:54:13 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-0bd01f96-45e2-4115-9926-bcddf5cfb4ec tempest-VolumesTransfersV355Test-1495773409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6c0807b-49be-46af-ab6f-a16b9ad1b683) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3bead13c-929b-4e72-8595-e50ac02bbdff', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:54:13 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-0bd01f96-45e2-4115-9926-bcddf5cfb4ec tempest-VolumesTransfersV355Test-1495773409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82dda3dd-f7f1-4ab6-b118-dae41ac18ff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:54:13 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-0bd01f96-45e2-4115-9926-bcddf5cfb4ec tempest-VolumesTransfersV355Test-1495773409 None] Volume volume-3bead13c-929b-4e72-8595-e50ac02bbdff (3bead13c-929b-4e72-8595-e50ac02bbdff): created successfully Apr 22 17:54:13 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-0bd01f96-45e2-4115-9926-bcddf5cfb4ec tempest-VolumesTransfersV355Test-1495773409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82dda3dd-f7f1-4ab6-b118-dae41ac18ff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:54:13 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-0bd01f96-45e2-4115-9926-bcddf5cfb4ec tempest-VolumesTransfersV355Test-1495773409 None] Flow 'volume_create_manager' (177b7dda-29c7-4e8d-bfbf-6ed3dfff6f6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:54:13 devstack cinder-volume[81771]: DEBUG cinder.quota [req-3ad72566-8ab4-4195-a088-44d5513694b4 req-de6c07b1-a28f-4a81-88a4-46323752c399 tempest-ServerBootFromVolumeStableRescueTest-800024217 None] Created reservations ['ffdc19b0-5185-4ec6-bae1-10c9af770115', '64a2bfee-5e6b-42dd-ae8c-21f844eacaed', '938d423e-bd5e-4065-b35d-0a4a15990442', '74785b5f-85c5-4e71-92d6-68e10252aecc'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 17:54:13 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-0bd01f96-45e2-4115-9926-bcddf5cfb4ec tempest-VolumesTransfersV355Test-1495773409 None] Created volume successfully. Apr 22 17:54:13 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [req-3ad72566-8ab4-4195-a088-44d5513694b4 req-de6c07b1-a28f-4a81-88a4-46323752c399 tempest-ServerBootFromVolumeStableRescueTest-800024217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:54:13 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [req-3ad72566-8ab4-4195-a088-44d5513694b4 req-de6c07b1-a28f-4a81-88a4-46323752c399 tempest-ServerBootFromVolumeStableRescueTest-800024217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:54:13 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [req-3ad72566-8ab4-4195-a088-44d5513694b4 req-de6c07b1-a28f-4a81-88a4-46323752c399 tempest-ServerBootFromVolumeStableRescueTest-800024217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:54:13 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [req-3ad72566-8ab4-4195-a088-44d5513694b4 req-de6c07b1-a28f-4a81-88a4-46323752c399 tempest-ServerBootFromVolumeStableRescueTest-800024217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:54:13 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [req-3ad72566-8ab4-4195-a088-44d5513694b4 req-de6c07b1-a28f-4a81-88a4-46323752c399 tempest-ServerBootFromVolumeStableRescueTest-800024217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:54:13 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [req-3ad72566-8ab4-4195-a088-44d5513694b4 req-de6c07b1-a28f-4a81-88a4-46323752c399 tempest-ServerBootFromVolumeStableRescueTest-800024217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:54:13 devstack sudo[86822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 Apr 22 17:54:13 devstack sudo[86822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:54:14 devstack sudo[86822]: pam_unix(sudo:session): session closed for user root Apr 22 17:54:14 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [req-3ad72566-8ab4-4195-a088-44d5513694b4 req-de6c07b1-a28f-4a81-88a4-46323752c399 tempest-ServerBootFromVolumeStableRescueTest-800024217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33" returned: 0 in 0.747s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:54:14 devstack cinder-volume[81771]: DEBUG cinder.manager [req-3ad72566-8ab4-4195-a088-44d5513694b4 req-de6c07b1-a28f-4a81-88a4-46323752c399 tempest-ServerBootFromVolumeStableRescueTest-800024217 None] Notifying Schedulers of capabilities ... {{(pid=81771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 17:54:14 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-b940c928-e797-4c02-b549-501bb970a069 tempest-VolumesTransfersV355Test-359152681 None] Acquiring lock "cinder-3bead13c-929b-4e72-8595-e50ac02bbdff-delete_volume" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:54:14 devstack cinder-volume[81771]: INFO cinder.volume.manager [req-3ad72566-8ab4-4195-a088-44d5513694b4 req-de6c07b1-a28f-4a81-88a4-46323752c399 tempest-ServerBootFromVolumeStableRescueTest-800024217 None] Deleted volume successfully. Apr 22 17:54:14 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-b940c928-e797-4c02-b549-501bb970a069 tempest-VolumesTransfersV355Test-359152681 None] Lock "cinder-3bead13c-929b-4e72-8595-e50ac02bbdff-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:54:14 devstack cinder-volume[81771]: DEBUG cinder.coordination [req-3ad72566-8ab4-4195-a088-44d5513694b4 req-de6c07b1-a28f-4a81-88a4-46323752c399 tempest-ServerBootFromVolumeStableRescueTest-800024217 None] Lock "cinder-a7107516-205a-44b0-b159-4965c9ded840-delete_volume" released by "delete_volume" :: held 2.575s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:54:14 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-b940c928-e797-4c02-b549-501bb970a069 tempest-VolumesTransfersV355Test-359152681 None] Acquiring lock "cinder-quobyte-3bead13c-929b-4e72-8595-e50ac02bbdff" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:54:14 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-b940c928-e797-4c02-b549-501bb970a069 tempest-VolumesTransfersV355Test-359152681 None] Lock "cinder-quobyte-3bead13c-929b-4e72-8595-e50ac02bbdff" acquired by "delete_volume" :: waited 0.016s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:54:14 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c5d500a-f8a1-48ea-8b5d-442853fd3525]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:54:14 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-b940c928-e797-4c02-b549-501bb970a069 tempest-VolumesTransfersV355Test-359152681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-3bead13c-929b-4e72-8595-e50ac02bbdff {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:54:14 devstack sudo[86825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-3bead13c-929b-4e72-8595-e50ac02bbdff Apr 22 17:54:14 devstack sudo[86825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:54:15 devstack sudo[86825]: pam_unix(sudo:session): session closed for user root Apr 22 17:54:15 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-b940c928-e797-4c02-b549-501bb970a069 tempest-VolumesTransfersV355Test-359152681 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-3bead13c-929b-4e72-8595-e50ac02bbdff" returned: 0 in 0.926s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:54:15 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-b940c928-e797-4c02-b549-501bb970a069 tempest-VolumesTransfersV355Test-359152681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-3bead13c-929b-4e72-8595-e50ac02bbdff {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:54:15 devstack sudo[86831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-3bead13c-929b-4e72-8595-e50ac02bbdff Apr 22 17:54:15 devstack sudo[86831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:54:15 devstack sudo[86831]: pam_unix(sudo:session): session closed for user root Apr 22 17:54:15 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-b940c928-e797-4c02-b549-501bb970a069 tempest-VolumesTransfersV355Test-359152681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-3bead13c-929b-4e72-8595-e50ac02bbdff" returned: 0 in 0.674s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:54:15 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-b940c928-e797-4c02-b549-501bb970a069 tempest-VolumesTransfersV355Test-359152681 None] Lock "cinder-quobyte-3bead13c-929b-4e72-8595-e50ac02bbdff" released by "delete_volume" :: held 1.645s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:54:15 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-b940c928-e797-4c02-b549-501bb970a069 tempest-VolumesTransfersV355Test-359152681 None] Created reservations ['785d5f2d-b5fd-4e43-aec0-446d999f3a87', '86746abd-b1fb-4edf-9d45-b03d2d7037c8', '54da8929-1e9f-4016-97cc-5df186901dd5', '192fdc81-bd84-43e5-b02e-89a796aba413'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 17:54:15 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-b940c928-e797-4c02-b549-501bb970a069 tempest-VolumesTransfersV355Test-359152681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:54:15 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-b940c928-e797-4c02-b549-501bb970a069 tempest-VolumesTransfersV355Test-359152681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:54:15 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-b940c928-e797-4c02-b549-501bb970a069 tempest-VolumesTransfersV355Test-359152681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:54:15 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-b940c928-e797-4c02-b549-501bb970a069 tempest-VolumesTransfersV355Test-359152681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:54:15 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-b940c928-e797-4c02-b549-501bb970a069 tempest-VolumesTransfersV355Test-359152681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:54:15 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-b940c928-e797-4c02-b549-501bb970a069 tempest-VolumesTransfersV355Test-359152681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:54:16 devstack sudo[86835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 Apr 22 17:54:16 devstack sudo[86835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:54:16 devstack sudo[86835]: pam_unix(sudo:session): session closed for user root Apr 22 17:54:16 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-b940c928-e797-4c02-b549-501bb970a069 tempest-VolumesTransfersV355Test-359152681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33" returned: 0 in 0.912s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:54:16 devstack cinder-volume[81771]: DEBUG cinder.manager [None req-b940c928-e797-4c02-b549-501bb970a069 tempest-VolumesTransfersV355Test-359152681 None] Notifying Schedulers of capabilities ... {{(pid=81771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 17:54:16 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-b940c928-e797-4c02-b549-501bb970a069 tempest-VolumesTransfersV355Test-359152681 None] Deleted volume successfully. Apr 22 17:54:16 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-b940c928-e797-4c02-b549-501bb970a069 tempest-VolumesTransfersV355Test-359152681 None] Lock "cinder-3bead13c-929b-4e72-8595-e50ac02bbdff-delete_volume" released by "delete_volume" :: held 2.765s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:54:25 devstack cinder-volume[81771]: DEBUG dbcounter [-] [81771] Writing DB stats cinder:SELECT=85,cinder:UPDATE=109,cinder:INSERT=30,cinder:DELETE=7 {{(pid=81771) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 22 17:54:26 devstack cinder-volume[81771]: DEBUG dbcounter [-] [81771] Writing DB stats cinder:SELECT=47,cinder:INSERT=15,cinder:UPDATE=57,cinder:DELETE=4 {{(pid=81771) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 22 17:54:29 devstack cinder-volume[81771]: DEBUG oslo_service.periodic_task [None req-1a7bdab5-8190-4e00-a2e2-843e5894ab49 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81771) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 22 17:54:29 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-1a7bdab5-8190-4e00-a2e2-843e5894ab49 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:54:29 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-1a7bdab5-8190-4e00-a2e2-843e5894ab49 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:54:29 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-1a7bdab5-8190-4e00-a2e2-843e5894ab49 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:54:29 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-1a7bdab5-8190-4e00-a2e2-843e5894ab49 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:54:29 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-1a7bdab5-8190-4e00-a2e2-843e5894ab49 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:54:29 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-1a7bdab5-8190-4e00-a2e2-843e5894ab49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:54:29 devstack sudo[86882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 Apr 22 17:54:29 devstack sudo[86882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:54:30 devstack cinder-volume[81771]: DEBUG cinder.volume.flows.manager.create_volume [None req-15fb752f-7d10-4080-9a47-a02ea761f374 tempest-VolumesServicesTestJSON-64619952 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 17:54:30 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-15fb752f-7d10-4080-9a47-a02ea761f374 tempest-VolumesServicesTestJSON-64619952 None] Flow 'volume_create_manager' (a784545b-f72e-4d8d-b7a7-7c1ade2b5de9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:54:30 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-15fb752f-7d10-4080-9a47-a02ea761f374 tempest-VolumesServicesTestJSON-64619952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38b94141-b581-46e3-9882-bd5a0c994d42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:54:30 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-15fb752f-7d10-4080-9a47-a02ea761f374 tempest-VolumesServicesTestJSON-64619952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38b94141-b581-46e3-9882-bd5a0c994d42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:54:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1760453334',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b9689f6-4e72-480f-b4f9-a13beb8ca3d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c07734081bb14eb7941e4087bfbd058b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:54:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:54:30Z,use_quota=True,user_id='1c90707c4cb64cdb9354367c5b0f5774',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:54:30 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-15fb752f-7d10-4080-9a47-a02ea761f374 tempest-VolumesServicesTestJSON-64619952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4b62b21-d49c-4ece-b08d-06bcbbd7d683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:54:30 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-15fb752f-7d10-4080-9a47-a02ea761f374 tempest-VolumesServicesTestJSON-64619952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4b62b21-d49c-4ece-b08d-06bcbbd7d683) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:54:30 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-15fb752f-7d10-4080-9a47-a02ea761f374 tempest-VolumesServicesTestJSON-64619952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d845171e-9553-4f49-bdcc-91f8bd0038b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:54:30 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-15fb752f-7d10-4080-9a47-a02ea761f374 tempest-VolumesServicesTestJSON-64619952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d845171e-9553-4f49-bdcc-91f8bd0038b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b9689f6-4e72-480f-b4f9-a13beb8ca3d6', 'volume_name': 'volume-0b9689f6-4e72-480f-b4f9-a13beb8ca3d6', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:54:30 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-15fb752f-7d10-4080-9a47-a02ea761f374 tempest-VolumesServicesTestJSON-64619952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74aacb74-4f8d-4e8e-a550-5788f0955747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:54:30 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-15fb752f-7d10-4080-9a47-a02ea761f374 tempest-VolumesServicesTestJSON-64619952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74aacb74-4f8d-4e8e-a550-5788f0955747) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:54:30 devstack sudo[86882]: pam_unix(sudo:session): session closed for user root Apr 22 17:54:30 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-15fb752f-7d10-4080-9a47-a02ea761f374 tempest-VolumesServicesTestJSON-64619952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00f385b4-4fc4-40fd-a157-9a2c0b67c8c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:54:30 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-15fb752f-7d10-4080-9a47-a02ea761f374 tempest-VolumesServicesTestJSON-64619952 None] Volume 0b9689f6-4e72-480f-b4f9-a13beb8ca3d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b9689f6-4e72-480f-b4f9-a13beb8ca3d6', 'volume_size': 1} Apr 22 17:54:30 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-15fb752f-7d10-4080-9a47-a02ea761f374 tempest-VolumesServicesTestJSON-64619952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:54:30 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-15fb752f-7d10-4080-9a47-a02ea761f374 tempest-VolumesServicesTestJSON-64619952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:54:30 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-15fb752f-7d10-4080-9a47-a02ea761f374 tempest-VolumesServicesTestJSON-64619952 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:54:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1760453334',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b9689f6-4e72-480f-b4f9-a13beb8ca3d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c07734081bb14eb7941e4087bfbd058b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:54:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:54:30Z,use_quota=True,user_id='1c90707c4cb64cdb9354367c5b0f5774',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)}" {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 17:54:30 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-15fb752f-7d10-4080-9a47-a02ea761f374 tempest-VolumesServicesTestJSON-64619952 None] Creating volume 0b9689f6-4e72-480f-b4f9-a13beb8ca3d6 {{(pid=81771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 17:54:30 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-15fb752f-7d10-4080-9a47-a02ea761f374 tempest-VolumesServicesTestJSON-64619952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:54:30 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-15fb752f-7d10-4080-9a47-a02ea761f374 tempest-VolumesServicesTestJSON-64619952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:54:30 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-15fb752f-7d10-4080-9a47-a02ea761f374 tempest-VolumesServicesTestJSON-64619952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:54:30 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-15fb752f-7d10-4080-9a47-a02ea761f374 tempest-VolumesServicesTestJSON-64619952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:54:30 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-15fb752f-7d10-4080-9a47-a02ea761f374 tempest-VolumesServicesTestJSON-64619952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:54:30 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-15fb752f-7d10-4080-9a47-a02ea761f374 tempest-VolumesServicesTestJSON-64619952 None] Selected osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 as target Quobyte volume. {{(pid=81771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 17:54:30 devstack cinder-volume[81771]: INFO cinder.volume.drivers.remotefs [None req-15fb752f-7d10-4080-9a47-a02ea761f374 tempest-VolumesServicesTestJSON-64619952 None] casted to osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 Apr 22 17:54:30 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-15fb752f-7d10-4080-9a47-a02ea761f374 tempest-VolumesServicesTestJSON-64619952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-0b9689f6-4e72-480f-b4f9-a13beb8ca3d6 1073741824 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:54:30 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-1a7bdab5-8190-4e00-a2e2-843e5894ab49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33" returned: 0 in 0.822s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:54:30 devstack cinder-volume[81771]: DEBUG cinder.manager [None req-1a7bdab5-8190-4e00-a2e2-843e5894ab49 None None] Notifying Schedulers of capabilities ... {{(pid=81771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 17:54:30 devstack sudo[86885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-0b9689f6-4e72-480f-b4f9-a13beb8ca3d6 1073741824 Apr 22 17:54:30 devstack sudo[86885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:54:31 devstack sudo[86885]: pam_unix(sudo:session): session closed for user root Apr 22 17:54:31 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-15fb752f-7d10-4080-9a47-a02ea761f374 tempest-VolumesServicesTestJSON-64619952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-0b9689f6-4e72-480f-b4f9-a13beb8ca3d6 1073741824" returned: 0 in 0.779s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:54:31 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-15fb752f-7d10-4080-9a47-a02ea761f374 tempest-VolumesServicesTestJSON-64619952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-0b9689f6-4e72-480f-b4f9-a13beb8ca3d6 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:54:31 devstack sudo[86890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-0b9689f6-4e72-480f-b4f9-a13beb8ca3d6 Apr 22 17:54:31 devstack sudo[86890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:54:32 devstack sudo[86890]: pam_unix(sudo:session): session closed for user root Apr 22 17:54:32 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-15fb752f-7d10-4080-9a47-a02ea761f374 tempest-VolumesServicesTestJSON-64619952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-0b9689f6-4e72-480f-b4f9-a13beb8ca3d6" returned: 0 in 0.784s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:54:32 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-15fb752f-7d10-4080-9a47-a02ea761f374 tempest-VolumesServicesTestJSON-64619952 None] <== create_volume: return (1623ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'} {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 17:54:32 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-15fb752f-7d10-4080-9a47-a02ea761f374 tempest-VolumesServicesTestJSON-64619952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.626s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:54:32 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-15fb752f-7d10-4080-9a47-a02ea761f374 tempest-VolumesServicesTestJSON-64619952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00f385b4-4fc4-40fd-a157-9a2c0b67c8c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b9689f6-4e72-480f-b4f9-a13beb8ca3d6', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:54:32 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-15fb752f-7d10-4080-9a47-a02ea761f374 tempest-VolumesServicesTestJSON-64619952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (992c509d-f078-4de7-b9a3-94643efa7f5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:54:32 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-15fb752f-7d10-4080-9a47-a02ea761f374 tempest-VolumesServicesTestJSON-64619952 None] Volume volume-0b9689f6-4e72-480f-b4f9-a13beb8ca3d6 (0b9689f6-4e72-480f-b4f9-a13beb8ca3d6): created successfully Apr 22 17:54:32 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-15fb752f-7d10-4080-9a47-a02ea761f374 tempest-VolumesServicesTestJSON-64619952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (992c509d-f078-4de7-b9a3-94643efa7f5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:54:32 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-15fb752f-7d10-4080-9a47-a02ea761f374 tempest-VolumesServicesTestJSON-64619952 None] Flow 'volume_create_manager' (a784545b-f72e-4d8d-b7a7-7c1ade2b5de9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:54:32 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-15fb752f-7d10-4080-9a47-a02ea761f374 tempest-VolumesServicesTestJSON-64619952 None] Created volume successfully. Apr 22 17:54:32 devstack cinder-volume[81771]: DEBUG cinder.volume.flows.manager.create_volume [req-24e8688a-5a3a-45c2-98b4-4dae383eaf09 req-c7a95073-5c0f-4cef-9670-dd07c5ccfbf9 tempest-VolumesGetTestJSON-1992253955 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 17:54:32 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [req-24e8688a-5a3a-45c2-98b4-4dae383eaf09 req-c7a95073-5c0f-4cef-9670-dd07c5ccfbf9 tempest-VolumesGetTestJSON-1992253955 None] Flow 'volume_create_manager' (761812bd-bd06-4b51-868d-4d988d37db3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:54:33 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [req-24e8688a-5a3a-45c2-98b4-4dae383eaf09 req-c7a95073-5c0f-4cef-9670-dd07c5ccfbf9 tempest-VolumesGetTestJSON-1992253955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76dcb1ca-4a45-49ce-ba13-03106aee55c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:54:33 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-dc69b6b8-3d61-49a3-bcf2-7afd65138b91 tempest-VolumesServicesTestJSON-64619952 None] Acquiring lock "cinder-0b9689f6-4e72-480f-b4f9-a13beb8ca3d6-delete_volume" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:54:33 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [req-24e8688a-5a3a-45c2-98b4-4dae383eaf09 req-c7a95073-5c0f-4cef-9670-dd07c5ccfbf9 tempest-VolumesGetTestJSON-1992253955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76dcb1ca-4a45-49ce-ba13-03106aee55c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:54:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-979723753',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d3ba95d-53aa-447d-93c2-99ebb329c8cf,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b92f06d7258c4841a1e2f755f8531591',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:54:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:54:33Z,use_quota=True,user_id='efa53daf219842a097b278ce1750900b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:54:33 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [req-24e8688a-5a3a-45c2-98b4-4dae383eaf09 req-c7a95073-5c0f-4cef-9670-dd07c5ccfbf9 tempest-VolumesGetTestJSON-1992253955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (613a6f85-41e7-4554-a3a0-0253a15c14e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:54:33 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [req-24e8688a-5a3a-45c2-98b4-4dae383eaf09 req-c7a95073-5c0f-4cef-9670-dd07c5ccfbf9 tempest-VolumesGetTestJSON-1992253955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (613a6f85-41e7-4554-a3a0-0253a15c14e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:54:33 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [req-24e8688a-5a3a-45c2-98b4-4dae383eaf09 req-c7a95073-5c0f-4cef-9670-dd07c5ccfbf9 tempest-VolumesGetTestJSON-1992253955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f78c8425-8aa6-4d4b-bd4f-611d48f56ddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:54:33 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [req-24e8688a-5a3a-45c2-98b4-4dae383eaf09 req-c7a95073-5c0f-4cef-9670-dd07c5ccfbf9 tempest-VolumesGetTestJSON-1992253955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f78c8425-8aa6-4d4b-bd4f-611d48f56ddd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d3ba95d-53aa-447d-93c2-99ebb329c8cf', 'volume_name': 'volume-3d3ba95d-53aa-447d-93c2-99ebb329c8cf', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:54:33 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [req-24e8688a-5a3a-45c2-98b4-4dae383eaf09 req-c7a95073-5c0f-4cef-9670-dd07c5ccfbf9 tempest-VolumesGetTestJSON-1992253955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d33d254-44f2-4aab-bf31-05d39e541610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:54:33 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [req-24e8688a-5a3a-45c2-98b4-4dae383eaf09 req-c7a95073-5c0f-4cef-9670-dd07c5ccfbf9 tempest-VolumesGetTestJSON-1992253955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d33d254-44f2-4aab-bf31-05d39e541610) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:54:33 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [req-24e8688a-5a3a-45c2-98b4-4dae383eaf09 req-c7a95073-5c0f-4cef-9670-dd07c5ccfbf9 tempest-VolumesGetTestJSON-1992253955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f5251a7-8c6e-4a78-92ac-32abb2bac0b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:54:33 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [req-24e8688a-5a3a-45c2-98b4-4dae383eaf09 req-c7a95073-5c0f-4cef-9670-dd07c5ccfbf9 tempest-VolumesGetTestJSON-1992253955 None] Volume 3d3ba95d-53aa-447d-93c2-99ebb329c8cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d3ba95d-53aa-447d-93c2-99ebb329c8cf', 'volume_size': 1} Apr 22 17:54:33 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [req-24e8688a-5a3a-45c2-98b4-4dae383eaf09 req-c7a95073-5c0f-4cef-9670-dd07c5ccfbf9 tempest-VolumesGetTestJSON-1992253955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:54:33 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [req-24e8688a-5a3a-45c2-98b4-4dae383eaf09 req-c7a95073-5c0f-4cef-9670-dd07c5ccfbf9 tempest-VolumesGetTestJSON-1992253955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:54:33 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [req-24e8688a-5a3a-45c2-98b4-4dae383eaf09 req-c7a95073-5c0f-4cef-9670-dd07c5ccfbf9 tempest-VolumesGetTestJSON-1992253955 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:54:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-979723753',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d3ba95d-53aa-447d-93c2-99ebb329c8cf,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b92f06d7258c4841a1e2f755f8531591',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:54:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:54:33Z,use_quota=True,user_id='efa53daf219842a097b278ce1750900b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)}" {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 17:54:33 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [req-24e8688a-5a3a-45c2-98b4-4dae383eaf09 req-c7a95073-5c0f-4cef-9670-dd07c5ccfbf9 tempest-VolumesGetTestJSON-1992253955 None] Creating volume 3d3ba95d-53aa-447d-93c2-99ebb329c8cf {{(pid=81771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 17:54:33 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [req-24e8688a-5a3a-45c2-98b4-4dae383eaf09 req-c7a95073-5c0f-4cef-9670-dd07c5ccfbf9 tempest-VolumesGetTestJSON-1992253955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:54:33 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [req-24e8688a-5a3a-45c2-98b4-4dae383eaf09 req-c7a95073-5c0f-4cef-9670-dd07c5ccfbf9 tempest-VolumesGetTestJSON-1992253955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:54:33 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [req-24e8688a-5a3a-45c2-98b4-4dae383eaf09 req-c7a95073-5c0f-4cef-9670-dd07c5ccfbf9 tempest-VolumesGetTestJSON-1992253955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:54:33 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [req-24e8688a-5a3a-45c2-98b4-4dae383eaf09 req-c7a95073-5c0f-4cef-9670-dd07c5ccfbf9 tempest-VolumesGetTestJSON-1992253955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:54:33 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [req-24e8688a-5a3a-45c2-98b4-4dae383eaf09 req-c7a95073-5c0f-4cef-9670-dd07c5ccfbf9 tempest-VolumesGetTestJSON-1992253955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:54:33 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [req-24e8688a-5a3a-45c2-98b4-4dae383eaf09 req-c7a95073-5c0f-4cef-9670-dd07c5ccfbf9 tempest-VolumesGetTestJSON-1992253955 None] Selected osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 as target Quobyte volume. {{(pid=81771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 17:54:33 devstack cinder-volume[81771]: INFO cinder.volume.drivers.remotefs [req-24e8688a-5a3a-45c2-98b4-4dae383eaf09 req-c7a95073-5c0f-4cef-9670-dd07c5ccfbf9 tempest-VolumesGetTestJSON-1992253955 None] casted to osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 Apr 22 17:54:33 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [req-24e8688a-5a3a-45c2-98b4-4dae383eaf09 req-c7a95073-5c0f-4cef-9670-dd07c5ccfbf9 tempest-VolumesGetTestJSON-1992253955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-3d3ba95d-53aa-447d-93c2-99ebb329c8cf 1073741824 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:54:33 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-dc69b6b8-3d61-49a3-bcf2-7afd65138b91 tempest-VolumesServicesTestJSON-64619952 None] Lock "cinder-0b9689f6-4e72-480f-b4f9-a13beb8ca3d6-delete_volume" acquired by "delete_volume" :: waited 0.146s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:54:33 devstack sudo[86893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-3d3ba95d-53aa-447d-93c2-99ebb329c8cf 1073741824 Apr 22 17:54:33 devstack sudo[86893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:54:33 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-dc69b6b8-3d61-49a3-bcf2-7afd65138b91 tempest-VolumesServicesTestJSON-64619952 None] Acquiring lock "cinder-quobyte-0b9689f6-4e72-480f-b4f9-a13beb8ca3d6" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:54:33 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-dc69b6b8-3d61-49a3-bcf2-7afd65138b91 tempest-VolumesServicesTestJSON-64619952 None] Lock "cinder-quobyte-0b9689f6-4e72-480f-b4f9-a13beb8ca3d6" acquired by "delete_volume" :: waited 0.019s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:54:33 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8b10d74-9ac0-49b7-b90e-adba69256651]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:54:33 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-dc69b6b8-3d61-49a3-bcf2-7afd65138b91 tempest-VolumesServicesTestJSON-64619952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-0b9689f6-4e72-480f-b4f9-a13beb8ca3d6 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:54:33 devstack sudo[86895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-0b9689f6-4e72-480f-b4f9-a13beb8ca3d6 Apr 22 17:54:33 devstack sudo[86895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:54:33 devstack cinder-volume[81771]: DEBUG cinder.volume.flows.manager.create_volume [None req-6420d81d-fe19-4f4a-8c60-8d20cc488c68 tempest-VolumesActionsTest-84916959 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 17:54:33 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-6420d81d-fe19-4f4a-8c60-8d20cc488c68 tempest-VolumesActionsTest-84916959 None] Flow 'volume_create_manager' (b5588074-14a9-4651-8c07-2dd1bab871b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:54:33 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-6420d81d-fe19-4f4a-8c60-8d20cc488c68 tempest-VolumesActionsTest-84916959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9375ee6-1c01-4129-bb06-8d64dca56b2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:54:33 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-6420d81d-fe19-4f4a-8c60-8d20cc488c68 tempest-VolumesActionsTest-84916959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9375ee6-1c01-4129-bb06-8d64dca56b2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:54:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-105426862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3664582-4810-4ace-9346-f53375c65ed6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86deb8e7fece483d80b78988af625cde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:54:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:54:34Z,use_quota=True,user_id='45807bf1a6e04402940ef17fd85757c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:54:33 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-6420d81d-fe19-4f4a-8c60-8d20cc488c68 tempest-VolumesActionsTest-84916959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8240575c-67df-44dd-acad-a081dfdfd6d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:54:33 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-6420d81d-fe19-4f4a-8c60-8d20cc488c68 tempest-VolumesActionsTest-84916959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8240575c-67df-44dd-acad-a081dfdfd6d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:54:33 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-6420d81d-fe19-4f4a-8c60-8d20cc488c68 tempest-VolumesActionsTest-84916959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c64e2e86-7341-4440-89e9-1623cfcdae9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:54:33 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-6420d81d-fe19-4f4a-8c60-8d20cc488c68 tempest-VolumesActionsTest-84916959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c64e2e86-7341-4440-89e9-1623cfcdae9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3664582-4810-4ace-9346-f53375c65ed6', 'volume_name': 'volume-e3664582-4810-4ace-9346-f53375c65ed6', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:54:33 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-6420d81d-fe19-4f4a-8c60-8d20cc488c68 tempest-VolumesActionsTest-84916959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8978b675-74a0-4e3b-8db2-18b60ced5ae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:54:33 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-6420d81d-fe19-4f4a-8c60-8d20cc488c68 tempest-VolumesActionsTest-84916959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8978b675-74a0-4e3b-8db2-18b60ced5ae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:54:33 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-6420d81d-fe19-4f4a-8c60-8d20cc488c68 tempest-VolumesActionsTest-84916959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3254598c-9c16-4827-acd9-ad477168aba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:54:33 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-6420d81d-fe19-4f4a-8c60-8d20cc488c68 tempest-VolumesActionsTest-84916959 None] Volume e3664582-4810-4ace-9346-f53375c65ed6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3664582-4810-4ace-9346-f53375c65ed6', 'volume_size': 1} Apr 22 17:54:33 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-6420d81d-fe19-4f4a-8c60-8d20cc488c68 tempest-VolumesActionsTest-84916959 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:54:34 devstack sudo[86893]: pam_unix(sudo:session): session closed for user root Apr 22 17:54:34 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [req-24e8688a-5a3a-45c2-98b4-4dae383eaf09 req-c7a95073-5c0f-4cef-9670-dd07c5ccfbf9 tempest-VolumesGetTestJSON-1992253955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-3d3ba95d-53aa-447d-93c2-99ebb329c8cf 1073741824" returned: 0 in 1.086s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:54:34 devstack sudo[86895]: pam_unix(sudo:session): session closed for user root Apr 22 17:54:34 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-dc69b6b8-3d61-49a3-bcf2-7afd65138b91 tempest-VolumesServicesTestJSON-64619952 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-0b9689f6-4e72-480f-b4f9-a13beb8ca3d6" returned: 0 in 0.910s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:54:34 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-dc69b6b8-3d61-49a3-bcf2-7afd65138b91 tempest-VolumesServicesTestJSON-64619952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-0b9689f6-4e72-480f-b4f9-a13beb8ca3d6 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:54:34 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [req-24e8688a-5a3a-45c2-98b4-4dae383eaf09 req-c7a95073-5c0f-4cef-9670-dd07c5ccfbf9 tempest-VolumesGetTestJSON-1992253955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-3d3ba95d-53aa-447d-93c2-99ebb329c8cf {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:54:34 devstack sudo[86903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-0b9689f6-4e72-480f-b4f9-a13beb8ca3d6 Apr 22 17:54:34 devstack sudo[86903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:54:34 devstack sudo[86905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-3d3ba95d-53aa-447d-93c2-99ebb329c8cf Apr 22 17:54:34 devstack sudo[86905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:54:34 devstack sudo[86903]: pam_unix(sudo:session): session closed for user root Apr 22 17:54:34 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-dc69b6b8-3d61-49a3-bcf2-7afd65138b91 tempest-VolumesServicesTestJSON-64619952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-0b9689f6-4e72-480f-b4f9-a13beb8ca3d6" returned: 0 in 0.603s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:54:34 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-dc69b6b8-3d61-49a3-bcf2-7afd65138b91 tempest-VolumesServicesTestJSON-64619952 None] Lock "cinder-quobyte-0b9689f6-4e72-480f-b4f9-a13beb8ca3d6" released by "delete_volume" :: held 1.586s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:54:34 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-dc69b6b8-3d61-49a3-bcf2-7afd65138b91 tempest-VolumesServicesTestJSON-64619952 None] Created reservations ['bef1fad0-4dde-4348-9937-5a9ceb3eb0a3', '52acdf7b-e8fb-4429-b49b-7190195d59c5', 'a4a411db-d46b-49f8-b57c-ec8763733181', '7b69b50b-3db5-4e67-b433-ecf824197906'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 17:54:34 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-dc69b6b8-3d61-49a3-bcf2-7afd65138b91 tempest-VolumesServicesTestJSON-64619952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:54:34 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-dc69b6b8-3d61-49a3-bcf2-7afd65138b91 tempest-VolumesServicesTestJSON-64619952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:54:34 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-dc69b6b8-3d61-49a3-bcf2-7afd65138b91 tempest-VolumesServicesTestJSON-64619952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:54:34 devstack sudo[86905]: pam_unix(sudo:session): session closed for user root Apr 22 17:54:34 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-dc69b6b8-3d61-49a3-bcf2-7afd65138b91 tempest-VolumesServicesTestJSON-64619952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:54:34 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-dc69b6b8-3d61-49a3-bcf2-7afd65138b91 tempest-VolumesServicesTestJSON-64619952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:54:34 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-dc69b6b8-3d61-49a3-bcf2-7afd65138b91 tempest-VolumesServicesTestJSON-64619952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:54:35 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [req-24e8688a-5a3a-45c2-98b4-4dae383eaf09 req-c7a95073-5c0f-4cef-9670-dd07c5ccfbf9 tempest-VolumesGetTestJSON-1992253955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-3d3ba95d-53aa-447d-93c2-99ebb329c8cf" returned: 0 in 0.731s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:54:35 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [req-24e8688a-5a3a-45c2-98b4-4dae383eaf09 req-c7a95073-5c0f-4cef-9670-dd07c5ccfbf9 tempest-VolumesGetTestJSON-1992253955 None] <== create_volume: return (1897ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'} {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 17:54:35 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [req-24e8688a-5a3a-45c2-98b4-4dae383eaf09 req-c7a95073-5c0f-4cef-9670-dd07c5ccfbf9 tempest-VolumesGetTestJSON-1992253955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.901s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:54:35 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-6420d81d-fe19-4f4a-8c60-8d20cc488c68 tempest-VolumesActionsTest-84916959 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.025s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:54:35 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-6420d81d-fe19-4f4a-8c60-8d20cc488c68 tempest-VolumesActionsTest-84916959 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:54:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-105426862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3664582-4810-4ace-9346-f53375c65ed6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86deb8e7fece483d80b78988af625cde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:54:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:54:34Z,use_quota=True,user_id='45807bf1a6e04402940ef17fd85757c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)}" {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 17:54:35 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-6420d81d-fe19-4f4a-8c60-8d20cc488c68 tempest-VolumesActionsTest-84916959 None] Creating volume e3664582-4810-4ace-9346-f53375c65ed6 {{(pid=81771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 17:54:35 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-6420d81d-fe19-4f4a-8c60-8d20cc488c68 tempest-VolumesActionsTest-84916959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:54:35 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-6420d81d-fe19-4f4a-8c60-8d20cc488c68 tempest-VolumesActionsTest-84916959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:54:35 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-6420d81d-fe19-4f4a-8c60-8d20cc488c68 tempest-VolumesActionsTest-84916959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:54:35 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-6420d81d-fe19-4f4a-8c60-8d20cc488c68 tempest-VolumesActionsTest-84916959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:54:35 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-6420d81d-fe19-4f4a-8c60-8d20cc488c68 tempest-VolumesActionsTest-84916959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:54:35 devstack sudo[86909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 Apr 22 17:54:35 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-6420d81d-fe19-4f4a-8c60-8d20cc488c68 tempest-VolumesActionsTest-84916959 None] Selected osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 as target Quobyte volume. {{(pid=81771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 17:54:35 devstack cinder-volume[81771]: INFO cinder.volume.drivers.remotefs [None req-6420d81d-fe19-4f4a-8c60-8d20cc488c68 tempest-VolumesActionsTest-84916959 None] casted to osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 Apr 22 17:54:35 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-6420d81d-fe19-4f4a-8c60-8d20cc488c68 tempest-VolumesActionsTest-84916959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e3664582-4810-4ace-9346-f53375c65ed6 1073741824 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:54:35 devstack sudo[86909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:54:35 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [req-24e8688a-5a3a-45c2-98b4-4dae383eaf09 req-c7a95073-5c0f-4cef-9670-dd07c5ccfbf9 tempest-VolumesGetTestJSON-1992253955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f5251a7-8c6e-4a78-92ac-32abb2bac0b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d3ba95d-53aa-447d-93c2-99ebb329c8cf', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:54:35 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [req-24e8688a-5a3a-45c2-98b4-4dae383eaf09 req-c7a95073-5c0f-4cef-9670-dd07c5ccfbf9 tempest-VolumesGetTestJSON-1992253955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00947a02-d057-41f4-8e11-8da66b4f7abf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:54:35 devstack sudo[86911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e3664582-4810-4ace-9346-f53375c65ed6 1073741824 Apr 22 17:54:35 devstack sudo[86911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:54:35 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [req-24e8688a-5a3a-45c2-98b4-4dae383eaf09 req-c7a95073-5c0f-4cef-9670-dd07c5ccfbf9 tempest-VolumesGetTestJSON-1992253955 None] Volume volume-3d3ba95d-53aa-447d-93c2-99ebb329c8cf (3d3ba95d-53aa-447d-93c2-99ebb329c8cf): created successfully Apr 22 17:54:35 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [req-24e8688a-5a3a-45c2-98b4-4dae383eaf09 req-c7a95073-5c0f-4cef-9670-dd07c5ccfbf9 tempest-VolumesGetTestJSON-1992253955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00947a02-d057-41f4-8e11-8da66b4f7abf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:54:35 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [req-24e8688a-5a3a-45c2-98b4-4dae383eaf09 req-c7a95073-5c0f-4cef-9670-dd07c5ccfbf9 tempest-VolumesGetTestJSON-1992253955 None] Flow 'volume_create_manager' (761812bd-bd06-4b51-868d-4d988d37db3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:54:35 devstack cinder-volume[81771]: INFO cinder.volume.manager [req-24e8688a-5a3a-45c2-98b4-4dae383eaf09 req-c7a95073-5c0f-4cef-9670-dd07c5ccfbf9 tempest-VolumesGetTestJSON-1992253955 None] Created volume successfully. Apr 22 17:54:35 devstack sudo[86909]: pam_unix(sudo:session): session closed for user root Apr 22 17:54:35 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-dc69b6b8-3d61-49a3-bcf2-7afd65138b91 tempest-VolumesServicesTestJSON-64619952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33" returned: 0 in 0.616s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:54:35 devstack cinder-volume[81771]: DEBUG cinder.manager [None req-dc69b6b8-3d61-49a3-bcf2-7afd65138b91 tempest-VolumesServicesTestJSON-64619952 None] Notifying Schedulers of capabilities ... {{(pid=81771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 17:54:35 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-dc69b6b8-3d61-49a3-bcf2-7afd65138b91 tempest-VolumesServicesTestJSON-64619952 None] Deleted volume successfully. Apr 22 17:54:35 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-dc69b6b8-3d61-49a3-bcf2-7afd65138b91 tempest-VolumesServicesTestJSON-64619952 None] Lock "cinder-0b9689f6-4e72-480f-b4f9-a13beb8ca3d6-delete_volume" released by "delete_volume" :: held 2.477s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:54:35 devstack sudo[86911]: pam_unix(sudo:session): session closed for user root Apr 22 17:54:35 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-6420d81d-fe19-4f4a-8c60-8d20cc488c68 tempest-VolumesActionsTest-84916959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e3664582-4810-4ace-9346-f53375c65ed6 1073741824" returned: 0 in 0.806s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:54:35 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-6420d81d-fe19-4f4a-8c60-8d20cc488c68 tempest-VolumesActionsTest-84916959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e3664582-4810-4ace-9346-f53375c65ed6 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:54:35 devstack sudo[86917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e3664582-4810-4ace-9346-f53375c65ed6 Apr 22 17:54:35 devstack sudo[86917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:54:36 devstack cinder-volume[81771]: DEBUG cinder.coordination [req-78e62fa5-b05d-410b-b681-ec8ae1af2cc0 req-ecfb5654-6d9a-4de2-b84f-22b0fdd9ebd3 tempest-VolumesGetTestJSON-1992253955 None] Acquiring lock "cinder-3d3ba95d-53aa-447d-93c2-99ebb329c8cf-delete_volume" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:54:36 devstack cinder-volume[81771]: DEBUG cinder.coordination [req-78e62fa5-b05d-410b-b681-ec8ae1af2cc0 req-ecfb5654-6d9a-4de2-b84f-22b0fdd9ebd3 tempest-VolumesGetTestJSON-1992253955 None] Lock "cinder-3d3ba95d-53aa-447d-93c2-99ebb329c8cf-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:54:36 devstack cinder-volume[81771]: DEBUG cinder.coordination [req-78e62fa5-b05d-410b-b681-ec8ae1af2cc0 req-ecfb5654-6d9a-4de2-b84f-22b0fdd9ebd3 tempest-VolumesGetTestJSON-1992253955 None] Acquiring lock "cinder-quobyte-3d3ba95d-53aa-447d-93c2-99ebb329c8cf" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:54:36 devstack cinder-volume[81771]: DEBUG cinder.coordination [req-78e62fa5-b05d-410b-b681-ec8ae1af2cc0 req-ecfb5654-6d9a-4de2-b84f-22b0fdd9ebd3 tempest-VolumesGetTestJSON-1992253955 None] Lock "cinder-quobyte-3d3ba95d-53aa-447d-93c2-99ebb329c8cf" acquired by "delete_volume" :: waited 0.028s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:54:36 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9b32d1b-7b92-49c8-967a-4624c812d0d4]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:54:36 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [req-78e62fa5-b05d-410b-b681-ec8ae1af2cc0 req-ecfb5654-6d9a-4de2-b84f-22b0fdd9ebd3 tempest-VolumesGetTestJSON-1992253955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-3d3ba95d-53aa-447d-93c2-99ebb329c8cf {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:54:36 devstack sudo[86919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-3d3ba95d-53aa-447d-93c2-99ebb329c8cf Apr 22 17:54:36 devstack sudo[86919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:54:36 devstack sudo[86917]: pam_unix(sudo:session): session closed for user root Apr 22 17:54:36 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-6420d81d-fe19-4f4a-8c60-8d20cc488c68 tempest-VolumesActionsTest-84916959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e3664582-4810-4ace-9346-f53375c65ed6" returned: 0 in 0.576s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:54:36 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-6420d81d-fe19-4f4a-8c60-8d20cc488c68 tempest-VolumesActionsTest-84916959 None] <== create_volume: return (1426ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'} {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 17:54:36 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-6420d81d-fe19-4f4a-8c60-8d20cc488c68 tempest-VolumesActionsTest-84916959 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.429s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:54:36 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-6420d81d-fe19-4f4a-8c60-8d20cc488c68 tempest-VolumesActionsTest-84916959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3254598c-9c16-4827-acd9-ad477168aba8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3664582-4810-4ace-9346-f53375c65ed6', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:54:36 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-6420d81d-fe19-4f4a-8c60-8d20cc488c68 tempest-VolumesActionsTest-84916959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (351c5543-8e87-4f93-8afd-20440a8b1f38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:54:36 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-6420d81d-fe19-4f4a-8c60-8d20cc488c68 tempest-VolumesActionsTest-84916959 None] Volume volume-e3664582-4810-4ace-9346-f53375c65ed6 (e3664582-4810-4ace-9346-f53375c65ed6): created successfully Apr 22 17:54:36 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-6420d81d-fe19-4f4a-8c60-8d20cc488c68 tempest-VolumesActionsTest-84916959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (351c5543-8e87-4f93-8afd-20440a8b1f38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:54:36 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-6420d81d-fe19-4f4a-8c60-8d20cc488c68 tempest-VolumesActionsTest-84916959 None] Flow 'volume_create_manager' (b5588074-14a9-4651-8c07-2dd1bab871b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:54:36 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-6420d81d-fe19-4f4a-8c60-8d20cc488c68 tempest-VolumesActionsTest-84916959 None] Created volume successfully. Apr 22 17:54:36 devstack sudo[86919]: pam_unix(sudo:session): session closed for user root Apr 22 17:54:36 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [req-78e62fa5-b05d-410b-b681-ec8ae1af2cc0 req-ecfb5654-6d9a-4de2-b84f-22b0fdd9ebd3 tempest-VolumesGetTestJSON-1992253955 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-3d3ba95d-53aa-447d-93c2-99ebb329c8cf" returned: 0 in 0.692s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:54:36 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [req-78e62fa5-b05d-410b-b681-ec8ae1af2cc0 req-ecfb5654-6d9a-4de2-b84f-22b0fdd9ebd3 tempest-VolumesGetTestJSON-1992253955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-3d3ba95d-53aa-447d-93c2-99ebb329c8cf {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:54:37 devstack sudo[86926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-3d3ba95d-53aa-447d-93c2-99ebb329c8cf Apr 22 17:54:37 devstack sudo[86926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:54:37 devstack sudo[86926]: pam_unix(sudo:session): session closed for user root Apr 22 17:54:37 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [req-78e62fa5-b05d-410b-b681-ec8ae1af2cc0 req-ecfb5654-6d9a-4de2-b84f-22b0fdd9ebd3 tempest-VolumesGetTestJSON-1992253955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-3d3ba95d-53aa-447d-93c2-99ebb329c8cf" returned: 0 in 0.741s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:54:37 devstack cinder-volume[81771]: DEBUG cinder.coordination [req-78e62fa5-b05d-410b-b681-ec8ae1af2cc0 req-ecfb5654-6d9a-4de2-b84f-22b0fdd9ebd3 tempest-VolumesGetTestJSON-1992253955 None] Lock "cinder-quobyte-3d3ba95d-53aa-447d-93c2-99ebb329c8cf" released by "delete_volume" :: held 1.479s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:54:37 devstack cinder-volume[81771]: DEBUG cinder.quota [req-78e62fa5-b05d-410b-b681-ec8ae1af2cc0 req-ecfb5654-6d9a-4de2-b84f-22b0fdd9ebd3 tempest-VolumesGetTestJSON-1992253955 None] Created reservations ['bb858227-44b7-4fb4-8cba-6603bcb16710', '0bc08ff5-63ed-46cb-a5fb-44aa15311b5c', 'da61ac67-1c8b-4e25-b10d-41280610caa9', 'bd9f8c5e-9c9a-4af2-bf59-7993a7985afb'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 17:54:37 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [req-78e62fa5-b05d-410b-b681-ec8ae1af2cc0 req-ecfb5654-6d9a-4de2-b84f-22b0fdd9ebd3 tempest-VolumesGetTestJSON-1992253955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:54:37 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [req-78e62fa5-b05d-410b-b681-ec8ae1af2cc0 req-ecfb5654-6d9a-4de2-b84f-22b0fdd9ebd3 tempest-VolumesGetTestJSON-1992253955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:54:37 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [req-78e62fa5-b05d-410b-b681-ec8ae1af2cc0 req-ecfb5654-6d9a-4de2-b84f-22b0fdd9ebd3 tempest-VolumesGetTestJSON-1992253955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:54:37 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [req-78e62fa5-b05d-410b-b681-ec8ae1af2cc0 req-ecfb5654-6d9a-4de2-b84f-22b0fdd9ebd3 tempest-VolumesGetTestJSON-1992253955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:54:37 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [req-78e62fa5-b05d-410b-b681-ec8ae1af2cc0 req-ecfb5654-6d9a-4de2-b84f-22b0fdd9ebd3 tempest-VolumesGetTestJSON-1992253955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:54:37 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [req-78e62fa5-b05d-410b-b681-ec8ae1af2cc0 req-ecfb5654-6d9a-4de2-b84f-22b0fdd9ebd3 tempest-VolumesGetTestJSON-1992253955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:54:37 devstack sudo[86929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 Apr 22 17:54:37 devstack sudo[86929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:54:38 devstack sudo[86929]: pam_unix(sudo:session): session closed for user root Apr 22 17:54:38 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [req-78e62fa5-b05d-410b-b681-ec8ae1af2cc0 req-ecfb5654-6d9a-4de2-b84f-22b0fdd9ebd3 tempest-VolumesGetTestJSON-1992253955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33" returned: 0 in 0.830s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:54:38 devstack cinder-volume[81771]: DEBUG cinder.manager [req-78e62fa5-b05d-410b-b681-ec8ae1af2cc0 req-ecfb5654-6d9a-4de2-b84f-22b0fdd9ebd3 tempest-VolumesGetTestJSON-1992253955 None] Notifying Schedulers of capabilities ... {{(pid=81771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 17:54:38 devstack cinder-volume[81771]: INFO cinder.volume.manager [req-78e62fa5-b05d-410b-b681-ec8ae1af2cc0 req-ecfb5654-6d9a-4de2-b84f-22b0fdd9ebd3 tempest-VolumesGetTestJSON-1992253955 None] Deleted volume successfully. Apr 22 17:54:38 devstack cinder-volume[81771]: DEBUG cinder.coordination [req-78e62fa5-b05d-410b-b681-ec8ae1af2cc0 req-ecfb5654-6d9a-4de2-b84f-22b0fdd9ebd3 tempest-VolumesGetTestJSON-1992253955 None] Lock "cinder-3d3ba95d-53aa-447d-93c2-99ebb329c8cf-delete_volume" released by "delete_volume" :: held 2.655s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:54:40 devstack cinder-volume[81771]: DEBUG cinder.volume.flows.manager.create_volume [None req-479a1511-1422-4706-b073-3994c7ded239 tempest-VolumesImageMetadata-1623522424 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 17:54:40 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-479a1511-1422-4706-b073-3994c7ded239 tempest-VolumesImageMetadata-1623522424 None] Flow 'volume_create_manager' (96fa30a9-80f7-4bac-a0ab-d24b2320efdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:54:40 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-479a1511-1422-4706-b073-3994c7ded239 tempest-VolumesImageMetadata-1623522424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28946c43-981f-413c-a59d-c53ca1d14b38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:54:40 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-479a1511-1422-4706-b073-3994c7ded239 tempest-VolumesImageMetadata-1623522424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28946c43-981f-413c-a59d-c53ca1d14b38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:54:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1475362166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e0dbfb5-8ded-4fc0-ac6f-aec5893d1a52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='754674b71e76414bb24b6c7bf394a22b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:54:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:54:41Z,use_quota=True,user_id='05c1bd538f7a47ddb62683262f674d5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:54:40 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-479a1511-1422-4706-b073-3994c7ded239 tempest-VolumesImageMetadata-1623522424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e322074-eb77-4e8f-b68c-cc046fefdcf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:54:40 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-479a1511-1422-4706-b073-3994c7ded239 tempest-VolumesImageMetadata-1623522424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e322074-eb77-4e8f-b68c-cc046fefdcf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:54:40 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-479a1511-1422-4706-b073-3994c7ded239 tempest-VolumesImageMetadata-1623522424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d7ed15c-349a-433d-8c7e-fdeca9ce3261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:54:40 devstack cinder-volume[81771]: DEBUG cinder.image.glance [None req-479a1511-1422-4706-b073-3994c7ded239 tempest-VolumesImageMetadata-1623522424 None] Creating Keystone auth plugin from conf {{(pid=81771) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 22 17:54:41 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-479a1511-1422-4706-b073-3994c7ded239 tempest-VolumesImageMetadata-1623522424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d7ed15c-349a-433d-8c7e-fdeca9ce3261) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3e0dbfb5-8ded-4fc0-ac6f-aec5893d1a52', 'volume_name': 'volume-3e0dbfb5-8ded-4fc0-ac6f-aec5893d1a52', 'volume_size': 1, 'image_id': '9e076047-8ac8-4bf8-88ea-602aa20d3c9e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9e076047-8ac8-4bf8-88ea-602aa20d3c9e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '39e18fb0fde242f68d38bed6963e8744', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9e076047-8ac8-4bf8-88ea-602aa20d3c9e', 'created_at': datetime.datetime(2026, 4, 22, 15, 44, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 22, 15, 44, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9e076047-8ac8-4bf8-88ea-602aa20d3c9e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:54:41 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-479a1511-1422-4706-b073-3994c7ded239 tempest-VolumesImageMetadata-1623522424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e3d91a3-92ee-405b-adb3-91221ddd0126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:54:41 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-479a1511-1422-4706-b073-3994c7ded239 tempest-VolumesImageMetadata-1623522424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e3d91a3-92ee-405b-adb3-91221ddd0126) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:54:41 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-479a1511-1422-4706-b073-3994c7ded239 tempest-VolumesImageMetadata-1623522424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d4cf519-e7e0-4891-bdd0-a1bc110e8a91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:54:41 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-479a1511-1422-4706-b073-3994c7ded239 tempest-VolumesImageMetadata-1623522424 None] Volume 3e0dbfb5-8ded-4fc0-ac6f-aec5893d1a52: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3e0dbfb5-8ded-4fc0-ac6f-aec5893d1a52', 'volume_size': 1, 'image_id': '9e076047-8ac8-4bf8-88ea-602aa20d3c9e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9e076047-8ac8-4bf8-88ea-602aa20d3c9e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '39e18fb0fde242f68d38bed6963e8744', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9e076047-8ac8-4bf8-88ea-602aa20d3c9e', 'created_at': datetime.datetime(2026, 4, 22, 15, 44, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 22, 15, 44, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9e076047-8ac8-4bf8-88ea-602aa20d3c9e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 22 17:54:41 devstack cinder-volume[81771]: DEBUG cinder.volume.flows.manager.create_volume [None req-479a1511-1422-4706-b073-3994c7ded239 tempest-VolumesImageMetadata-1623522424 None] Trying to clone 3e0dbfb5-8ded-4fc0-ac6f-aec5893d1a52 from image 9e076047-8ac8-4bf8-88ea-602aa20d3c9e at location (None, [{'url': 'file:///opt/stack/data/glance/images/9e076047-8ac8-4bf8-88ea-602aa20d3c9e', 'metadata': {}}]). {{(pid=81771) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 22 17:54:41 devstack cinder-volume[81771]: DEBUG cinder.image.image_utils [None req-479a1511-1422-4706-b073-3994c7ded239 tempest-VolumesImageMetadata-1623522424 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9e076047-8ac8-4bf8-88ea-602aa20d3c9e_slemzzj2devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=81771) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 22 17:54:41 devstack cinder-volume[81771]: INFO cinder.image.image_utils [None req-479a1511-1422-4706-b073-3994c7ded239 tempest-VolumesImageMetadata-1623522424 None] Image download 20.69 MB at 20.69 MB/s Apr 22 17:54:41 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[e972c958-707e-43f2-9a85-c4d9fb0afb4e]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:54:41 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-479a1511-1422-4706-b073-3994c7ded239 tempest-VolumesImageMetadata-1623522424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9e076047-8ac8-4bf8-88ea-602aa20d3c9e_slemzzj2devstack@QuobyteHD {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:54:41 devstack sudo[86937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9e076047-8ac8-4bf8-88ea-602aa20d3c9e_slemzzj2devstack@QuobyteHD Apr 22 17:54:41 devstack sudo[86937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:54:42 devstack sudo[86937]: pam_unix(sudo:session): session closed for user root Apr 22 17:54:42 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-479a1511-1422-4706-b073-3994c7ded239 tempest-VolumesImageMetadata-1623522424 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9e076047-8ac8-4bf8-88ea-602aa20d3c9e_slemzzj2devstack@QuobyteHD" returned: 0 in 0.614s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:54:42 devstack cinder-volume[81771]: DEBUG cinder.image.image_utils [None req-479a1511-1422-4706-b073-3994c7ded239 tempest-VolumesImageMetadata-1623522424 None] Temporary image 9e076047-8ac8-4bf8-88ea-602aa20d3c9e is fetched for user 05c1bd538f7a47ddb62683262f674d5d. {{(pid=81771) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 22 17:54:42 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c316b94-052f-4dbf-9552-25e5c69d29a1]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:54:42 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-479a1511-1422-4706-b073-3994c7ded239 tempest-VolumesImageMetadata-1623522424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9e076047-8ac8-4bf8-88ea-602aa20d3c9e_slemzzj2devstack@QuobyteHD {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:54:42 devstack sudo[86942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9e076047-8ac8-4bf8-88ea-602aa20d3c9e_slemzzj2devstack@QuobyteHD Apr 22 17:54:42 devstack sudo[86942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:54:42 devstack cinder-volume[81771]: DEBUG cinder.volume.flows.manager.create_volume [None req-2cc0b8bc-956f-4723-979b-048164f8ba04 tempest-VolumesListAdminTestJSON-2106952741 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 17:54:42 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-2cc0b8bc-956f-4723-979b-048164f8ba04 tempest-VolumesListAdminTestJSON-2106952741 None] Flow 'volume_create_manager' (0fa34952-99fe-4e4e-b990-277528644d70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:54:42 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-2cc0b8bc-956f-4723-979b-048164f8ba04 tempest-VolumesListAdminTestJSON-2106952741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97728a37-fde9-460a-8687-1eb9fea26c79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:54:42 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-2cc0b8bc-956f-4723-979b-048164f8ba04 tempest-VolumesListAdminTestJSON-2106952741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97728a37-fde9-460a-8687-1eb9fea26c79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:54:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1868876468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4861db81-3409-4363-9456-04b5c8e95ca6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='236a3274b01a487898875f5f6e0366e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:54:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:54:43Z,use_quota=True,user_id='5472d2c5583b460ba75629209128878d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:54:42 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-2cc0b8bc-956f-4723-979b-048164f8ba04 tempest-VolumesListAdminTestJSON-2106952741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f315ef50-403d-49b2-93f2-718c2e304044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:54:42 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-2cc0b8bc-956f-4723-979b-048164f8ba04 tempest-VolumesListAdminTestJSON-2106952741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f315ef50-403d-49b2-93f2-718c2e304044) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:54:42 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-2cc0b8bc-956f-4723-979b-048164f8ba04 tempest-VolumesListAdminTestJSON-2106952741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71f54275-350f-4230-8bee-78c3bcd2ea9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:54:42 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-2cc0b8bc-956f-4723-979b-048164f8ba04 tempest-VolumesListAdminTestJSON-2106952741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71f54275-350f-4230-8bee-78c3bcd2ea9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4861db81-3409-4363-9456-04b5c8e95ca6', 'volume_name': 'volume-4861db81-3409-4363-9456-04b5c8e95ca6', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:54:42 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-2cc0b8bc-956f-4723-979b-048164f8ba04 tempest-VolumesListAdminTestJSON-2106952741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1019ccce-411c-4e2c-88a3-7a5790123b1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:54:42 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-2cc0b8bc-956f-4723-979b-048164f8ba04 tempest-VolumesListAdminTestJSON-2106952741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1019ccce-411c-4e2c-88a3-7a5790123b1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:54:42 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-2cc0b8bc-956f-4723-979b-048164f8ba04 tempest-VolumesListAdminTestJSON-2106952741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05001579-4af8-4367-a5fd-0c3ff0d28d8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:54:42 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-2cc0b8bc-956f-4723-979b-048164f8ba04 tempest-VolumesListAdminTestJSON-2106952741 None] Volume 4861db81-3409-4363-9456-04b5c8e95ca6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4861db81-3409-4363-9456-04b5c8e95ca6', 'volume_size': 1} Apr 22 17:54:42 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-2cc0b8bc-956f-4723-979b-048164f8ba04 tempest-VolumesListAdminTestJSON-2106952741 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:54:42 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-2cc0b8bc-956f-4723-979b-048164f8ba04 tempest-VolumesListAdminTestJSON-2106952741 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:54:42 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-2cc0b8bc-956f-4723-979b-048164f8ba04 tempest-VolumesListAdminTestJSON-2106952741 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:54:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1868876468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4861db81-3409-4363-9456-04b5c8e95ca6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='236a3274b01a487898875f5f6e0366e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:54:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:54:43Z,use_quota=True,user_id='5472d2c5583b460ba75629209128878d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)}" {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 17:54:42 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-2cc0b8bc-956f-4723-979b-048164f8ba04 tempest-VolumesListAdminTestJSON-2106952741 None] Creating volume 4861db81-3409-4363-9456-04b5c8e95ca6 {{(pid=81771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 17:54:42 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-2cc0b8bc-956f-4723-979b-048164f8ba04 tempest-VolumesListAdminTestJSON-2106952741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:54:42 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-2cc0b8bc-956f-4723-979b-048164f8ba04 tempest-VolumesListAdminTestJSON-2106952741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:54:42 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-2cc0b8bc-956f-4723-979b-048164f8ba04 tempest-VolumesListAdminTestJSON-2106952741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:54:42 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-2cc0b8bc-956f-4723-979b-048164f8ba04 tempest-VolumesListAdminTestJSON-2106952741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:54:42 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-2cc0b8bc-956f-4723-979b-048164f8ba04 tempest-VolumesListAdminTestJSON-2106952741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:54:42 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-2cc0b8bc-956f-4723-979b-048164f8ba04 tempest-VolumesListAdminTestJSON-2106952741 None] Selected osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 as target Quobyte volume. {{(pid=81771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 17:54:42 devstack cinder-volume[81771]: INFO cinder.volume.drivers.remotefs [None req-2cc0b8bc-956f-4723-979b-048164f8ba04 tempest-VolumesListAdminTestJSON-2106952741 None] casted to osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 Apr 22 17:54:42 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-2cc0b8bc-956f-4723-979b-048164f8ba04 tempest-VolumesListAdminTestJSON-2106952741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-4861db81-3409-4363-9456-04b5c8e95ca6 1073741824 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:54:42 devstack sudo[86944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-4861db81-3409-4363-9456-04b5c8e95ca6 1073741824 Apr 22 17:54:42 devstack sudo[86944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:54:43 devstack sudo[86942]: pam_unix(sudo:session): session closed for user root Apr 22 17:54:43 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-479a1511-1422-4706-b073-3994c7ded239 tempest-VolumesImageMetadata-1623522424 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9e076047-8ac8-4bf8-88ea-602aa20d3c9e_slemzzj2devstack@QuobyteHD" returned: 0 in 0.728s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:54:43 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-479a1511-1422-4706-b073-3994c7ded239 tempest-VolumesImageMetadata-1623522424 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:54:43 devstack sudo[86944]: pam_unix(sudo:session): session closed for user root Apr 22 17:54:43 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-2cc0b8bc-956f-4723-979b-048164f8ba04 tempest-VolumesListAdminTestJSON-2106952741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-4861db81-3409-4363-9456-04b5c8e95ca6 1073741824" returned: 0 in 0.863s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:54:43 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-2cc0b8bc-956f-4723-979b-048164f8ba04 tempest-VolumesListAdminTestJSON-2106952741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-4861db81-3409-4363-9456-04b5c8e95ca6 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:54:43 devstack sudo[86956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-4861db81-3409-4363-9456-04b5c8e95ca6 Apr 22 17:54:43 devstack sudo[86956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:54:44 devstack sudo[86956]: pam_unix(sudo:session): session closed for user root Apr 22 17:54:44 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-2cc0b8bc-956f-4723-979b-048164f8ba04 tempest-VolumesListAdminTestJSON-2106952741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-4861db81-3409-4363-9456-04b5c8e95ca6" returned: 0 in 0.690s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:54:44 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-2cc0b8bc-956f-4723-979b-048164f8ba04 tempest-VolumesListAdminTestJSON-2106952741 None] <== create_volume: return (1606ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'} {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 17:54:44 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-2cc0b8bc-956f-4723-979b-048164f8ba04 tempest-VolumesListAdminTestJSON-2106952741 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.609s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:54:44 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-479a1511-1422-4706-b073-3994c7ded239 tempest-VolumesImageMetadata-1623522424 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.386s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:54:44 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-479a1511-1422-4706-b073-3994c7ded239 tempest-VolumesImageMetadata-1623522424 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:54:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1475362166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e0dbfb5-8ded-4fc0-ac6f-aec5893d1a52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='754674b71e76414bb24b6c7bf394a22b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:54:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:54:41Z,use_quota=True,user_id='05c1bd538f7a47ddb62683262f674d5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)}" {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 17:54:44 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-479a1511-1422-4706-b073-3994c7ded239 tempest-VolumesImageMetadata-1623522424 None] Creating volume 3e0dbfb5-8ded-4fc0-ac6f-aec5893d1a52 {{(pid=81771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 17:54:44 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-479a1511-1422-4706-b073-3994c7ded239 tempest-VolumesImageMetadata-1623522424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:54:44 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-479a1511-1422-4706-b073-3994c7ded239 tempest-VolumesImageMetadata-1623522424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:54:44 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-479a1511-1422-4706-b073-3994c7ded239 tempest-VolumesImageMetadata-1623522424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:54:44 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-479a1511-1422-4706-b073-3994c7ded239 tempest-VolumesImageMetadata-1623522424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:54:44 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-479a1511-1422-4706-b073-3994c7ded239 tempest-VolumesImageMetadata-1623522424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:54:44 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-479a1511-1422-4706-b073-3994c7ded239 tempest-VolumesImageMetadata-1623522424 None] Selected osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 as target Quobyte volume. {{(pid=81771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 17:54:44 devstack cinder-volume[81771]: INFO cinder.volume.drivers.remotefs [None req-479a1511-1422-4706-b073-3994c7ded239 tempest-VolumesImageMetadata-1623522424 None] casted to osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 Apr 22 17:54:44 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-479a1511-1422-4706-b073-3994c7ded239 tempest-VolumesImageMetadata-1623522424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-3e0dbfb5-8ded-4fc0-ac6f-aec5893d1a52 1073741824 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:54:44 devstack sudo[86959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-3e0dbfb5-8ded-4fc0-ac6f-aec5893d1a52 1073741824 Apr 22 17:54:44 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-2cc0b8bc-956f-4723-979b-048164f8ba04 tempest-VolumesListAdminTestJSON-2106952741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05001579-4af8-4367-a5fd-0c3ff0d28d8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4861db81-3409-4363-9456-04b5c8e95ca6', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:54:44 devstack sudo[86959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:54:44 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-2cc0b8bc-956f-4723-979b-048164f8ba04 tempest-VolumesListAdminTestJSON-2106952741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91b1a5fd-6f97-4813-a5d2-047cadf7a82d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:54:44 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-2cc0b8bc-956f-4723-979b-048164f8ba04 tempest-VolumesListAdminTestJSON-2106952741 None] Volume volume-4861db81-3409-4363-9456-04b5c8e95ca6 (4861db81-3409-4363-9456-04b5c8e95ca6): created successfully Apr 22 17:54:44 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-2cc0b8bc-956f-4723-979b-048164f8ba04 tempest-VolumesListAdminTestJSON-2106952741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91b1a5fd-6f97-4813-a5d2-047cadf7a82d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:54:44 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-2cc0b8bc-956f-4723-979b-048164f8ba04 tempest-VolumesListAdminTestJSON-2106952741 None] Flow 'volume_create_manager' (0fa34952-99fe-4e4e-b990-277528644d70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:54:44 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-2cc0b8bc-956f-4723-979b-048164f8ba04 tempest-VolumesListAdminTestJSON-2106952741 None] Created volume successfully. Apr 22 17:54:45 devstack cinder-volume[81771]: DEBUG cinder.volume.flows.manager.create_volume [None req-7dc7b5c6-de32-44fa-8ec9-52fede222a6d tempest-VolumesListAdminTestJSON-2106952741 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 17:54:45 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-7dc7b5c6-de32-44fa-8ec9-52fede222a6d tempest-VolumesListAdminTestJSON-2106952741 None] Flow 'volume_create_manager' (a344e3b7-33e9-40c3-8cf7-de3651fba66f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:54:45 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-7dc7b5c6-de32-44fa-8ec9-52fede222a6d tempest-VolumesListAdminTestJSON-2106952741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ada47aa-2cdb-4fdc-b451-586a60ad1c2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:54:45 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-7dc7b5c6-de32-44fa-8ec9-52fede222a6d tempest-VolumesListAdminTestJSON-2106952741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ada47aa-2cdb-4fdc-b451-586a60ad1c2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:54:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-876667207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d74caa9-aac0-4f82-8cc1-515787864eee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='236a3274b01a487898875f5f6e0366e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:54:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:54:46Z,use_quota=True,user_id='5472d2c5583b460ba75629209128878d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:54:45 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-7dc7b5c6-de32-44fa-8ec9-52fede222a6d tempest-VolumesListAdminTestJSON-2106952741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5e40eee-ac84-4ae0-b764-04bfcfbac75d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:54:45 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-7dc7b5c6-de32-44fa-8ec9-52fede222a6d tempest-VolumesListAdminTestJSON-2106952741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5e40eee-ac84-4ae0-b764-04bfcfbac75d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:54:45 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-7dc7b5c6-de32-44fa-8ec9-52fede222a6d tempest-VolumesListAdminTestJSON-2106952741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2aa7d16e-d61f-40bd-8569-259cca62590a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:54:45 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-7dc7b5c6-de32-44fa-8ec9-52fede222a6d tempest-VolumesListAdminTestJSON-2106952741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2aa7d16e-d61f-40bd-8569-259cca62590a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d74caa9-aac0-4f82-8cc1-515787864eee', 'volume_name': 'volume-0d74caa9-aac0-4f82-8cc1-515787864eee', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:54:45 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-7dc7b5c6-de32-44fa-8ec9-52fede222a6d tempest-VolumesListAdminTestJSON-2106952741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d90d9dcb-3da5-4908-b5d2-b998d921b1f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:54:45 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-7dc7b5c6-de32-44fa-8ec9-52fede222a6d tempest-VolumesListAdminTestJSON-2106952741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d90d9dcb-3da5-4908-b5d2-b998d921b1f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:54:45 devstack sudo[86959]: pam_unix(sudo:session): session closed for user root Apr 22 17:54:45 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-7dc7b5c6-de32-44fa-8ec9-52fede222a6d tempest-VolumesListAdminTestJSON-2106952741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd7b8ad7-ec1a-4835-8b9f-7524beee4ade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:54:45 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-7dc7b5c6-de32-44fa-8ec9-52fede222a6d tempest-VolumesListAdminTestJSON-2106952741 None] Volume 0d74caa9-aac0-4f82-8cc1-515787864eee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d74caa9-aac0-4f82-8cc1-515787864eee', 'volume_size': 1} Apr 22 17:54:45 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-7dc7b5c6-de32-44fa-8ec9-52fede222a6d tempest-VolumesListAdminTestJSON-2106952741 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:54:45 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-479a1511-1422-4706-b073-3994c7ded239 tempest-VolumesImageMetadata-1623522424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-3e0dbfb5-8ded-4fc0-ac6f-aec5893d1a52 1073741824" returned: 0 in 1.221s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:54:45 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-479a1511-1422-4706-b073-3994c7ded239 tempest-VolumesImageMetadata-1623522424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-3e0dbfb5-8ded-4fc0-ac6f-aec5893d1a52 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:54:45 devstack sudo[86968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-3e0dbfb5-8ded-4fc0-ac6f-aec5893d1a52 Apr 22 17:54:45 devstack sudo[86968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:54:46 devstack sudo[86968]: pam_unix(sudo:session): session closed for user root Apr 22 17:54:46 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-479a1511-1422-4706-b073-3994c7ded239 tempest-VolumesImageMetadata-1623522424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-3e0dbfb5-8ded-4fc0-ac6f-aec5893d1a52" returned: 0 in 0.574s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:54:46 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-479a1511-1422-4706-b073-3994c7ded239 tempest-VolumesImageMetadata-1623522424 None] <== create_volume: return (1847ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'} {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 17:54:46 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-479a1511-1422-4706-b073-3994c7ded239 tempest-VolumesImageMetadata-1623522424 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.850s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:54:46 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-7dc7b5c6-de32-44fa-8ec9-52fede222a6d tempest-VolumesListAdminTestJSON-2106952741 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.631s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:54:46 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-7dc7b5c6-de32-44fa-8ec9-52fede222a6d tempest-VolumesListAdminTestJSON-2106952741 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:54:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-876667207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d74caa9-aac0-4f82-8cc1-515787864eee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='236a3274b01a487898875f5f6e0366e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:54:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:54:46Z,use_quota=True,user_id='5472d2c5583b460ba75629209128878d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)}" {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 17:54:46 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-7dc7b5c6-de32-44fa-8ec9-52fede222a6d tempest-VolumesListAdminTestJSON-2106952741 None] Creating volume 0d74caa9-aac0-4f82-8cc1-515787864eee {{(pid=81771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 17:54:46 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-7dc7b5c6-de32-44fa-8ec9-52fede222a6d tempest-VolumesListAdminTestJSON-2106952741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:54:46 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-7dc7b5c6-de32-44fa-8ec9-52fede222a6d tempest-VolumesListAdminTestJSON-2106952741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:54:46 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-7dc7b5c6-de32-44fa-8ec9-52fede222a6d tempest-VolumesListAdminTestJSON-2106952741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:54:46 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-7dc7b5c6-de32-44fa-8ec9-52fede222a6d tempest-VolumesListAdminTestJSON-2106952741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:54:46 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-7dc7b5c6-de32-44fa-8ec9-52fede222a6d tempest-VolumesListAdminTestJSON-2106952741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:54:46 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-7dc7b5c6-de32-44fa-8ec9-52fede222a6d tempest-VolumesListAdminTestJSON-2106952741 None] Selected osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 as target Quobyte volume. {{(pid=81771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 17:54:46 devstack cinder-volume[81771]: INFO cinder.volume.drivers.remotefs [None req-7dc7b5c6-de32-44fa-8ec9-52fede222a6d tempest-VolumesListAdminTestJSON-2106952741 None] casted to osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 Apr 22 17:54:46 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-7dc7b5c6-de32-44fa-8ec9-52fede222a6d tempest-VolumesListAdminTestJSON-2106952741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-0d74caa9-aac0-4f82-8cc1-515787864eee 1073741824 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:54:46 devstack cinder-volume[81771]: DEBUG cinder.volume.volume_utils [None req-479a1511-1422-4706-b073-3994c7ded239 tempest-VolumesImageMetadata-1623522424 None] Attempting download of 9e076047-8ac8-4bf8-88ea-602aa20d3c9e ((None, [{'url': 'file:///opt/stack/data/glance/images/9e076047-8ac8-4bf8-88ea-602aa20d3c9e', 'metadata': {}}])) to volume 3e0dbfb5-8ded-4fc0-ac6f-aec5893d1a52. {{(pid=81771) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 22 17:54:46 devstack sudo[86982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-0d74caa9-aac0-4f82-8cc1-515787864eee 1073741824 Apr 22 17:54:46 devstack sudo[86982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:54:46 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[acb3a823-3aa9-42df-b519-fbffd92fd39b]: (4, 'raw') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:54:46 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-479a1511-1422-4706-b073-3994c7ded239 tempest-VolumesImageMetadata-1623522424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9e076047-8ac8-4bf8-88ea-602aa20d3c9e_iqt0ge9c {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:54:46 devstack sudo[86984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9e076047-8ac8-4bf8-88ea-602aa20d3c9e_iqt0ge9c Apr 22 17:54:46 devstack sudo[86984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:54:47 devstack sudo[86984]: pam_unix(sudo:session): session closed for user root Apr 22 17:54:47 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-479a1511-1422-4706-b073-3994c7ded239 tempest-VolumesImageMetadata-1623522424 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9e076047-8ac8-4bf8-88ea-602aa20d3c9e_iqt0ge9c" returned: 0 in 0.746s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:54:47 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-479a1511-1422-4706-b073-3994c7ded239 tempest-VolumesImageMetadata-1623522424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9e076047-8ac8-4bf8-88ea-602aa20d3c9e_iqt0ge9c {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:54:47 devstack sudo[86982]: pam_unix(sudo:session): session closed for user root Apr 22 17:54:47 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-7dc7b5c6-de32-44fa-8ec9-52fede222a6d tempest-VolumesListAdminTestJSON-2106952741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-0d74caa9-aac0-4f82-8cc1-515787864eee 1073741824" returned: 0 in 0.869s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:54:47 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-7dc7b5c6-de32-44fa-8ec9-52fede222a6d tempest-VolumesListAdminTestJSON-2106952741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-0d74caa9-aac0-4f82-8cc1-515787864eee {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:54:47 devstack sudo[86993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9e076047-8ac8-4bf8-88ea-602aa20d3c9e_iqt0ge9c Apr 22 17:54:47 devstack sudo[86993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:54:47 devstack sudo[86994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-0d74caa9-aac0-4f82-8cc1-515787864eee Apr 22 17:54:47 devstack sudo[86994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:54:47 devstack sudo[86994]: pam_unix(sudo:session): session closed for user root Apr 22 17:54:47 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-7dc7b5c6-de32-44fa-8ec9-52fede222a6d tempest-VolumesListAdminTestJSON-2106952741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-0d74caa9-aac0-4f82-8cc1-515787864eee" returned: 0 in 0.560s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:54:47 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-7dc7b5c6-de32-44fa-8ec9-52fede222a6d tempest-VolumesListAdminTestJSON-2106952741 None] <== create_volume: return (1472ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'} {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 17:54:47 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-7dc7b5c6-de32-44fa-8ec9-52fede222a6d tempest-VolumesListAdminTestJSON-2106952741 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.477s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:54:47 devstack sudo[86993]: pam_unix(sudo:session): session closed for user root Apr 22 17:54:47 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-479a1511-1422-4706-b073-3994c7ded239 tempest-VolumesImageMetadata-1623522424 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9e076047-8ac8-4bf8-88ea-602aa20d3c9e_iqt0ge9c" returned: 1 in 0.634s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:54:47 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-479a1511-1422-4706-b073-3994c7ded239 tempest-VolumesImageMetadata-1623522424 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9e076047-8ac8-4bf8-88ea-602aa20d3c9e_iqt0ge9c' failed. Not Retrying. {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 22 17:54:47 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3ed6bd8-2c4e-4dbb-a1c1-416518582bda]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:54:47 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-479a1511-1422-4706-b073-3994c7ded239 tempest-VolumesImageMetadata-1623522424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9e076047-8ac8-4bf8-88ea-602aa20d3c9e_slemzzj2devstack@QuobyteHD {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:54:47 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-7dc7b5c6-de32-44fa-8ec9-52fede222a6d tempest-VolumesListAdminTestJSON-2106952741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd7b8ad7-ec1a-4835-8b9f-7524beee4ade) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d74caa9-aac0-4f82-8cc1-515787864eee', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:54:47 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-7dc7b5c6-de32-44fa-8ec9-52fede222a6d tempest-VolumesListAdminTestJSON-2106952741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd4749f8-c30e-4b96-91b3-443b0a6303ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:54:47 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-7dc7b5c6-de32-44fa-8ec9-52fede222a6d tempest-VolumesListAdminTestJSON-2106952741 None] Volume volume-0d74caa9-aac0-4f82-8cc1-515787864eee (0d74caa9-aac0-4f82-8cc1-515787864eee): created successfully Apr 22 17:54:47 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-7dc7b5c6-de32-44fa-8ec9-52fede222a6d tempest-VolumesListAdminTestJSON-2106952741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd4749f8-c30e-4b96-91b3-443b0a6303ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:54:47 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-7dc7b5c6-de32-44fa-8ec9-52fede222a6d tempest-VolumesListAdminTestJSON-2106952741 None] Flow 'volume_create_manager' (a344e3b7-33e9-40c3-8cf7-de3651fba66f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:54:47 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-7dc7b5c6-de32-44fa-8ec9-52fede222a6d tempest-VolumesListAdminTestJSON-2106952741 None] Created volume successfully. Apr 22 17:54:48 devstack sudo[87000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9e076047-8ac8-4bf8-88ea-602aa20d3c9e_slemzzj2devstack@QuobyteHD Apr 22 17:54:48 devstack sudo[87000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:54:48 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-4b9bb333-22eb-4a29-b946-738223a335cb tempest-GroupSnapshotsV319Test-1358098521 None] Group tempest-GroupSnapshotsV319Test-Group-1847110659: creating Apr 22 17:54:48 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-4b9bb333-22eb-4a29-b946-738223a335cb tempest-GroupSnapshotsV319Test-1358098521 None] Group tempest-GroupSnapshotsV319Test-Group-1847110659: created successfully Apr 22 17:54:48 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-4b9bb333-22eb-4a29-b946-738223a335cb tempest-GroupSnapshotsV319Test-1358098521 None] Create group completed successfully. Apr 22 17:54:48 devstack sudo[87000]: pam_unix(sudo:session): session closed for user root Apr 22 17:54:48 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-479a1511-1422-4706-b073-3994c7ded239 tempest-VolumesImageMetadata-1623522424 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9e076047-8ac8-4bf8-88ea-602aa20d3c9e_slemzzj2devstack@QuobyteHD" returned: 0 in 0.617s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:54:48 devstack cinder-volume[81771]: DEBUG cinder.image.image_utils [None req-479a1511-1422-4706-b073-3994c7ded239 tempest-VolumesImageMetadata-1623522424 None] 9e076047-8ac8-4bf8-88ea-602aa20d3c9e was qcow2, converting to raw {{(pid=81771) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 22 17:54:48 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-479a1511-1422-4706-b073-3994c7ded239 tempest-VolumesImageMetadata-1623522424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9e076047-8ac8-4bf8-88ea-602aa20d3c9e_slemzzj2devstack@QuobyteHD /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-3e0dbfb5-8ded-4fc0-ac6f-aec5893d1a52 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:54:48 devstack sudo[87005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9e076047-8ac8-4bf8-88ea-602aa20d3c9e_slemzzj2devstack@QuobyteHD /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-3e0dbfb5-8ded-4fc0-ac6f-aec5893d1a52 Apr 22 17:54:48 devstack sudo[87005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:54:49 devstack cinder-volume[81771]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d6c88e6-af22-42e7-85cc-ea9e4df006b5 tempest-VolumesListAdminTestJSON-2106952741 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 17:54:49 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-6d6c88e6-af22-42e7-85cc-ea9e4df006b5 tempest-VolumesListAdminTestJSON-2106952741 None] Flow 'volume_create_manager' (07e2c12c-d0fd-4288-8ee3-2a2c20f6e28d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:54:49 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-6d6c88e6-af22-42e7-85cc-ea9e4df006b5 tempest-VolumesListAdminTestJSON-2106952741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aeac4ba8-67a6-4d7c-9495-0d7d8655597a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:54:49 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-6d6c88e6-af22-42e7-85cc-ea9e4df006b5 tempest-VolumesListAdminTestJSON-2106952741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aeac4ba8-67a6-4d7c-9495-0d7d8655597a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:54:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-161867087',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9a9b3b8-8b14-4a9f-914f-a9bd62815f8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='236a3274b01a487898875f5f6e0366e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:54:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:54:49Z,use_quota=True,user_id='5472d2c5583b460ba75629209128878d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:54:49 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-6d6c88e6-af22-42e7-85cc-ea9e4df006b5 tempest-VolumesListAdminTestJSON-2106952741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57cbf824-8309-47c2-ae4f-daf865b37b05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:54:49 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-6d6c88e6-af22-42e7-85cc-ea9e4df006b5 tempest-VolumesListAdminTestJSON-2106952741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57cbf824-8309-47c2-ae4f-daf865b37b05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:54:49 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-6d6c88e6-af22-42e7-85cc-ea9e4df006b5 tempest-VolumesListAdminTestJSON-2106952741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e69edf62-f255-481e-a4f6-728f66f0ae7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:54:49 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-6d6c88e6-af22-42e7-85cc-ea9e4df006b5 tempest-VolumesListAdminTestJSON-2106952741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e69edf62-f255-481e-a4f6-728f66f0ae7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9a9b3b8-8b14-4a9f-914f-a9bd62815f8e', 'volume_name': 'volume-e9a9b3b8-8b14-4a9f-914f-a9bd62815f8e', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:54:49 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-6d6c88e6-af22-42e7-85cc-ea9e4df006b5 tempest-VolumesListAdminTestJSON-2106952741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e29cc18e-9c4c-4b7b-b70b-d283e8767e1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:54:49 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-6d6c88e6-af22-42e7-85cc-ea9e4df006b5 tempest-VolumesListAdminTestJSON-2106952741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e29cc18e-9c4c-4b7b-b70b-d283e8767e1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:54:49 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-6d6c88e6-af22-42e7-85cc-ea9e4df006b5 tempest-VolumesListAdminTestJSON-2106952741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ed22b75-786e-4019-b140-8a9ea525b881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:54:49 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-6d6c88e6-af22-42e7-85cc-ea9e4df006b5 tempest-VolumesListAdminTestJSON-2106952741 None] Volume e9a9b3b8-8b14-4a9f-914f-a9bd62815f8e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9a9b3b8-8b14-4a9f-914f-a9bd62815f8e', 'volume_size': 1} Apr 22 17:54:49 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-6d6c88e6-af22-42e7-85cc-ea9e4df006b5 tempest-VolumesListAdminTestJSON-2106952741 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:54:49 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-6d6c88e6-af22-42e7-85cc-ea9e4df006b5 tempest-VolumesListAdminTestJSON-2106952741 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:54:49 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-6d6c88e6-af22-42e7-85cc-ea9e4df006b5 tempest-VolumesListAdminTestJSON-2106952741 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:54:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-161867087',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9a9b3b8-8b14-4a9f-914f-a9bd62815f8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='236a3274b01a487898875f5f6e0366e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:54:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:54:49Z,use_quota=True,user_id='5472d2c5583b460ba75629209128878d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)}" {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 17:54:49 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-6d6c88e6-af22-42e7-85cc-ea9e4df006b5 tempest-VolumesListAdminTestJSON-2106952741 None] Creating volume e9a9b3b8-8b14-4a9f-914f-a9bd62815f8e {{(pid=81771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 17:54:49 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-6d6c88e6-af22-42e7-85cc-ea9e4df006b5 tempest-VolumesListAdminTestJSON-2106952741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:54:49 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-6d6c88e6-af22-42e7-85cc-ea9e4df006b5 tempest-VolumesListAdminTestJSON-2106952741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:54:49 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-6d6c88e6-af22-42e7-85cc-ea9e4df006b5 tempest-VolumesListAdminTestJSON-2106952741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:54:49 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-6d6c88e6-af22-42e7-85cc-ea9e4df006b5 tempest-VolumesListAdminTestJSON-2106952741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:54:49 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-6d6c88e6-af22-42e7-85cc-ea9e4df006b5 tempest-VolumesListAdminTestJSON-2106952741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:54:49 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-6d6c88e6-af22-42e7-85cc-ea9e4df006b5 tempest-VolumesListAdminTestJSON-2106952741 None] Selected osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 as target Quobyte volume. {{(pid=81771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 17:54:49 devstack cinder-volume[81771]: INFO cinder.volume.drivers.remotefs [None req-6d6c88e6-af22-42e7-85cc-ea9e4df006b5 tempest-VolumesListAdminTestJSON-2106952741 None] casted to osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 Apr 22 17:54:49 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-6d6c88e6-af22-42e7-85cc-ea9e4df006b5 tempest-VolumesListAdminTestJSON-2106952741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e9a9b3b8-8b14-4a9f-914f-a9bd62815f8e 1073741824 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:54:49 devstack sudo[87014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e9a9b3b8-8b14-4a9f-914f-a9bd62815f8e 1073741824 Apr 22 17:54:49 devstack sudo[87014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:54:50 devstack cinder-volume[81771]: DEBUG cinder.volume.flows.manager.create_volume [None req-71817165-c4a0-473d-9df2-c3e649e11c0a tempest-GroupSnapshotsV319Test-1358098521 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 17:54:50 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-71817165-c4a0-473d-9df2-c3e649e11c0a tempest-GroupSnapshotsV319Test-1358098521 None] Flow 'volume_create_manager' (8b28b8ff-5d6a-4b71-bacb-b01bea786bc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:54:50 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-71817165-c4a0-473d-9df2-c3e649e11c0a tempest-GroupSnapshotsV319Test-1358098521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f4da841-01ec-4eaf-84c6-4b30e24bcce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:54:50 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-71817165-c4a0-473d-9df2-c3e649e11c0a tempest-GroupSnapshotsV319Test-1358098521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f4da841-01ec-4eaf-84c6-4b30e24bcce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:54:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1260997694',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=75d0a220-749c-4a14-a331-b7a810c661c0,host='devstack@QuobyteHD#QuobyteHD',id=a643ca1d-2042-492b-8498-a30b8740fd68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d03ec9db0e248eb9f956b53535ef8c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:54:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:54:50Z,use_quota=True,user_id='d0ba426318124bdb98a507b5bda0ae69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d85cfd70-b0cc-4aa2-aeaf-461241d94f4a),volume_type_id=d85cfd70-b0cc-4aa2-aeaf-461241d94f4a)' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:54:50 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-71817165-c4a0-473d-9df2-c3e649e11c0a tempest-GroupSnapshotsV319Test-1358098521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4493a023-ef19-468b-aa13-717d979fcfd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:54:50 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-71817165-c4a0-473d-9df2-c3e649e11c0a tempest-GroupSnapshotsV319Test-1358098521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4493a023-ef19-468b-aa13-717d979fcfd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:54:50 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-71817165-c4a0-473d-9df2-c3e649e11c0a tempest-GroupSnapshotsV319Test-1358098521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29aaac05-4d12-42ca-a2a2-d66c9efc2515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:54:50 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-71817165-c4a0-473d-9df2-c3e649e11c0a tempest-GroupSnapshotsV319Test-1358098521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29aaac05-4d12-42ca-a2a2-d66c9efc2515) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a643ca1d-2042-492b-8498-a30b8740fd68', 'volume_name': 'volume-a643ca1d-2042-492b-8498-a30b8740fd68', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:54:50 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-71817165-c4a0-473d-9df2-c3e649e11c0a tempest-GroupSnapshotsV319Test-1358098521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f72df120-85ce-4837-95d1-f56aa4078665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:54:50 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-71817165-c4a0-473d-9df2-c3e649e11c0a tempest-GroupSnapshotsV319Test-1358098521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f72df120-85ce-4837-95d1-f56aa4078665) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:54:50 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-71817165-c4a0-473d-9df2-c3e649e11c0a tempest-GroupSnapshotsV319Test-1358098521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4cb1971-f2fd-4e8d-8c3b-64b388c6f04f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:54:50 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-71817165-c4a0-473d-9df2-c3e649e11c0a tempest-GroupSnapshotsV319Test-1358098521 None] Volume a643ca1d-2042-492b-8498-a30b8740fd68: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a643ca1d-2042-492b-8498-a30b8740fd68', 'volume_size': 1} Apr 22 17:54:50 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-71817165-c4a0-473d-9df2-c3e649e11c0a tempest-GroupSnapshotsV319Test-1358098521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:54:50 devstack sudo[87005]: pam_unix(sudo:session): session closed for user root Apr 22 17:54:50 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-479a1511-1422-4706-b073-3994c7ded239 tempest-VolumesImageMetadata-1623522424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9e076047-8ac8-4bf8-88ea-602aa20d3c9e_slemzzj2devstack@QuobyteHD /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-3e0dbfb5-8ded-4fc0-ac6f-aec5893d1a52" returned: 0 in 1.747s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:54:50 devstack cinder-volume[81771]: DEBUG cinder.image.image_utils [None req-479a1511-1422-4706-b073-3994c7ded239 tempest-VolumesImageMetadata-1623522424 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9e076047-8ac8-4bf8-88ea-602aa20d3c9e_slemzzj2devstack@QuobyteHD, size 112.00 MB, duration 1.75 sec, destination /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-3e0dbfb5-8ded-4fc0-ac6f-aec5893d1a52 {{(pid=81771) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 22 17:54:50 devstack cinder-volume[81771]: INFO cinder.image.image_utils [None req-479a1511-1422-4706-b073-3994c7ded239 tempest-VolumesImageMetadata-1623522424 None] Converted 112.00 MB image at 64.07 MB/s Apr 22 17:54:50 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-479a1511-1422-4706-b073-3994c7ded239 tempest-VolumesImageMetadata-1623522424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-3e0dbfb5-8ded-4fc0-ac6f-aec5893d1a52 1G {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:54:50 devstack sudo[87022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-3e0dbfb5-8ded-4fc0-ac6f-aec5893d1a52 1G Apr 22 17:54:50 devstack sudo[87022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:54:50 devstack sudo[87014]: pam_unix(sudo:session): session closed for user root Apr 22 17:54:50 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-6d6c88e6-af22-42e7-85cc-ea9e4df006b5 tempest-VolumesListAdminTestJSON-2106952741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e9a9b3b8-8b14-4a9f-914f-a9bd62815f8e 1073741824" returned: 0 in 0.933s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:54:50 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-6d6c88e6-af22-42e7-85cc-ea9e4df006b5 tempest-VolumesListAdminTestJSON-2106952741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e9a9b3b8-8b14-4a9f-914f-a9bd62815f8e {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:54:50 devstack sudo[87024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e9a9b3b8-8b14-4a9f-914f-a9bd62815f8e Apr 22 17:54:50 devstack sudo[87024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:54:50 devstack sudo[87022]: pam_unix(sudo:session): session closed for user root Apr 22 17:54:50 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-479a1511-1422-4706-b073-3994c7ded239 tempest-VolumesImageMetadata-1623522424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-3e0dbfb5-8ded-4fc0-ac6f-aec5893d1a52 1G" returned: 0 in 0.551s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:54:50 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf1592ab-8c95-40ae-918c-d56f5f7661df]: (4, 'raw') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:54:50 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-479a1511-1422-4706-b073-3994c7ded239 tempest-VolumesImageMetadata-1623522424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-3e0dbfb5-8ded-4fc0-ac6f-aec5893d1a52 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:54:50 devstack sudo[87024]: pam_unix(sudo:session): session closed for user root Apr 22 17:54:50 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-6d6c88e6-af22-42e7-85cc-ea9e4df006b5 tempest-VolumesListAdminTestJSON-2106952741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e9a9b3b8-8b14-4a9f-914f-a9bd62815f8e" returned: 0 in 0.556s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:54:50 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-6d6c88e6-af22-42e7-85cc-ea9e4df006b5 tempest-VolumesListAdminTestJSON-2106952741 None] <== create_volume: return (1543ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'} {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 17:54:50 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-6d6c88e6-af22-42e7-85cc-ea9e4df006b5 tempest-VolumesListAdminTestJSON-2106952741 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.546s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:54:50 devstack sudo[87030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-3e0dbfb5-8ded-4fc0-ac6f-aec5893d1a52 Apr 22 17:54:50 devstack sudo[87030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:54:50 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-71817165-c4a0-473d-9df2-c3e649e11c0a tempest-GroupSnapshotsV319Test-1358098521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.807s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:54:50 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-71817165-c4a0-473d-9df2-c3e649e11c0a tempest-GroupSnapshotsV319Test-1358098521 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=75d0a220-749c-4a14-a331-b7a810c661c0,created_at=2026-04-22T15:54:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1260997694',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=75d0a220-749c-4a14-a331-b7a810c661c0,host='devstack@QuobyteHD#QuobyteHD',id=a643ca1d-2042-492b-8498-a30b8740fd68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d03ec9db0e248eb9f956b53535ef8c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:54:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:54:50Z,use_quota=True,user_id='d0ba426318124bdb98a507b5bda0ae69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d85cfd70-b0cc-4aa2-aeaf-461241d94f4a),volume_type_id=d85cfd70-b0cc-4aa2-aeaf-461241d94f4a)}" {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 17:54:50 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-71817165-c4a0-473d-9df2-c3e649e11c0a tempest-GroupSnapshotsV319Test-1358098521 None] Creating volume a643ca1d-2042-492b-8498-a30b8740fd68 {{(pid=81771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 17:54:50 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-71817165-c4a0-473d-9df2-c3e649e11c0a tempest-GroupSnapshotsV319Test-1358098521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:54:50 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-71817165-c4a0-473d-9df2-c3e649e11c0a tempest-GroupSnapshotsV319Test-1358098521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:54:50 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-71817165-c4a0-473d-9df2-c3e649e11c0a tempest-GroupSnapshotsV319Test-1358098521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:54:50 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-71817165-c4a0-473d-9df2-c3e649e11c0a tempest-GroupSnapshotsV319Test-1358098521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:54:50 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-71817165-c4a0-473d-9df2-c3e649e11c0a tempest-GroupSnapshotsV319Test-1358098521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:54:50 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-71817165-c4a0-473d-9df2-c3e649e11c0a tempest-GroupSnapshotsV319Test-1358098521 None] Selected osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 as target Quobyte volume. {{(pid=81771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 17:54:50 devstack cinder-volume[81771]: INFO cinder.volume.drivers.remotefs [None req-71817165-c4a0-473d-9df2-c3e649e11c0a tempest-GroupSnapshotsV319Test-1358098521 None] casted to osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 Apr 22 17:54:50 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-71817165-c4a0-473d-9df2-c3e649e11c0a tempest-GroupSnapshotsV319Test-1358098521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a643ca1d-2042-492b-8498-a30b8740fd68 1073741824 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:54:51 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-6d6c88e6-af22-42e7-85cc-ea9e4df006b5 tempest-VolumesListAdminTestJSON-2106952741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ed22b75-786e-4019-b140-8a9ea525b881) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9a9b3b8-8b14-4a9f-914f-a9bd62815f8e', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:54:51 devstack sudo[87032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a643ca1d-2042-492b-8498-a30b8740fd68 1073741824 Apr 22 17:54:51 devstack sudo[87032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:54:51 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-6d6c88e6-af22-42e7-85cc-ea9e4df006b5 tempest-VolumesListAdminTestJSON-2106952741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3116d233-b69f-4ab2-9cfa-9ce9203f8ab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:54:51 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-6d6c88e6-af22-42e7-85cc-ea9e4df006b5 tempest-VolumesListAdminTestJSON-2106952741 None] Volume volume-e9a9b3b8-8b14-4a9f-914f-a9bd62815f8e (e9a9b3b8-8b14-4a9f-914f-a9bd62815f8e): created successfully Apr 22 17:54:51 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-6d6c88e6-af22-42e7-85cc-ea9e4df006b5 tempest-VolumesListAdminTestJSON-2106952741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3116d233-b69f-4ab2-9cfa-9ce9203f8ab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:54:51 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-6d6c88e6-af22-42e7-85cc-ea9e4df006b5 tempest-VolumesListAdminTestJSON-2106952741 None] Flow 'volume_create_manager' (07e2c12c-d0fd-4288-8ee3-2a2c20f6e28d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:54:51 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-6d6c88e6-af22-42e7-85cc-ea9e4df006b5 tempest-VolumesListAdminTestJSON-2106952741 None] Created volume successfully. Apr 22 17:54:51 devstack sudo[87030]: pam_unix(sudo:session): session closed for user root Apr 22 17:54:51 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-479a1511-1422-4706-b073-3994c7ded239 tempest-VolumesImageMetadata-1623522424 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-3e0dbfb5-8ded-4fc0-ac6f-aec5893d1a52" returned: 0 in 0.574s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:54:51 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-479a1511-1422-4706-b073-3994c7ded239 tempest-VolumesImageMetadata-1623522424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-3e0dbfb5-8ded-4fc0-ac6f-aec5893d1a52 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:54:51 devstack sudo[87039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-3e0dbfb5-8ded-4fc0-ac6f-aec5893d1a52 Apr 22 17:54:51 devstack sudo[87039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:54:51 devstack sudo[87032]: pam_unix(sudo:session): session closed for user root Apr 22 17:54:51 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-71817165-c4a0-473d-9df2-c3e649e11c0a tempest-GroupSnapshotsV319Test-1358098521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a643ca1d-2042-492b-8498-a30b8740fd68 1073741824" returned: 0 in 0.725s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:54:51 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-71817165-c4a0-473d-9df2-c3e649e11c0a tempest-GroupSnapshotsV319Test-1358098521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a643ca1d-2042-492b-8498-a30b8740fd68 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:54:51 devstack sudo[87044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a643ca1d-2042-492b-8498-a30b8740fd68 Apr 22 17:54:51 devstack sudo[87044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:54:52 devstack cinder-volume[81771]: DEBUG cinder.volume.flows.manager.create_volume [None req-dabbb9ba-67de-477b-9043-379522d4a89f tempest-VolumesListAdminTestJSON-1796033045 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 17:54:52 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-dabbb9ba-67de-477b-9043-379522d4a89f tempest-VolumesListAdminTestJSON-1796033045 None] Flow 'volume_create_manager' (ec9bf8be-ea70-40e3-bfac-344105302467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:54:52 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-dabbb9ba-67de-477b-9043-379522d4a89f tempest-VolumesListAdminTestJSON-1796033045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3e25617-a098-4d06-81c8-e5f69fbc5ca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:54:52 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-dabbb9ba-67de-477b-9043-379522d4a89f tempest-VolumesListAdminTestJSON-1796033045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3e25617-a098-4d06-81c8-e5f69fbc5ca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:54:52Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d50337af-17b9-41e0-b31d-dcb4c8249347,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='292b8e3573004237b26309d838ed0bf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:54:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:54:52Z,use_quota=True,user_id='4d7a79fb6998447b9124551719bbc108',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:54:52 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-dabbb9ba-67de-477b-9043-379522d4a89f tempest-VolumesListAdminTestJSON-1796033045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8eaff43-7bf8-4ef4-9df6-57bb038416b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:54:52 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-dabbb9ba-67de-477b-9043-379522d4a89f tempest-VolumesListAdminTestJSON-1796033045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8eaff43-7bf8-4ef4-9df6-57bb038416b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:54:52 devstack sudo[87039]: pam_unix(sudo:session): session closed for user root Apr 22 17:54:52 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-dabbb9ba-67de-477b-9043-379522d4a89f tempest-VolumesListAdminTestJSON-1796033045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f63fbd2b-9b89-4f84-b070-696775208c31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:54:52 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-dabbb9ba-67de-477b-9043-379522d4a89f tempest-VolumesListAdminTestJSON-1796033045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f63fbd2b-9b89-4f84-b070-696775208c31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd50337af-17b9-41e0-b31d-dcb4c8249347', 'volume_name': 'volume-d50337af-17b9-41e0-b31d-dcb4c8249347', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:54:52 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-dabbb9ba-67de-477b-9043-379522d4a89f tempest-VolumesListAdminTestJSON-1796033045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be00c4ba-90c0-4023-80c5-23137e20e5bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:54:52 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-dabbb9ba-67de-477b-9043-379522d4a89f tempest-VolumesListAdminTestJSON-1796033045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be00c4ba-90c0-4023-80c5-23137e20e5bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:54:52 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-dabbb9ba-67de-477b-9043-379522d4a89f tempest-VolumesListAdminTestJSON-1796033045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (850c467a-d96e-48ac-b4e3-913e8701d696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:54:52 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-dabbb9ba-67de-477b-9043-379522d4a89f tempest-VolumesListAdminTestJSON-1796033045 None] Volume d50337af-17b9-41e0-b31d-dcb4c8249347: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d50337af-17b9-41e0-b31d-dcb4c8249347', 'volume_size': 1} Apr 22 17:54:52 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-dabbb9ba-67de-477b-9043-379522d4a89f tempest-VolumesListAdminTestJSON-1796033045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:54:52 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-479a1511-1422-4706-b073-3994c7ded239 tempest-VolumesImageMetadata-1623522424 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-3e0dbfb5-8ded-4fc0-ac6f-aec5893d1a52" returned: 1 in 0.839s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:54:52 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-479a1511-1422-4706-b073-3994c7ded239 tempest-VolumesImageMetadata-1623522424 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-3e0dbfb5-8ded-4fc0-ac6f-aec5893d1a52' failed. Not Retrying. {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 22 17:54:52 devstack cinder-volume[81771]: DEBUG cinder.volume.volume_utils [None req-479a1511-1422-4706-b073-3994c7ded239 tempest-VolumesImageMetadata-1623522424 None] Downloaded image 9e076047-8ac8-4bf8-88ea-602aa20d3c9e ((None, [{'url': 'file:///opt/stack/data/glance/images/9e076047-8ac8-4bf8-88ea-602aa20d3c9e', 'metadata': {}}])) to volume 3e0dbfb5-8ded-4fc0-ac6f-aec5893d1a52 successfully. {{(pid=81771) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 22 17:54:52 devstack cinder-volume[81771]: DEBUG cinder.image.image_utils [None req-479a1511-1422-4706-b073-3994c7ded239 tempest-VolumesImageMetadata-1623522424 None] Temporary image 9e076047-8ac8-4bf8-88ea-602aa20d3c9e for user 05c1bd538f7a47ddb62683262f674d5d is deleted. {{(pid=81771) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 22 17:54:52 devstack cinder-volume[81771]: DEBUG cinder.volume.volume_utils [None req-479a1511-1422-4706-b073-3994c7ded239 tempest-VolumesImageMetadata-1623522424 None] Marking volume 3e0dbfb5-8ded-4fc0-ac6f-aec5893d1a52 as bootable. {{(pid=81771) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 22 17:54:52 devstack cinder-volume[81771]: DEBUG cinder.volume.flows.manager.create_volume [None req-479a1511-1422-4706-b073-3994c7ded239 tempest-VolumesImageMetadata-1623522424 None] Copying metadata from image 9e076047-8ac8-4bf8-88ea-602aa20d3c9e to 3e0dbfb5-8ded-4fc0-ac6f-aec5893d1a52. {{(pid=81771) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 22 17:54:52 devstack cinder-volume[81771]: DEBUG cinder.volume.flows.manager.create_volume [None req-479a1511-1422-4706-b073-3994c7ded239 tempest-VolumesImageMetadata-1623522424 None] Creating volume glance metadata for volume 3e0dbfb5-8ded-4fc0-ac6f-aec5893d1a52 backed by image 9e076047-8ac8-4bf8-88ea-602aa20d3c9e with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '9e076047-8ac8-4bf8-88ea-602aa20d3c9e', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=81771) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 22 17:54:52 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-479a1511-1422-4706-b073-3994c7ded239 tempest-VolumesImageMetadata-1623522424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d4cf519-e7e0-4891-bdd0-a1bc110e8a91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e0dbfb5-8ded-4fc0-ac6f-aec5893d1a52', 'volume_size': 1, 'image_id': '9e076047-8ac8-4bf8-88ea-602aa20d3c9e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9e076047-8ac8-4bf8-88ea-602aa20d3c9e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '39e18fb0fde242f68d38bed6963e8744', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9e076047-8ac8-4bf8-88ea-602aa20d3c9e', 'created_at': datetime.datetime(2026, 4, 22, 15, 44, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 22, 15, 44, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9e076047-8ac8-4bf8-88ea-602aa20d3c9e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:54:52 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-479a1511-1422-4706-b073-3994c7ded239 tempest-VolumesImageMetadata-1623522424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e526d45e-c12a-405a-ad1c-4b098359471f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:54:52 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-479a1511-1422-4706-b073-3994c7ded239 tempest-VolumesImageMetadata-1623522424 None] Volume volume-3e0dbfb5-8ded-4fc0-ac6f-aec5893d1a52 (3e0dbfb5-8ded-4fc0-ac6f-aec5893d1a52): created successfully Apr 22 17:54:52 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-479a1511-1422-4706-b073-3994c7ded239 tempest-VolumesImageMetadata-1623522424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e526d45e-c12a-405a-ad1c-4b098359471f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:54:52 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-479a1511-1422-4706-b073-3994c7ded239 tempest-VolumesImageMetadata-1623522424 None] Flow 'volume_create_manager' (96fa30a9-80f7-4bac-a0ab-d24b2320efdc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:54:52 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-479a1511-1422-4706-b073-3994c7ded239 tempest-VolumesImageMetadata-1623522424 None] Created volume successfully. Apr 22 17:54:52 devstack sudo[87044]: pam_unix(sudo:session): session closed for user root Apr 22 17:54:52 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-71817165-c4a0-473d-9df2-c3e649e11c0a tempest-GroupSnapshotsV319Test-1358098521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a643ca1d-2042-492b-8498-a30b8740fd68" returned: 0 in 0.741s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:54:52 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-71817165-c4a0-473d-9df2-c3e649e11c0a tempest-GroupSnapshotsV319Test-1358098521 None] <== create_volume: return (1522ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'} {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 17:54:52 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-71817165-c4a0-473d-9df2-c3e649e11c0a tempest-GroupSnapshotsV319Test-1358098521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.524s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:54:52 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-dabbb9ba-67de-477b-9043-379522d4a89f tempest-VolumesListAdminTestJSON-1796033045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.198s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:54:52 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-dabbb9ba-67de-477b-9043-379522d4a89f tempest-VolumesListAdminTestJSON-1796033045 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:54:52Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d50337af-17b9-41e0-b31d-dcb4c8249347,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='292b8e3573004237b26309d838ed0bf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:54:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:54:52Z,use_quota=True,user_id='4d7a79fb6998447b9124551719bbc108',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)}" {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 17:54:52 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-dabbb9ba-67de-477b-9043-379522d4a89f tempest-VolumesListAdminTestJSON-1796033045 None] Creating volume d50337af-17b9-41e0-b31d-dcb4c8249347 {{(pid=81771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 17:54:52 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-dabbb9ba-67de-477b-9043-379522d4a89f tempest-VolumesListAdminTestJSON-1796033045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:54:52 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-dabbb9ba-67de-477b-9043-379522d4a89f tempest-VolumesListAdminTestJSON-1796033045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:54:52 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-dabbb9ba-67de-477b-9043-379522d4a89f tempest-VolumesListAdminTestJSON-1796033045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:54:52 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-dabbb9ba-67de-477b-9043-379522d4a89f tempest-VolumesListAdminTestJSON-1796033045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:54:52 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-dabbb9ba-67de-477b-9043-379522d4a89f tempest-VolumesListAdminTestJSON-1796033045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:54:52 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-dabbb9ba-67de-477b-9043-379522d4a89f tempest-VolumesListAdminTestJSON-1796033045 None] Selected osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 as target Quobyte volume. {{(pid=81771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 17:54:52 devstack cinder-volume[81771]: INFO cinder.volume.drivers.remotefs [None req-dabbb9ba-67de-477b-9043-379522d4a89f tempest-VolumesListAdminTestJSON-1796033045 None] casted to osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 Apr 22 17:54:52 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-dabbb9ba-67de-477b-9043-379522d4a89f tempest-VolumesListAdminTestJSON-1796033045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-d50337af-17b9-41e0-b31d-dcb4c8249347 1073741824 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:54:52 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-71817165-c4a0-473d-9df2-c3e649e11c0a tempest-GroupSnapshotsV319Test-1358098521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4cb1971-f2fd-4e8d-8c3b-64b388c6f04f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a643ca1d-2042-492b-8498-a30b8740fd68', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:54:52 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-71817165-c4a0-473d-9df2-c3e649e11c0a tempest-GroupSnapshotsV319Test-1358098521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d91da70d-9ee8-4a12-9bcb-54e714dbf6e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:54:52 devstack sudo[87057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-d50337af-17b9-41e0-b31d-dcb4c8249347 1073741824 Apr 22 17:54:52 devstack sudo[87057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:54:52 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-71817165-c4a0-473d-9df2-c3e649e11c0a tempest-GroupSnapshotsV319Test-1358098521 None] Volume volume-a643ca1d-2042-492b-8498-a30b8740fd68 (a643ca1d-2042-492b-8498-a30b8740fd68): created successfully Apr 22 17:54:52 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-71817165-c4a0-473d-9df2-c3e649e11c0a tempest-GroupSnapshotsV319Test-1358098521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d91da70d-9ee8-4a12-9bcb-54e714dbf6e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:54:52 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-71817165-c4a0-473d-9df2-c3e649e11c0a tempest-GroupSnapshotsV319Test-1358098521 None] Flow 'volume_create_manager' (8b28b8ff-5d6a-4b71-bacb-b01bea786bc9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:54:52 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-71817165-c4a0-473d-9df2-c3e649e11c0a tempest-GroupSnapshotsV319Test-1358098521 None] Created volume successfully. Apr 22 17:54:53 devstack sudo[87057]: pam_unix(sudo:session): session closed for user root Apr 22 17:54:53 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-dabbb9ba-67de-477b-9043-379522d4a89f tempest-VolumesListAdminTestJSON-1796033045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-d50337af-17b9-41e0-b31d-dcb4c8249347 1073741824" returned: 0 in 0.821s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:54:53 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-dabbb9ba-67de-477b-9043-379522d4a89f tempest-VolumesListAdminTestJSON-1796033045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-d50337af-17b9-41e0-b31d-dcb4c8249347 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:54:53 devstack sudo[87082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-d50337af-17b9-41e0-b31d-dcb4c8249347 Apr 22 17:54:53 devstack sudo[87082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:54:53 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-c9e25ad8-5dda-42cf-9f44-cab8e4337011 tempest-GroupSnapshotsV319Test-1358098521 None] GroupSnapshot 0d2b31c1-264a-4e01-87b7-fb8570abc9de: creating. Apr 22 17:54:54 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-c9e25ad8-5dda-42cf-9f44-cab8e4337011 tempest-GroupSnapshotsV319Test-1358098521 None] Group snapshot 0d2b31c1-264a-4e01-87b7-fb8570abc9de: creating. {{(pid=81771) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 22 17:54:54 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-c9e25ad8-5dda-42cf-9f44-cab8e4337011 tempest-GroupSnapshotsV319Test-1358098521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:54:54 devstack sudo[87082]: pam_unix(sudo:session): session closed for user root Apr 22 17:54:54 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-dabbb9ba-67de-477b-9043-379522d4a89f tempest-VolumesListAdminTestJSON-1796033045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-d50337af-17b9-41e0-b31d-dcb4c8249347" returned: 0 in 0.823s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:54:54 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-dabbb9ba-67de-477b-9043-379522d4a89f tempest-VolumesListAdminTestJSON-1796033045 None] <== create_volume: return (1691ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'} {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 17:54:54 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-dabbb9ba-67de-477b-9043-379522d4a89f tempest-VolumesListAdminTestJSON-1796033045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.695s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:54:54 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-c9e25ad8-5dda-42cf-9f44-cab8e4337011 tempest-GroupSnapshotsV319Test-1358098521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.154s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:54:54 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-dabbb9ba-67de-477b-9043-379522d4a89f tempest-VolumesListAdminTestJSON-1796033045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (850c467a-d96e-48ac-b4e3-913e8701d696) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d50337af-17b9-41e0-b31d-dcb4c8249347', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:54:54 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-dabbb9ba-67de-477b-9043-379522d4a89f tempest-VolumesListAdminTestJSON-1796033045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11cd4bd0-02cf-4b21-b917-6e9e727f1a8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:54:54 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-c9e25ad8-5dda-42cf-9f44-cab8e4337011 tempest-GroupSnapshotsV319Test-1358098521 None] Creating offline snapshot 6486c404-4b48-4387-aa5b-f4eb1a990833 of volume a643ca1d-2042-492b-8498-a30b8740fd68 {{(pid=81771) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 22 17:54:54 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-dabbb9ba-67de-477b-9043-379522d4a89f tempest-VolumesListAdminTestJSON-1796033045 None] Volume volume-d50337af-17b9-41e0-b31d-dcb4c8249347 (d50337af-17b9-41e0-b31d-dcb4c8249347): created successfully Apr 22 17:54:54 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-dabbb9ba-67de-477b-9043-379522d4a89f tempest-VolumesListAdminTestJSON-1796033045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11cd4bd0-02cf-4b21-b917-6e9e727f1a8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:54:54 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-dabbb9ba-67de-477b-9043-379522d4a89f tempest-VolumesListAdminTestJSON-1796033045 None] Flow 'volume_create_manager' (ec9bf8be-ea70-40e3-bfac-344105302467) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:54:54 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf179c84-4457-4f6f-bd2f-d7dfd8da072a]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:54:54 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-c9e25ad8-5dda-42cf-9f44-cab8e4337011 tempest-GroupSnapshotsV319Test-1358098521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a643ca1d-2042-492b-8498-a30b8740fd68 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:54:54 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-dabbb9ba-67de-477b-9043-379522d4a89f tempest-VolumesListAdminTestJSON-1796033045 None] Created volume successfully. Apr 22 17:54:54 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-29f58d7d-ea9c-45f6-8b96-d95f212a73f2 tempest-VolumesImageMetadata-1623522424 None] Acquiring lock "cinder-3e0dbfb5-8ded-4fc0-ac6f-aec5893d1a52-delete_volume" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:54:54 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-29f58d7d-ea9c-45f6-8b96-d95f212a73f2 tempest-VolumesImageMetadata-1623522424 None] Lock "cinder-3e0dbfb5-8ded-4fc0-ac6f-aec5893d1a52-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:54:54 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-29f58d7d-ea9c-45f6-8b96-d95f212a73f2 tempest-VolumesImageMetadata-1623522424 None] Acquiring lock "cinder-quobyte-3e0dbfb5-8ded-4fc0-ac6f-aec5893d1a52" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:54:54 devstack sudo[87101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a643ca1d-2042-492b-8498-a30b8740fd68 Apr 22 17:54:54 devstack sudo[87101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:54:54 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-29f58d7d-ea9c-45f6-8b96-d95f212a73f2 tempest-VolumesImageMetadata-1623522424 None] Lock "cinder-quobyte-3e0dbfb5-8ded-4fc0-ac6f-aec5893d1a52" acquired by "delete_volume" :: waited 0.016s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:54:54 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a91c37d-62e0-4088-86d1-ec6879e84531]: (4, 'raw') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:54:54 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-29f58d7d-ea9c-45f6-8b96-d95f212a73f2 tempest-VolumesImageMetadata-1623522424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-3e0dbfb5-8ded-4fc0-ac6f-aec5893d1a52 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:54:54 devstack sudo[87103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-3e0dbfb5-8ded-4fc0-ac6f-aec5893d1a52 Apr 22 17:54:54 devstack sudo[87103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:54:54 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-4634b2b9-8877-4892-81e2-ba9e85a071f6 tempest-VolumesListAdminTestJSON-1796033045 None] Acquiring lock "cinder-d50337af-17b9-41e0-b31d-dcb4c8249347-delete_volume" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:54:54 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-4634b2b9-8877-4892-81e2-ba9e85a071f6 tempest-VolumesListAdminTestJSON-1796033045 None] Lock "cinder-d50337af-17b9-41e0-b31d-dcb4c8249347-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:54:54 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-4634b2b9-8877-4892-81e2-ba9e85a071f6 tempest-VolumesListAdminTestJSON-1796033045 None] Acquiring lock "cinder-quobyte-d50337af-17b9-41e0-b31d-dcb4c8249347" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:54:54 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-4634b2b9-8877-4892-81e2-ba9e85a071f6 tempest-VolumesListAdminTestJSON-1796033045 None] Lock "cinder-quobyte-d50337af-17b9-41e0-b31d-dcb4c8249347" acquired by "delete_volume" :: waited 0.032s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:54:54 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7a12acc-a8e7-4800-a076-c012045ce0be]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:54:54 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-4634b2b9-8877-4892-81e2-ba9e85a071f6 tempest-VolumesListAdminTestJSON-1796033045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-d50337af-17b9-41e0-b31d-dcb4c8249347 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:54:54 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-7df917e4-ffe2-4cbd-922c-75e9e8a4a464 tempest-VolumesListAdminTestJSON-2106952741 None] Acquiring lock "cinder-e9a9b3b8-8b14-4a9f-914f-a9bd62815f8e-delete_volume" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:54:54 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-7df917e4-ffe2-4cbd-922c-75e9e8a4a464 tempest-VolumesListAdminTestJSON-2106952741 None] Lock "cinder-e9a9b3b8-8b14-4a9f-914f-a9bd62815f8e-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:54:55 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-7df917e4-ffe2-4cbd-922c-75e9e8a4a464 tempest-VolumesListAdminTestJSON-2106952741 None] Acquiring lock "cinder-quobyte-e9a9b3b8-8b14-4a9f-914f-a9bd62815f8e" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:54:55 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-7df917e4-ffe2-4cbd-922c-75e9e8a4a464 tempest-VolumesListAdminTestJSON-2106952741 None] Lock "cinder-quobyte-e9a9b3b8-8b14-4a9f-914f-a9bd62815f8e" acquired by "delete_volume" :: waited 0.022s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:54:55 devstack sudo[87105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-d50337af-17b9-41e0-b31d-dcb4c8249347 Apr 22 17:54:55 devstack sudo[87105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:54:55 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[685a783a-9d65-479d-9bb2-bd37df49655b]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:54:55 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-7df917e4-ffe2-4cbd-922c-75e9e8a4a464 tempest-VolumesListAdminTestJSON-2106952741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e9a9b3b8-8b14-4a9f-914f-a9bd62815f8e {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:54:55 devstack sudo[87107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e9a9b3b8-8b14-4a9f-914f-a9bd62815f8e Apr 22 17:54:55 devstack sudo[87107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:54:55 devstack sudo[87101]: pam_unix(sudo:session): session closed for user root Apr 22 17:54:55 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-c9e25ad8-5dda-42cf-9f44-cab8e4337011 tempest-GroupSnapshotsV319Test-1358098521 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a643ca1d-2042-492b-8498-a30b8740fd68" returned: 0 in 1.228s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:54:55 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-c9e25ad8-5dda-42cf-9f44-cab8e4337011 tempest-GroupSnapshotsV319Test-1358098521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a643ca1d-2042-492b-8498-a30b8740fd68,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a643ca1d-2042-492b-8498-a30b8740fd68.6486c404-4b48-4387-aa5b-f4eb1a990833 1G {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:54:55 devstack sudo[87112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a643ca1d-2042-492b-8498-a30b8740fd68,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a643ca1d-2042-492b-8498-a30b8740fd68.6486c404-4b48-4387-aa5b-f4eb1a990833 1G Apr 22 17:54:55 devstack sudo[87112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:54:55 devstack sudo[87103]: pam_unix(sudo:session): session closed for user root Apr 22 17:54:55 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-29f58d7d-ea9c-45f6-8b96-d95f212a73f2 tempest-VolumesImageMetadata-1623522424 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-3e0dbfb5-8ded-4fc0-ac6f-aec5893d1a52" returned: 0 in 1.273s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:54:55 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-29f58d7d-ea9c-45f6-8b96-d95f212a73f2 tempest-VolumesImageMetadata-1623522424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-3e0dbfb5-8ded-4fc0-ac6f-aec5893d1a52 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:54:55 devstack sudo[87107]: pam_unix(sudo:session): session closed for user root Apr 22 17:54:55 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-7df917e4-ffe2-4cbd-922c-75e9e8a4a464 tempest-VolumesListAdminTestJSON-2106952741 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e9a9b3b8-8b14-4a9f-914f-a9bd62815f8e" returned: 0 in 0.805s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:54:55 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-7df917e4-ffe2-4cbd-922c-75e9e8a4a464 tempest-VolumesListAdminTestJSON-2106952741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e9a9b3b8-8b14-4a9f-914f-a9bd62815f8e {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:54:55 devstack sudo[87123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e9a9b3b8-8b14-4a9f-914f-a9bd62815f8e Apr 22 17:54:55 devstack sudo[87123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:54:55 devstack sudo[87122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-3e0dbfb5-8ded-4fc0-ac6f-aec5893d1a52 Apr 22 17:54:55 devstack sudo[87122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:54:55 devstack sudo[87105]: pam_unix(sudo:session): session closed for user root Apr 22 17:54:55 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-4634b2b9-8877-4892-81e2-ba9e85a071f6 tempest-VolumesListAdminTestJSON-1796033045 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-d50337af-17b9-41e0-b31d-dcb4c8249347" returned: 0 in 1.146s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:54:56 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-4634b2b9-8877-4892-81e2-ba9e85a071f6 tempest-VolumesListAdminTestJSON-1796033045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-d50337af-17b9-41e0-b31d-dcb4c8249347 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:54:56 devstack sudo[87133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-d50337af-17b9-41e0-b31d-dcb4c8249347 Apr 22 17:54:56 devstack sudo[87133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:54:56 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-7399497d-1b8e-47c4-98a9-a7b38bce8534 tempest-VolumesActionsTest-84916959 None] Acquiring lock "cinder-e3664582-4810-4ace-9346-f53375c65ed6" by "attach_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:54:56 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-7399497d-1b8e-47c4-98a9-a7b38bce8534 tempest-VolumesActionsTest-84916959 None] Lock "cinder-e3664582-4810-4ace-9346-f53375c65ed6" acquired by "attach_volume" :: waited 0.035s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:54:57 devstack sudo[87122]: pam_unix(sudo:session): session closed for user root Apr 22 17:54:57 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-29f58d7d-ea9c-45f6-8b96-d95f212a73f2 tempest-VolumesImageMetadata-1623522424 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-3e0dbfb5-8ded-4fc0-ac6f-aec5893d1a52" returned: 1 in 1.256s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:54:57 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-29f58d7d-ea9c-45f6-8b96-d95f212a73f2 tempest-VolumesImageMetadata-1623522424 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-3e0dbfb5-8ded-4fc0-ac6f-aec5893d1a52' failed. Not Retrying. {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 22 17:54:57 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-29f58d7d-ea9c-45f6-8b96-d95f212a73f2 tempest-VolumesImageMetadata-1623522424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-3e0dbfb5-8ded-4fc0-ac6f-aec5893d1a52 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:54:57 devstack sudo[87171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-3e0dbfb5-8ded-4fc0-ac6f-aec5893d1a52 Apr 22 17:54:57 devstack sudo[87171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:54:57 devstack sudo[87123]: pam_unix(sudo:session): session closed for user root Apr 22 17:54:57 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-7399497d-1b8e-47c4-98a9-a7b38bce8534 tempest-VolumesActionsTest-84916959 None] Attaching volume e3664582-4810-4ace-9346-f53375c65ed6 to instance 44e7b821-a3aa-42ef-8e45-c819ad324bbd at mountpoint /dev/vdb on host None. Apr 22 17:54:57 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-7df917e4-ffe2-4cbd-922c-75e9e8a4a464 tempest-VolumesListAdminTestJSON-2106952741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e9a9b3b8-8b14-4a9f-914f-a9bd62815f8e" returned: 0 in 1.234s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:54:57 devstack sudo[87133]: pam_unix(sudo:session): session closed for user root Apr 22 17:54:57 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-4634b2b9-8877-4892-81e2-ba9e85a071f6 tempest-VolumesListAdminTestJSON-1796033045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-d50337af-17b9-41e0-b31d-dcb4c8249347" returned: 0 in 1.158s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:54:57 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-7df917e4-ffe2-4cbd-922c-75e9e8a4a464 tempest-VolumesListAdminTestJSON-2106952741 None] Lock "cinder-quobyte-e9a9b3b8-8b14-4a9f-914f-a9bd62815f8e" released by "delete_volume" :: held 2.142s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:54:57 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-4634b2b9-8877-4892-81e2-ba9e85a071f6 tempest-VolumesListAdminTestJSON-1796033045 None] Lock "cinder-quobyte-d50337af-17b9-41e0-b31d-dcb4c8249347" released by "delete_volume" :: held 2.433s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:54:57 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-7399497d-1b8e-47c4-98a9-a7b38bce8534 tempest-VolumesActionsTest-84916959 None] Attach volume completed successfully. Apr 22 17:54:57 devstack sudo[87112]: pam_unix(sudo:session): session closed for user root Apr 22 17:54:57 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-7399497d-1b8e-47c4-98a9-a7b38bce8534 tempest-VolumesActionsTest-84916959 None] Lock "cinder-e3664582-4810-4ace-9346-f53375c65ed6" released by "attach_volume" :: held 0.300s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:54:57 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-c9e25ad8-5dda-42cf-9f44-cab8e4337011 tempest-GroupSnapshotsV319Test-1358098521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a643ca1d-2042-492b-8498-a30b8740fd68,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a643ca1d-2042-492b-8498-a30b8740fd68.6486c404-4b48-4387-aa5b-f4eb1a990833 1G" returned: 0 in 1.720s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:54:57 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-c9e25ad8-5dda-42cf-9f44-cab8e4337011 tempest-GroupSnapshotsV319Test-1358098521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a643ca1d-2042-492b-8498-a30b8740fd68 -F qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a643ca1d-2042-492b-8498-a30b8740fd68.6486c404-4b48-4387-aa5b-f4eb1a990833 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:54:57 devstack sudo[87173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a643ca1d-2042-492b-8498-a30b8740fd68 -F qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a643ca1d-2042-492b-8498-a30b8740fd68.6486c404-4b48-4387-aa5b-f4eb1a990833 Apr 22 17:54:57 devstack sudo[87173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:54:57 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-4634b2b9-8877-4892-81e2-ba9e85a071f6 tempest-VolumesListAdminTestJSON-1796033045 None] Created reservations ['26dd7be2-396f-45b5-b9ca-ac2e4485e42a', 'd8c600ea-0eb0-42c5-9c89-94a0ee2e5ba9', 'a8823a7e-6d06-40c8-b703-cc4150004b83', '0a2d3890-6ea0-47a5-bda9-07d23b7462c6'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 17:54:57 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-7df917e4-ffe2-4cbd-922c-75e9e8a4a464 tempest-VolumesListAdminTestJSON-2106952741 None] Created reservations ['1943ce77-185e-48a1-9ea8-a8eb64692b0a', 'a325d1e3-474a-400a-bfca-387e03eac8df', 'c64c80f5-f3d9-4d74-8d86-c4f539a5d123', '8b05a7c2-05cd-47fa-adbe-55ba914560d0'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 17:54:57 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-4634b2b9-8877-4892-81e2-ba9e85a071f6 tempest-VolumesListAdminTestJSON-1796033045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:54:57 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-4634b2b9-8877-4892-81e2-ba9e85a071f6 tempest-VolumesListAdminTestJSON-1796033045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:54:57 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-4634b2b9-8877-4892-81e2-ba9e85a071f6 tempest-VolumesListAdminTestJSON-1796033045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:54:57 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-4634b2b9-8877-4892-81e2-ba9e85a071f6 tempest-VolumesListAdminTestJSON-1796033045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:54:57 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-4634b2b9-8877-4892-81e2-ba9e85a071f6 tempest-VolumesListAdminTestJSON-1796033045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:54:57 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-4634b2b9-8877-4892-81e2-ba9e85a071f6 tempest-VolumesListAdminTestJSON-1796033045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:54:57 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-7df917e4-ffe2-4cbd-922c-75e9e8a4a464 tempest-VolumesListAdminTestJSON-2106952741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:54:57 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-7df917e4-ffe2-4cbd-922c-75e9e8a4a464 tempest-VolumesListAdminTestJSON-2106952741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:54:57 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-7df917e4-ffe2-4cbd-922c-75e9e8a4a464 tempest-VolumesListAdminTestJSON-2106952741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:54:57 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-7df917e4-ffe2-4cbd-922c-75e9e8a4a464 tempest-VolumesListAdminTestJSON-2106952741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:54:57 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-7df917e4-ffe2-4cbd-922c-75e9e8a4a464 tempest-VolumesListAdminTestJSON-2106952741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:54:57 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-7df917e4-ffe2-4cbd-922c-75e9e8a4a464 tempest-VolumesListAdminTestJSON-2106952741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:54:57 devstack sudo[87176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 Apr 22 17:54:57 devstack sudo[87176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:54:57 devstack sudo[87175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 Apr 22 17:54:57 devstack sudo[87175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:54:57 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-312df65a-2c0f-4af0-b973-40f4ca691ec2 tempest-VolumesActionsTest-84916959 None] Acquiring lock "cinder-e3664582-4810-4ace-9346-f53375c65ed6-detach_volume" by "detach_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:54:57 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-312df65a-2c0f-4af0-b973-40f4ca691ec2 tempest-VolumesActionsTest-84916959 None] Lock "cinder-e3664582-4810-4ace-9346-f53375c65ed6-detach_volume" acquired by "detach_volume" :: waited 0.051s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:54:57 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-312df65a-2c0f-4af0-b973-40f4ca691ec2 tempest-VolumesActionsTest-84916959 None] Detaching volume e3664582-4810-4ace-9346-f53375c65ed6 from instance 44e7b821-a3aa-42ef-8e45-c819ad324bbd. Apr 22 17:54:57 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-a342899c-bab9-4f7d-9bf5-78c5656933f2 tempest-VolumesListAdminTestJSON-2106952741 None] Acquiring lock "cinder-0d74caa9-aac0-4f82-8cc1-515787864eee-delete_volume" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:54:57 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-a342899c-bab9-4f7d-9bf5-78c5656933f2 tempest-VolumesListAdminTestJSON-2106952741 None] Lock "cinder-0d74caa9-aac0-4f82-8cc1-515787864eee-delete_volume" acquired by "delete_volume" :: waited 0.188s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:54:58 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-a342899c-bab9-4f7d-9bf5-78c5656933f2 tempest-VolumesListAdminTestJSON-2106952741 None] Acquiring lock "cinder-quobyte-0d74caa9-aac0-4f82-8cc1-515787864eee" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:54:58 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-312df65a-2c0f-4af0-b973-40f4ca691ec2 tempest-VolumesActionsTest-84916959 None] Detach volume completed successfully. Apr 22 17:54:58 devstack sudo[87173]: pam_unix(sudo:session): session closed for user root Apr 22 17:54:58 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-312df65a-2c0f-4af0-b973-40f4ca691ec2 tempest-VolumesActionsTest-84916959 None] Lock "cinder-e3664582-4810-4ace-9346-f53375c65ed6-detach_volume" released by "detach_volume" :: held 0.407s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:54:58 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-c9e25ad8-5dda-42cf-9f44-cab8e4337011 tempest-GroupSnapshotsV319Test-1358098521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a643ca1d-2042-492b-8498-a30b8740fd68 -F qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a643ca1d-2042-492b-8498-a30b8740fd68.6486c404-4b48-4387-aa5b-f4eb1a990833" returned: 0 in 0.915s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:54:58 devstack cinder-volume[81771]: WARNING cinder.volume.drivers.remotefs [None req-c9e25ad8-5dda-42cf-9f44-cab8e4337011 tempest-GroupSnapshotsV319Test-1358098521 None] /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a643ca1d-2042-492b-8498-a30b8740fd68.6486c404-4b48-4387-aa5b-f4eb1a990833 is being set with open permissions: ugo+rw: NotImplementedError Apr 22 17:54:58 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-c9e25ad8-5dda-42cf-9f44-cab8e4337011 tempest-GroupSnapshotsV319Test-1358098521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a643ca1d-2042-492b-8498-a30b8740fd68.6486c404-4b48-4387-aa5b-f4eb1a990833 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:54:58 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-a342899c-bab9-4f7d-9bf5-78c5656933f2 tempest-VolumesListAdminTestJSON-2106952741 None] Lock "cinder-quobyte-0d74caa9-aac0-4f82-8cc1-515787864eee" acquired by "delete_volume" :: waited 0.068s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:54:58 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[35c28543-806c-4141-99b3-ff78026c0272]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:54:58 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-a342899c-bab9-4f7d-9bf5-78c5656933f2 tempest-VolumesListAdminTestJSON-2106952741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-0d74caa9-aac0-4f82-8cc1-515787864eee {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:54:58 devstack sudo[87183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a643ca1d-2042-492b-8498-a30b8740fd68.6486c404-4b48-4387-aa5b-f4eb1a990833 Apr 22 17:54:58 devstack sudo[87183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:54:58 devstack sudo[87184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-0d74caa9-aac0-4f82-8cc1-515787864eee Apr 22 17:54:58 devstack sudo[87184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:54:58 devstack sudo[87171]: pam_unix(sudo:session): session closed for user root Apr 22 17:54:58 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-29f58d7d-ea9c-45f6-8b96-d95f212a73f2 tempest-VolumesImageMetadata-1623522424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-3e0dbfb5-8ded-4fc0-ac6f-aec5893d1a52" returned: 0 in 1.372s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:54:58 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-29f58d7d-ea9c-45f6-8b96-d95f212a73f2 tempest-VolumesImageMetadata-1623522424 None] Lock "cinder-quobyte-3e0dbfb5-8ded-4fc0-ac6f-aec5893d1a52" released by "delete_volume" :: held 3.980s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:54:58 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-29f58d7d-ea9c-45f6-8b96-d95f212a73f2 tempest-VolumesImageMetadata-1623522424 None] Created reservations ['ebf142f9-3abe-4ad5-a9b3-e029d2cb7971', '666fde66-1364-42cd-a9c2-59b07ecc4a50', '4d810710-ccd0-4794-b419-c38007f5378c', '339b466a-c415-4287-accd-0660819a548d'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 17:54:58 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-29f58d7d-ea9c-45f6-8b96-d95f212a73f2 tempest-VolumesImageMetadata-1623522424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:54:58 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-29f58d7d-ea9c-45f6-8b96-d95f212a73f2 tempest-VolumesImageMetadata-1623522424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:54:58 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-29f58d7d-ea9c-45f6-8b96-d95f212a73f2 tempest-VolumesImageMetadata-1623522424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:54:58 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-29f58d7d-ea9c-45f6-8b96-d95f212a73f2 tempest-VolumesImageMetadata-1623522424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:54:58 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-29f58d7d-ea9c-45f6-8b96-d95f212a73f2 tempest-VolumesImageMetadata-1623522424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:54:58 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-29f58d7d-ea9c-45f6-8b96-d95f212a73f2 tempest-VolumesImageMetadata-1623522424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:54:58 devstack sudo[87188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 Apr 22 17:54:58 devstack sudo[87188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:54:58 devstack sudo[87176]: pam_unix(sudo:session): session closed for user root Apr 22 17:54:58 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-7df917e4-ffe2-4cbd-922c-75e9e8a4a464 tempest-VolumesListAdminTestJSON-2106952741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33" returned: 0 in 1.220s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:54:58 devstack cinder-volume[81771]: DEBUG cinder.manager [None req-7df917e4-ffe2-4cbd-922c-75e9e8a4a464 tempest-VolumesListAdminTestJSON-2106952741 None] Notifying Schedulers of capabilities ... {{(pid=81771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 17:54:58 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-7df917e4-ffe2-4cbd-922c-75e9e8a4a464 tempest-VolumesListAdminTestJSON-2106952741 None] Deleted volume successfully. Apr 22 17:54:58 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-7df917e4-ffe2-4cbd-922c-75e9e8a4a464 tempest-VolumesListAdminTestJSON-2106952741 None] Lock "cinder-e9a9b3b8-8b14-4a9f-914f-a9bd62815f8e-delete_volume" released by "delete_volume" :: held 3.799s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:54:59 devstack sudo[87175]: pam_unix(sudo:session): session closed for user root Apr 22 17:54:59 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-4634b2b9-8877-4892-81e2-ba9e85a071f6 tempest-VolumesListAdminTestJSON-1796033045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33" returned: 0 in 1.650s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:54:59 devstack cinder-volume[81771]: DEBUG cinder.manager [None req-4634b2b9-8877-4892-81e2-ba9e85a071f6 tempest-VolumesListAdminTestJSON-1796033045 None] Notifying Schedulers of capabilities ... {{(pid=81771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 17:54:59 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-4634b2b9-8877-4892-81e2-ba9e85a071f6 tempest-VolumesListAdminTestJSON-1796033045 None] Deleted volume successfully. Apr 22 17:54:59 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-4634b2b9-8877-4892-81e2-ba9e85a071f6 tempest-VolumesListAdminTestJSON-1796033045 None] Lock "cinder-d50337af-17b9-41e0-b31d-dcb4c8249347-delete_volume" released by "delete_volume" :: held 4.460s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:54:59 devstack sudo[87183]: pam_unix(sudo:session): session closed for user root Apr 22 17:54:59 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-c9e25ad8-5dda-42cf-9f44-cab8e4337011 tempest-GroupSnapshotsV319Test-1358098521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a643ca1d-2042-492b-8498-a30b8740fd68.6486c404-4b48-4387-aa5b-f4eb1a990833" returned: 0 in 0.964s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:54:59 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-c9e25ad8-5dda-42cf-9f44-cab8e4337011 tempest-GroupSnapshotsV319Test-1358098521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a643ca1d-2042-492b-8498-a30b8740fd68.info {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:54:59 devstack sudo[87193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a643ca1d-2042-492b-8498-a30b8740fd68.info Apr 22 17:54:59 devstack sudo[87193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:54:59 devstack sudo[87184]: pam_unix(sudo:session): session closed for user root Apr 22 17:54:59 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-a342899c-bab9-4f7d-9bf5-78c5656933f2 tempest-VolumesListAdminTestJSON-2106952741 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-0d74caa9-aac0-4f82-8cc1-515787864eee" returned: 0 in 1.353s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:54:59 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-a342899c-bab9-4f7d-9bf5-78c5656933f2 tempest-VolumesListAdminTestJSON-2106952741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-0d74caa9-aac0-4f82-8cc1-515787864eee {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:54:59 devstack sudo[87199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-0d74caa9-aac0-4f82-8cc1-515787864eee Apr 22 17:54:59 devstack sudo[87199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:54:59 devstack sudo[87188]: pam_unix(sudo:session): session closed for user root Apr 22 17:54:59 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-29f58d7d-ea9c-45f6-8b96-d95f212a73f2 tempest-VolumesImageMetadata-1623522424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33" returned: 0 in 1.073s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:54:59 devstack cinder-volume[81771]: DEBUG cinder.manager [None req-29f58d7d-ea9c-45f6-8b96-d95f212a73f2 tempest-VolumesImageMetadata-1623522424 None] Notifying Schedulers of capabilities ... {{(pid=81771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 17:54:59 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-29f58d7d-ea9c-45f6-8b96-d95f212a73f2 tempest-VolumesImageMetadata-1623522424 None] Deleted volume successfully. Apr 22 17:54:59 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-29f58d7d-ea9c-45f6-8b96-d95f212a73f2 tempest-VolumesImageMetadata-1623522424 None] Lock "cinder-3e0dbfb5-8ded-4fc0-ac6f-aec5893d1a52-delete_volume" released by "delete_volume" :: held 5.348s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:55:00 devstack sudo[87193]: pam_unix(sudo:session): session closed for user root Apr 22 17:55:00 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-c9e25ad8-5dda-42cf-9f44-cab8e4337011 tempest-GroupSnapshotsV319Test-1358098521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a643ca1d-2042-492b-8498-a30b8740fd68.info" returned: 0 in 1.075s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:55:00 devstack cinder-volume[81771]: WARNING cinder.volume.drivers.remotefs [None req-c9e25ad8-5dda-42cf-9f44-cab8e4337011 tempest-GroupSnapshotsV319Test-1358098521 None] /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a643ca1d-2042-492b-8498-a30b8740fd68.info is being set with open permissions: ugo+rw: NotImplementedError Apr 22 17:55:00 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-c9e25ad8-5dda-42cf-9f44-cab8e4337011 tempest-GroupSnapshotsV319Test-1358098521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a643ca1d-2042-492b-8498-a30b8740fd68.info {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:55:00 devstack sudo[87214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a643ca1d-2042-492b-8498-a30b8740fd68.info Apr 22 17:55:00 devstack sudo[87214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:55:00 devstack sudo[87199]: pam_unix(sudo:session): session closed for user root Apr 22 17:55:00 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-a342899c-bab9-4f7d-9bf5-78c5656933f2 tempest-VolumesListAdminTestJSON-2106952741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-0d74caa9-aac0-4f82-8cc1-515787864eee" returned: 0 in 1.123s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:55:00 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-a342899c-bab9-4f7d-9bf5-78c5656933f2 tempest-VolumesListAdminTestJSON-2106952741 None] Lock "cinder-quobyte-0d74caa9-aac0-4f82-8cc1-515787864eee" released by "delete_volume" :: held 2.521s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:55:00 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-a342899c-bab9-4f7d-9bf5-78c5656933f2 tempest-VolumesListAdminTestJSON-2106952741 None] Created reservations ['7ff8ac88-b2df-4669-9eed-ea95ce2597d7', 'a1d5829b-67fb-4ad5-9e94-f986579f3647', 'f4461ce5-f993-4388-8c05-ec9c31155835', '3c63c32f-9f2d-4955-a7dc-56aee3e3a3bb'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 17:55:00 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-a342899c-bab9-4f7d-9bf5-78c5656933f2 tempest-VolumesListAdminTestJSON-2106952741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:55:00 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-a342899c-bab9-4f7d-9bf5-78c5656933f2 tempest-VolumesListAdminTestJSON-2106952741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:55:00 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-a342899c-bab9-4f7d-9bf5-78c5656933f2 tempest-VolumesListAdminTestJSON-2106952741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:55:00 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-a342899c-bab9-4f7d-9bf5-78c5656933f2 tempest-VolumesListAdminTestJSON-2106952741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:55:00 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-a342899c-bab9-4f7d-9bf5-78c5656933f2 tempest-VolumesListAdminTestJSON-2106952741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:55:00 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-a342899c-bab9-4f7d-9bf5-78c5656933f2 tempest-VolumesListAdminTestJSON-2106952741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:55:01 devstack sudo[87380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 Apr 22 17:55:01 devstack sudo[87380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:55:01 devstack sudo[87214]: pam_unix(sudo:session): session closed for user root Apr 22 17:55:01 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-c9e25ad8-5dda-42cf-9f44-cab8e4337011 tempest-GroupSnapshotsV319Test-1358098521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a643ca1d-2042-492b-8498-a30b8740fd68.info" returned: 0 in 0.867s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:55:01 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-c9e25ad8-5dda-42cf-9f44-cab8e4337011 tempest-GroupSnapshotsV319Test-1358098521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.949s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:55:01 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-c9e25ad8-5dda-42cf-9f44-cab8e4337011 tempest-GroupSnapshotsV319Test-1358098521 None] group_snapshot 0d2b31c1-264a-4e01-87b7-fb8570abc9de: created successfully Apr 22 17:55:01 devstack sudo[87380]: pam_unix(sudo:session): session closed for user root Apr 22 17:55:01 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-a342899c-bab9-4f7d-9bf5-78c5656933f2 tempest-VolumesListAdminTestJSON-2106952741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33" returned: 0 in 0.565s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:55:01 devstack cinder-volume[81771]: DEBUG cinder.manager [None req-a342899c-bab9-4f7d-9bf5-78c5656933f2 tempest-VolumesListAdminTestJSON-2106952741 None] Notifying Schedulers of capabilities ... {{(pid=81771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 17:55:01 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-a342899c-bab9-4f7d-9bf5-78c5656933f2 tempest-VolumesListAdminTestJSON-2106952741 None] Deleted volume successfully. Apr 22 17:55:01 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-a342899c-bab9-4f7d-9bf5-78c5656933f2 tempest-VolumesListAdminTestJSON-2106952741 None] Lock "cinder-0d74caa9-aac0-4f82-8cc1-515787864eee-delete_volume" released by "delete_volume" :: held 3.612s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:55:01 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-7ec7065a-413a-4eb2-8d1f-ad0256f568b4 tempest-VolumesListAdminTestJSON-2106952741 None] Acquiring lock "cinder-4861db81-3409-4363-9456-04b5c8e95ca6-delete_volume" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:55:01 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-7ec7065a-413a-4eb2-8d1f-ad0256f568b4 tempest-VolumesListAdminTestJSON-2106952741 None] Lock "cinder-4861db81-3409-4363-9456-04b5c8e95ca6-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:55:01 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-7ec7065a-413a-4eb2-8d1f-ad0256f568b4 tempest-VolumesListAdminTestJSON-2106952741 None] Acquiring lock "cinder-quobyte-4861db81-3409-4363-9456-04b5c8e95ca6" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:55:01 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-7ec7065a-413a-4eb2-8d1f-ad0256f568b4 tempest-VolumesListAdminTestJSON-2106952741 None] Lock "cinder-quobyte-4861db81-3409-4363-9456-04b5c8e95ca6" acquired by "delete_volume" :: waited 0.018s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:55:01 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[d632d63b-9c92-45e2-a358-ce56fe3002b1]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:55:01 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-7ec7065a-413a-4eb2-8d1f-ad0256f568b4 tempest-VolumesListAdminTestJSON-2106952741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-4861db81-3409-4363-9456-04b5c8e95ca6 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:55:01 devstack sudo[87385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-4861db81-3409-4363-9456-04b5c8e95ca6 Apr 22 17:55:01 devstack sudo[87385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:55:02 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-39e02239-448d-4638-bf09-ae6a8283ddfd tempest-GroupSnapshotsV319Test-1358098521 None] group_snapshot 0d2b31c1-264a-4e01-87b7-fb8570abc9de: deleting Apr 22 17:55:02 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-39e02239-448d-4638-bf09-ae6a8283ddfd tempest-GroupSnapshotsV319Test-1358098521 None] group_snapshot 0d2b31c1-264a-4e01-87b7-fb8570abc9de: deleting {{(pid=81771) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 22 17:55:02 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-39e02239-448d-4638-bf09-ae6a8283ddfd tempest-GroupSnapshotsV319Test-1358098521 None] Acquiring lock "cinder-quobyte-a643ca1d-2042-492b-8498-a30b8740fd68" by "delete_snapshot" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:55:02 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-39e02239-448d-4638-bf09-ae6a8283ddfd tempest-GroupSnapshotsV319Test-1358098521 None] Lock "cinder-quobyte-a643ca1d-2042-492b-8498-a30b8740fd68" acquired by "delete_snapshot" :: waited 0.017s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:55:02 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-39e02239-448d-4638-bf09-ae6a8283ddfd tempest-GroupSnapshotsV319Test-1358098521 None] Acquiring lock "cinder-quobyte-6486c404-4b48-4387-aa5b-f4eb1a990833" by "_delete_snapshot" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:55:02 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-39e02239-448d-4638-bf09-ae6a8283ddfd tempest-GroupSnapshotsV319Test-1358098521 None] Lock "cinder-quobyte-6486c404-4b48-4387-aa5b-f4eb1a990833" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:55:02 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-39e02239-448d-4638-bf09-ae6a8283ddfd tempest-GroupSnapshotsV319Test-1358098521 None] Deleting offline snapshot 6486c404-4b48-4387-aa5b-f4eb1a990833 of volume a643ca1d-2042-492b-8498-a30b8740fd68 {{(pid=81771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 22 17:55:02 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-39e02239-448d-4638-bf09-ae6a8283ddfd tempest-GroupSnapshotsV319Test-1358098521 None] snapshot_file for this snap is: volume-a643ca1d-2042-492b-8498-a30b8740fd68.6486c404-4b48-4387-aa5b-f4eb1a990833 {{(pid=81771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 22 17:55:02 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc26c54e-0086-4371-a441-bf77752f0faf]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:55:02 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-39e02239-448d-4638-bf09-ae6a8283ddfd tempest-GroupSnapshotsV319Test-1358098521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a643ca1d-2042-492b-8498-a30b8740fd68.6486c404-4b48-4387-aa5b-f4eb1a990833 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:55:02 devstack sudo[87388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a643ca1d-2042-492b-8498-a30b8740fd68.6486c404-4b48-4387-aa5b-f4eb1a990833 Apr 22 17:55:02 devstack sudo[87388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:55:02 devstack sudo[87385]: pam_unix(sudo:session): session closed for user root Apr 22 17:55:02 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-7ec7065a-413a-4eb2-8d1f-ad0256f568b4 tempest-VolumesListAdminTestJSON-2106952741 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-4861db81-3409-4363-9456-04b5c8e95ca6" returned: 0 in 0.859s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:55:02 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-7ec7065a-413a-4eb2-8d1f-ad0256f568b4 tempest-VolumesListAdminTestJSON-2106952741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-4861db81-3409-4363-9456-04b5c8e95ca6 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:55:02 devstack sudo[87393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-4861db81-3409-4363-9456-04b5c8e95ca6 Apr 22 17:55:02 devstack sudo[87393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:55:03 devstack sudo[87388]: pam_unix(sudo:session): session closed for user root Apr 22 17:55:03 devstack cinder-volume[81771]: DEBUG cinder.volume.flows.manager.create_volume [None req-324a0225-565a-4b90-9366-fd4da971bcb2 tempest-VolumesSnapshotNegativeTestJSON-834288006 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 17:55:03 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-324a0225-565a-4b90-9366-fd4da971bcb2 tempest-VolumesSnapshotNegativeTestJSON-834288006 None] Flow 'volume_create_manager' (08067c1e-c8ce-4ab0-8b8a-a9da266fd97c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:55:03 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-324a0225-565a-4b90-9366-fd4da971bcb2 tempest-VolumesSnapshotNegativeTestJSON-834288006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81805493-1583-4da4-827d-394906fc1b16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:55:03 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-39e02239-448d-4638-bf09-ae6a8283ddfd tempest-GroupSnapshotsV319Test-1358098521 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a643ca1d-2042-492b-8498-a30b8740fd68.6486c404-4b48-4387-aa5b-f4eb1a990833" returned: 0 in 0.715s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:55:03 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-39e02239-448d-4638-bf09-ae6a8283ddfd tempest-GroupSnapshotsV319Test-1358098521 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a643ca1d-2042-492b-8498-a30b8740fd68(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81771) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 22 17:55:03 devstack sudo[87393]: pam_unix(sudo:session): session closed for user root Apr 22 17:55:03 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[49304cd4-d1d7-432c-9918-2ab222d8e497]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:55:03 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-39e02239-448d-4638-bf09-ae6a8283ddfd tempest-GroupSnapshotsV319Test-1358098521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a643ca1d-2042-492b-8498-a30b8740fd68 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:55:03 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-7ec7065a-413a-4eb2-8d1f-ad0256f568b4 tempest-VolumesListAdminTestJSON-2106952741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-4861db81-3409-4363-9456-04b5c8e95ca6" returned: 0 in 0.569s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:55:03 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-324a0225-565a-4b90-9366-fd4da971bcb2 tempest-VolumesSnapshotNegativeTestJSON-834288006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81805493-1583-4da4-827d-394906fc1b16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:55:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-965835184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad7c5bd6-cab5-46f1-bae5-272a80283761,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bee7a006cb84fa5a983171c481c7a79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:55:03Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:55:03Z,use_quota=True,user_id='de8e1cf750d6406db9fe25c0876a79af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:55:03 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-324a0225-565a-4b90-9366-fd4da971bcb2 tempest-VolumesSnapshotNegativeTestJSON-834288006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (476c6e4e-7931-4b03-a36e-de9f8ce17314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:55:03 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-324a0225-565a-4b90-9366-fd4da971bcb2 tempest-VolumesSnapshotNegativeTestJSON-834288006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (476c6e4e-7931-4b03-a36e-de9f8ce17314) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:55:03 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-324a0225-565a-4b90-9366-fd4da971bcb2 tempest-VolumesSnapshotNegativeTestJSON-834288006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (043369ec-5266-44ad-b4f3-3893b6a32295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:55:03 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-324a0225-565a-4b90-9366-fd4da971bcb2 tempest-VolumesSnapshotNegativeTestJSON-834288006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (043369ec-5266-44ad-b4f3-3893b6a32295) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad7c5bd6-cab5-46f1-bae5-272a80283761', 'volume_name': 'volume-ad7c5bd6-cab5-46f1-bae5-272a80283761', 'volume_size': 2}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:55:03 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-324a0225-565a-4b90-9366-fd4da971bcb2 tempest-VolumesSnapshotNegativeTestJSON-834288006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c529e01c-7df9-4efc-baf7-9aa1bf341e71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:55:03 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-324a0225-565a-4b90-9366-fd4da971bcb2 tempest-VolumesSnapshotNegativeTestJSON-834288006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c529e01c-7df9-4efc-baf7-9aa1bf341e71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:55:03 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-324a0225-565a-4b90-9366-fd4da971bcb2 tempest-VolumesSnapshotNegativeTestJSON-834288006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7279b6b-fe18-4f53-8155-ab4bd347600e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:55:03 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-324a0225-565a-4b90-9366-fd4da971bcb2 tempest-VolumesSnapshotNegativeTestJSON-834288006 None] Volume ad7c5bd6-cab5-46f1-bae5-272a80283761: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad7c5bd6-cab5-46f1-bae5-272a80283761', 'volume_size': 2} Apr 22 17:55:03 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-324a0225-565a-4b90-9366-fd4da971bcb2 tempest-VolumesSnapshotNegativeTestJSON-834288006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:55:03 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-324a0225-565a-4b90-9366-fd4da971bcb2 tempest-VolumesSnapshotNegativeTestJSON-834288006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:55:03 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-324a0225-565a-4b90-9366-fd4da971bcb2 tempest-VolumesSnapshotNegativeTestJSON-834288006 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:55:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-965835184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad7c5bd6-cab5-46f1-bae5-272a80283761,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bee7a006cb84fa5a983171c481c7a79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:55:03Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:55:03Z,use_quota=True,user_id='de8e1cf750d6406db9fe25c0876a79af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)}" {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 17:55:03 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-324a0225-565a-4b90-9366-fd4da971bcb2 tempest-VolumesSnapshotNegativeTestJSON-834288006 None] Creating volume ad7c5bd6-cab5-46f1-bae5-272a80283761 {{(pid=81771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 17:55:03 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-324a0225-565a-4b90-9366-fd4da971bcb2 tempest-VolumesSnapshotNegativeTestJSON-834288006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:55:03 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-324a0225-565a-4b90-9366-fd4da971bcb2 tempest-VolumesSnapshotNegativeTestJSON-834288006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:55:03 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-324a0225-565a-4b90-9366-fd4da971bcb2 tempest-VolumesSnapshotNegativeTestJSON-834288006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:55:03 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-324a0225-565a-4b90-9366-fd4da971bcb2 tempest-VolumesSnapshotNegativeTestJSON-834288006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:55:03 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-324a0225-565a-4b90-9366-fd4da971bcb2 tempest-VolumesSnapshotNegativeTestJSON-834288006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:55:03 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-324a0225-565a-4b90-9366-fd4da971bcb2 tempest-VolumesSnapshotNegativeTestJSON-834288006 None] Selected osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 as target Quobyte volume. {{(pid=81771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 17:55:03 devstack cinder-volume[81771]: INFO cinder.volume.drivers.remotefs [None req-324a0225-565a-4b90-9366-fd4da971bcb2 tempest-VolumesSnapshotNegativeTestJSON-834288006 None] casted to osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 Apr 22 17:55:03 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-324a0225-565a-4b90-9366-fd4da971bcb2 tempest-VolumesSnapshotNegativeTestJSON-834288006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-ad7c5bd6-cab5-46f1-bae5-272a80283761 2147483648 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:55:03 devstack sudo[87399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a643ca1d-2042-492b-8498-a30b8740fd68 Apr 22 17:55:03 devstack sudo[87399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:55:03 devstack sudo[87400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-ad7c5bd6-cab5-46f1-bae5-272a80283761 2147483648 Apr 22 17:55:03 devstack sudo[87400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:55:03 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-7ec7065a-413a-4eb2-8d1f-ad0256f568b4 tempest-VolumesListAdminTestJSON-2106952741 None] Lock "cinder-quobyte-4861db81-3409-4363-9456-04b5c8e95ca6" released by "delete_volume" :: held 1.553s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:55:03 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-7ec7065a-413a-4eb2-8d1f-ad0256f568b4 tempest-VolumesListAdminTestJSON-2106952741 None] Created reservations ['b4a73463-a36d-4fa6-b942-1b1d60a975b3', '89709d7d-2824-4b14-9cec-ac36b7090445', '8b24ca79-9abf-4ef6-b2e2-80c3dd716d77', '11cdb21f-4ef9-4769-91c4-2fa1b7ff8697'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 17:55:03 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-7ec7065a-413a-4eb2-8d1f-ad0256f568b4 tempest-VolumesListAdminTestJSON-2106952741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:55:03 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-7ec7065a-413a-4eb2-8d1f-ad0256f568b4 tempest-VolumesListAdminTestJSON-2106952741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:55:03 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-7ec7065a-413a-4eb2-8d1f-ad0256f568b4 tempest-VolumesListAdminTestJSON-2106952741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:55:03 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-7ec7065a-413a-4eb2-8d1f-ad0256f568b4 tempest-VolumesListAdminTestJSON-2106952741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:55:03 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-7ec7065a-413a-4eb2-8d1f-ad0256f568b4 tempest-VolumesListAdminTestJSON-2106952741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:55:03 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-7ec7065a-413a-4eb2-8d1f-ad0256f568b4 tempest-VolumesListAdminTestJSON-2106952741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:55:03 devstack sudo[87403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 Apr 22 17:55:03 devstack sudo[87403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:55:03 devstack sudo[87399]: pam_unix(sudo:session): session closed for user root Apr 22 17:55:03 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-39e02239-448d-4638-bf09-ae6a8283ddfd tempest-GroupSnapshotsV319Test-1358098521 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a643ca1d-2042-492b-8498-a30b8740fd68" returned: 0 in 0.674s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:55:03 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-39e02239-448d-4638-bf09-ae6a8283ddfd tempest-GroupSnapshotsV319Test-1358098521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a643ca1d-2042-492b-8498-a30b8740fd68.6486c404-4b48-4387-aa5b-f4eb1a990833 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:55:03 devstack sudo[87412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a643ca1d-2042-492b-8498-a30b8740fd68.6486c404-4b48-4387-aa5b-f4eb1a990833 Apr 22 17:55:03 devstack sudo[87412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:55:03 devstack sudo[87403]: pam_unix(sudo:session): session closed for user root Apr 22 17:55:03 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-7ec7065a-413a-4eb2-8d1f-ad0256f568b4 tempest-VolumesListAdminTestJSON-2106952741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33" returned: 0 in 0.548s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:55:03 devstack cinder-volume[81771]: DEBUG cinder.manager [None req-7ec7065a-413a-4eb2-8d1f-ad0256f568b4 tempest-VolumesListAdminTestJSON-2106952741 None] Notifying Schedulers of capabilities ... {{(pid=81771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 17:55:03 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-7ec7065a-413a-4eb2-8d1f-ad0256f568b4 tempest-VolumesListAdminTestJSON-2106952741 None] Deleted volume successfully. Apr 22 17:55:03 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-7ec7065a-413a-4eb2-8d1f-ad0256f568b4 tempest-VolumesListAdminTestJSON-2106952741 None] Lock "cinder-4861db81-3409-4363-9456-04b5c8e95ca6-delete_volume" released by "delete_volume" :: held 2.308s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:55:04 devstack sudo[87400]: pam_unix(sudo:session): session closed for user root Apr 22 17:55:04 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-324a0225-565a-4b90-9366-fd4da971bcb2 tempest-VolumesSnapshotNegativeTestJSON-834288006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-ad7c5bd6-cab5-46f1-bae5-272a80283761 2147483648" returned: 0 in 0.810s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:55:04 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-324a0225-565a-4b90-9366-fd4da971bcb2 tempest-VolumesSnapshotNegativeTestJSON-834288006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-ad7c5bd6-cab5-46f1-bae5-272a80283761 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:55:04 devstack sudo[87414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-ad7c5bd6-cab5-46f1-bae5-272a80283761 Apr 22 17:55:04 devstack sudo[87414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:55:04 devstack sudo[87412]: pam_unix(sudo:session): session closed for user root Apr 22 17:55:04 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-39e02239-448d-4638-bf09-ae6a8283ddfd tempest-GroupSnapshotsV319Test-1358098521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a643ca1d-2042-492b-8498-a30b8740fd68.6486c404-4b48-4387-aa5b-f4eb1a990833" returned: 0 in 0.737s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:55:04 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-39e02239-448d-4638-bf09-ae6a8283ddfd tempest-GroupSnapshotsV319Test-1358098521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a643ca1d-2042-492b-8498-a30b8740fd68.6486c404-4b48-4387-aa5b-f4eb1a990833 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:55:04 devstack sudo[87419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a643ca1d-2042-492b-8498-a30b8740fd68.6486c404-4b48-4387-aa5b-f4eb1a990833 Apr 22 17:55:04 devstack sudo[87419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:55:04 devstack sudo[87414]: pam_unix(sudo:session): session closed for user root Apr 22 17:55:04 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-324a0225-565a-4b90-9366-fd4da971bcb2 tempest-VolumesSnapshotNegativeTestJSON-834288006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-ad7c5bd6-cab5-46f1-bae5-272a80283761" returned: 0 in 0.628s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:55:04 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-324a0225-565a-4b90-9366-fd4da971bcb2 tempest-VolumesSnapshotNegativeTestJSON-834288006 None] <== create_volume: return (1499ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'} {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 17:55:04 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-324a0225-565a-4b90-9366-fd4da971bcb2 tempest-VolumesSnapshotNegativeTestJSON-834288006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.502s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:55:04 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-324a0225-565a-4b90-9366-fd4da971bcb2 tempest-VolumesSnapshotNegativeTestJSON-834288006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7279b6b-fe18-4f53-8155-ab4bd347600e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad7c5bd6-cab5-46f1-bae5-272a80283761', 'volume_size': 2}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:55:04 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-324a0225-565a-4b90-9366-fd4da971bcb2 tempest-VolumesSnapshotNegativeTestJSON-834288006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50980a51-04a7-4eee-b180-fc7c249ff56a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:55:04 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-324a0225-565a-4b90-9366-fd4da971bcb2 tempest-VolumesSnapshotNegativeTestJSON-834288006 None] Volume volume-ad7c5bd6-cab5-46f1-bae5-272a80283761 (ad7c5bd6-cab5-46f1-bae5-272a80283761): created successfully Apr 22 17:55:04 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-324a0225-565a-4b90-9366-fd4da971bcb2 tempest-VolumesSnapshotNegativeTestJSON-834288006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50980a51-04a7-4eee-b180-fc7c249ff56a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:55:04 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-324a0225-565a-4b90-9366-fd4da971bcb2 tempest-VolumesSnapshotNegativeTestJSON-834288006 None] Flow 'volume_create_manager' (08067c1e-c8ce-4ab0-8b8a-a9da266fd97c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:55:04 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-324a0225-565a-4b90-9366-fd4da971bcb2 tempest-VolumesSnapshotNegativeTestJSON-834288006 None] Created volume successfully. Apr 22 17:55:05 devstack sudo[87419]: pam_unix(sudo:session): session closed for user root Apr 22 17:55:05 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-39e02239-448d-4638-bf09-ae6a8283ddfd tempest-GroupSnapshotsV319Test-1358098521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a643ca1d-2042-492b-8498-a30b8740fd68.6486c404-4b48-4387-aa5b-f4eb1a990833" returned: 0 in 0.501s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:55:05 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-39e02239-448d-4638-bf09-ae6a8283ddfd tempest-GroupSnapshotsV319Test-1358098521 None] Lock "cinder-quobyte-6486c404-4b48-4387-aa5b-f4eb1a990833" released by "_delete_snapshot" :: held 2.742s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:55:05 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-39e02239-448d-4638-bf09-ae6a8283ddfd tempest-GroupSnapshotsV319Test-1358098521 None] Lock "cinder-quobyte-a643ca1d-2042-492b-8498-a30b8740fd68" released by "delete_snapshot" :: held 2.775s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:55:05 devstack cinder-volume[81771]: WARNING cinder.quota [None req-39e02239-448d-4638-bf09-ae6a8283ddfd tempest-GroupSnapshotsV319Test-1358098521 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-813646738 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-813646738, it is now deprecated. Please use the default quota class for default quota. Apr 22 17:55:05 devstack cinder-volume[81771]: WARNING cinder.quota [None req-39e02239-448d-4638-bf09-ae6a8283ddfd tempest-GroupSnapshotsV319Test-1358098521 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-813646738 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-813646738, it is now deprecated. Please use the default quota class for default quota. Apr 22 17:55:05 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-39e02239-448d-4638-bf09-ae6a8283ddfd tempest-GroupSnapshotsV319Test-1358098521 None] Created reservations ['a8c8e7ee-8833-41f9-881e-9b0e9c5de107', '6a55c842-3c6b-4a60-8d88-1540d4cc96d7', '72da16c0-8b18-451d-a8b2-03f34fa46761', '18d6cda2-39a2-4afb-b550-cbb5c7523779'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 17:55:05 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-39e02239-448d-4638-bf09-ae6a8283ddfd tempest-GroupSnapshotsV319Test-1358098521 None] group_snapshot 0d2b31c1-264a-4e01-87b7-fb8570abc9de: deleted successfully Apr 22 17:55:05 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-85a1f8ba-b064-4d5d-a1ec-e3e36f1810b0 tempest-VolumesSnapshotNegativeTestJSON-834288006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:55:05 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-85a1f8ba-b064-4d5d-a1ec-e3e36f1810b0 tempest-VolumesSnapshotNegativeTestJSON-834288006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:55:05 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-85a1f8ba-b064-4d5d-a1ec-e3e36f1810b0 tempest-VolumesSnapshotNegativeTestJSON-834288006 None] Creating offline snapshot 0a220976-bbb1-4710-9684-c8eb8e3280d0 of volume ad7c5bd6-cab5-46f1-bae5-272a80283761 {{(pid=81771) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 22 17:55:05 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8572312-b8f7-4ca1-8ecf-72baa6d47d49]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:55:05 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-85a1f8ba-b064-4d5d-a1ec-e3e36f1810b0 tempest-VolumesSnapshotNegativeTestJSON-834288006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-ad7c5bd6-cab5-46f1-bae5-272a80283761 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:55:05 devstack sudo[87423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-ad7c5bd6-cab5-46f1-bae5-272a80283761 Apr 22 17:55:05 devstack sudo[87423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:55:05 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-602040a8-280c-404f-b4d7-10bdcd7d4197 tempest-GroupSnapshotsV319Test-1358098521 None] Acquiring lock "cinder-quobyte-a643ca1d-2042-492b-8498-a30b8740fd68" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:55:06 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-602040a8-280c-404f-b4d7-10bdcd7d4197 tempest-GroupSnapshotsV319Test-1358098521 None] Lock "cinder-quobyte-a643ca1d-2042-492b-8498-a30b8740fd68" acquired by "delete_volume" :: waited 0.072s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:55:06 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[6218da7f-5aae-4e89-97fd-f175e27ee678]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:55:06 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-602040a8-280c-404f-b4d7-10bdcd7d4197 tempest-GroupSnapshotsV319Test-1358098521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a643ca1d-2042-492b-8498-a30b8740fd68 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:55:06 devstack sudo[87425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a643ca1d-2042-492b-8498-a30b8740fd68 Apr 22 17:55:06 devstack sudo[87425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:55:06 devstack sudo[87423]: pam_unix(sudo:session): session closed for user root Apr 22 17:55:06 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-85a1f8ba-b064-4d5d-a1ec-e3e36f1810b0 tempest-VolumesSnapshotNegativeTestJSON-834288006 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-ad7c5bd6-cab5-46f1-bae5-272a80283761" returned: 0 in 0.799s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:55:06 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-85a1f8ba-b064-4d5d-a1ec-e3e36f1810b0 tempest-VolumesSnapshotNegativeTestJSON-834288006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-ad7c5bd6-cab5-46f1-bae5-272a80283761,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-ad7c5bd6-cab5-46f1-bae5-272a80283761.0a220976-bbb1-4710-9684-c8eb8e3280d0 2G {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:55:06 devstack sudo[87430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-ad7c5bd6-cab5-46f1-bae5-272a80283761,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-ad7c5bd6-cab5-46f1-bae5-272a80283761.0a220976-bbb1-4710-9684-c8eb8e3280d0 2G Apr 22 17:55:06 devstack sudo[87430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:55:06 devstack sudo[87425]: pam_unix(sudo:session): session closed for user root Apr 22 17:55:06 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-602040a8-280c-404f-b4d7-10bdcd7d4197 tempest-GroupSnapshotsV319Test-1358098521 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a643ca1d-2042-492b-8498-a30b8740fd68" returned: 0 in 0.822s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:55:06 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-602040a8-280c-404f-b4d7-10bdcd7d4197 tempest-GroupSnapshotsV319Test-1358098521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a643ca1d-2042-492b-8498-a30b8740fd68 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:55:06 devstack sudo[87438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a643ca1d-2042-492b-8498-a30b8740fd68 Apr 22 17:55:06 devstack sudo[87438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:55:07 devstack sudo[87430]: pam_unix(sudo:session): session closed for user root Apr 22 17:55:07 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-85a1f8ba-b064-4d5d-a1ec-e3e36f1810b0 tempest-VolumesSnapshotNegativeTestJSON-834288006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-ad7c5bd6-cab5-46f1-bae5-272a80283761,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-ad7c5bd6-cab5-46f1-bae5-272a80283761.0a220976-bbb1-4710-9684-c8eb8e3280d0 2G" returned: 0 in 0.880s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:55:07 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-85a1f8ba-b064-4d5d-a1ec-e3e36f1810b0 tempest-VolumesSnapshotNegativeTestJSON-834288006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad7c5bd6-cab5-46f1-bae5-272a80283761 -F qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-ad7c5bd6-cab5-46f1-bae5-272a80283761.0a220976-bbb1-4710-9684-c8eb8e3280d0 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:55:07 devstack sudo[87444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad7c5bd6-cab5-46f1-bae5-272a80283761 -F qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-ad7c5bd6-cab5-46f1-bae5-272a80283761.0a220976-bbb1-4710-9684-c8eb8e3280d0 Apr 22 17:55:07 devstack sudo[87444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:55:07 devstack sudo[87438]: pam_unix(sudo:session): session closed for user root Apr 22 17:55:07 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-602040a8-280c-404f-b4d7-10bdcd7d4197 tempest-GroupSnapshotsV319Test-1358098521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a643ca1d-2042-492b-8498-a30b8740fd68" returned: 0 in 0.679s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:55:07 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-602040a8-280c-404f-b4d7-10bdcd7d4197 tempest-GroupSnapshotsV319Test-1358098521 None] Lock "cinder-quobyte-a643ca1d-2042-492b-8498-a30b8740fd68" released by "delete_volume" :: held 1.576s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:55:07 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-602040a8-280c-404f-b4d7-10bdcd7d4197 tempest-GroupSnapshotsV319Test-1358098521 None] Created reservations ['6800c663-f375-4780-a790-81a8cb70b531'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 17:55:07 devstack cinder-volume[81771]: WARNING cinder.quota [None req-602040a8-280c-404f-b4d7-10bdcd7d4197 tempest-GroupSnapshotsV319Test-1358098521 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-813646738 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-813646738, it is now deprecated. Please use the default quota class for default quota. Apr 22 17:55:07 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-602040a8-280c-404f-b4d7-10bdcd7d4197 tempest-GroupSnapshotsV319Test-1358098521 None] Created reservations ['80e04c24-e489-4f2b-881c-cb70de3079df', 'b37d522d-fc35-4575-a1ad-a8b2cc7bf02c', 'ab13de8b-5193-4ed3-a7da-83fc10531222', '2ca7dd8b-9da1-46fd-89a5-a0cd1d4ba2dd'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 17:55:07 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-602040a8-280c-404f-b4d7-10bdcd7d4197 tempest-GroupSnapshotsV319Test-1358098521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:55:07 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-602040a8-280c-404f-b4d7-10bdcd7d4197 tempest-GroupSnapshotsV319Test-1358098521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:55:07 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-602040a8-280c-404f-b4d7-10bdcd7d4197 tempest-GroupSnapshotsV319Test-1358098521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:55:07 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-602040a8-280c-404f-b4d7-10bdcd7d4197 tempest-GroupSnapshotsV319Test-1358098521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:55:07 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-602040a8-280c-404f-b4d7-10bdcd7d4197 tempest-GroupSnapshotsV319Test-1358098521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:55:07 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-602040a8-280c-404f-b4d7-10bdcd7d4197 tempest-GroupSnapshotsV319Test-1358098521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:55:07 devstack sudo[87451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 Apr 22 17:55:07 devstack sudo[87451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:55:08 devstack sudo[87444]: pam_unix(sudo:session): session closed for user root Apr 22 17:55:08 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-85a1f8ba-b064-4d5d-a1ec-e3e36f1810b0 tempest-VolumesSnapshotNegativeTestJSON-834288006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad7c5bd6-cab5-46f1-bae5-272a80283761 -F qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-ad7c5bd6-cab5-46f1-bae5-272a80283761.0a220976-bbb1-4710-9684-c8eb8e3280d0" returned: 0 in 0.724s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:55:08 devstack cinder-volume[81771]: WARNING cinder.volume.drivers.remotefs [None req-85a1f8ba-b064-4d5d-a1ec-e3e36f1810b0 tempest-VolumesSnapshotNegativeTestJSON-834288006 None] /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-ad7c5bd6-cab5-46f1-bae5-272a80283761.0a220976-bbb1-4710-9684-c8eb8e3280d0 is being set with open permissions: ugo+rw Apr 22 17:55:08 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-85a1f8ba-b064-4d5d-a1ec-e3e36f1810b0 tempest-VolumesSnapshotNegativeTestJSON-834288006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-ad7c5bd6-cab5-46f1-bae5-272a80283761.0a220976-bbb1-4710-9684-c8eb8e3280d0 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:55:08 devstack sudo[87453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-ad7c5bd6-cab5-46f1-bae5-272a80283761.0a220976-bbb1-4710-9684-c8eb8e3280d0 Apr 22 17:55:08 devstack sudo[87453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:55:08 devstack sudo[87451]: pam_unix(sudo:session): session closed for user root Apr 22 17:55:08 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-602040a8-280c-404f-b4d7-10bdcd7d4197 tempest-GroupSnapshotsV319Test-1358098521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33" returned: 0 in 0.754s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:55:08 devstack cinder-volume[81771]: DEBUG cinder.manager [None req-602040a8-280c-404f-b4d7-10bdcd7d4197 tempest-GroupSnapshotsV319Test-1358098521 None] Notifying Schedulers of capabilities ... {{(pid=81771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 17:55:08 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-602040a8-280c-404f-b4d7-10bdcd7d4197 tempest-GroupSnapshotsV319Test-1358098521 None] Delete group completed successfully. Apr 22 17:55:08 devstack sudo[87453]: pam_unix(sudo:session): session closed for user root Apr 22 17:55:08 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-85a1f8ba-b064-4d5d-a1ec-e3e36f1810b0 tempest-VolumesSnapshotNegativeTestJSON-834288006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-ad7c5bd6-cab5-46f1-bae5-272a80283761.0a220976-bbb1-4710-9684-c8eb8e3280d0" returned: 0 in 0.666s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:55:08 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-85a1f8ba-b064-4d5d-a1ec-e3e36f1810b0 tempest-VolumesSnapshotNegativeTestJSON-834288006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-ad7c5bd6-cab5-46f1-bae5-272a80283761.info {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:55:08 devstack sudo[87457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-ad7c5bd6-cab5-46f1-bae5-272a80283761.info Apr 22 17:55:08 devstack sudo[87457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:55:09 devstack sudo[87457]: pam_unix(sudo:session): session closed for user root Apr 22 17:55:09 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-85a1f8ba-b064-4d5d-a1ec-e3e36f1810b0 tempest-VolumesSnapshotNegativeTestJSON-834288006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-ad7c5bd6-cab5-46f1-bae5-272a80283761.info" returned: 0 in 0.655s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:55:09 devstack cinder-volume[81771]: WARNING cinder.volume.drivers.remotefs [None req-85a1f8ba-b064-4d5d-a1ec-e3e36f1810b0 tempest-VolumesSnapshotNegativeTestJSON-834288006 None] /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-ad7c5bd6-cab5-46f1-bae5-272a80283761.info is being set with open permissions: ugo+rw Apr 22 17:55:09 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-85a1f8ba-b064-4d5d-a1ec-e3e36f1810b0 tempest-VolumesSnapshotNegativeTestJSON-834288006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-ad7c5bd6-cab5-46f1-bae5-272a80283761.info {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:55:09 devstack sudo[87460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-ad7c5bd6-cab5-46f1-bae5-272a80283761.info Apr 22 17:55:09 devstack sudo[87460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:55:10 devstack sudo[87460]: pam_unix(sudo:session): session closed for user root Apr 22 17:55:10 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-85a1f8ba-b064-4d5d-a1ec-e3e36f1810b0 tempest-VolumesSnapshotNegativeTestJSON-834288006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-ad7c5bd6-cab5-46f1-bae5-272a80283761.info" returned: 0 in 0.636s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:55:10 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-85a1f8ba-b064-4d5d-a1ec-e3e36f1810b0 tempest-VolumesSnapshotNegativeTestJSON-834288006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.500s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:55:10 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-85a1f8ba-b064-4d5d-a1ec-e3e36f1810b0 tempest-VolumesSnapshotNegativeTestJSON-834288006 None] Create snapshot completed successfully Apr 22 17:55:10 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-8506cc74-0023-4944-8572-c40f47bb4c73 tempest-VolumesSnapshotNegativeTestJSON-834288006 None] Acquiring lock "cinder-0a220976-bbb1-4710-9684-c8eb8e3280d0-delete_snapshot" by "delete_snapshot" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:55:10 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-8506cc74-0023-4944-8572-c40f47bb4c73 tempest-VolumesSnapshotNegativeTestJSON-834288006 None] Lock "cinder-0a220976-bbb1-4710-9684-c8eb8e3280d0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:55:10 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-8506cc74-0023-4944-8572-c40f47bb4c73 tempest-VolumesSnapshotNegativeTestJSON-834288006 None] Acquiring lock "cinder-quobyte-ad7c5bd6-cab5-46f1-bae5-272a80283761" by "delete_snapshot" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:55:10 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-8506cc74-0023-4944-8572-c40f47bb4c73 tempest-VolumesSnapshotNegativeTestJSON-834288006 None] Lock "cinder-quobyte-ad7c5bd6-cab5-46f1-bae5-272a80283761" acquired by "delete_snapshot" :: waited 0.015s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:55:10 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-8506cc74-0023-4944-8572-c40f47bb4c73 tempest-VolumesSnapshotNegativeTestJSON-834288006 None] Acquiring lock "cinder-quobyte-0a220976-bbb1-4710-9684-c8eb8e3280d0" by "_delete_snapshot" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:55:11 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-8506cc74-0023-4944-8572-c40f47bb4c73 tempest-VolumesSnapshotNegativeTestJSON-834288006 None] Lock "cinder-quobyte-0a220976-bbb1-4710-9684-c8eb8e3280d0" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:55:11 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-8506cc74-0023-4944-8572-c40f47bb4c73 tempest-VolumesSnapshotNegativeTestJSON-834288006 None] Deleting offline snapshot 0a220976-bbb1-4710-9684-c8eb8e3280d0 of volume ad7c5bd6-cab5-46f1-bae5-272a80283761 {{(pid=81771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 22 17:55:11 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-8506cc74-0023-4944-8572-c40f47bb4c73 tempest-VolumesSnapshotNegativeTestJSON-834288006 None] snapshot_file for this snap is: volume-ad7c5bd6-cab5-46f1-bae5-272a80283761.0a220976-bbb1-4710-9684-c8eb8e3280d0 {{(pid=81771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 22 17:55:11 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d1df661-eacf-4913-9276-56c6dffac4d7]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:55:11 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-8506cc74-0023-4944-8572-c40f47bb4c73 tempest-VolumesSnapshotNegativeTestJSON-834288006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-ad7c5bd6-cab5-46f1-bae5-272a80283761.0a220976-bbb1-4710-9684-c8eb8e3280d0 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:55:11 devstack sudo[87549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-ad7c5bd6-cab5-46f1-bae5-272a80283761.0a220976-bbb1-4710-9684-c8eb8e3280d0 Apr 22 17:55:11 devstack sudo[87549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:55:11 devstack sudo[87549]: pam_unix(sudo:session): session closed for user root Apr 22 17:55:11 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-8506cc74-0023-4944-8572-c40f47bb4c73 tempest-VolumesSnapshotNegativeTestJSON-834288006 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-ad7c5bd6-cab5-46f1-bae5-272a80283761.0a220976-bbb1-4710-9684-c8eb8e3280d0" returned: 0 in 0.719s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:55:11 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-8506cc74-0023-4944-8572-c40f47bb4c73 tempest-VolumesSnapshotNegativeTestJSON-834288006 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ad7c5bd6-cab5-46f1-bae5-272a80283761(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81771) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 22 17:55:11 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[6db24dc4-f93e-410c-a0ac-628b0063ca0a]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:55:11 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-8506cc74-0023-4944-8572-c40f47bb4c73 tempest-VolumesSnapshotNegativeTestJSON-834288006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-ad7c5bd6-cab5-46f1-bae5-272a80283761 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:55:11 devstack sudo[87554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-ad7c5bd6-cab5-46f1-bae5-272a80283761 Apr 22 17:55:11 devstack sudo[87554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:55:12 devstack sudo[87554]: pam_unix(sudo:session): session closed for user root Apr 22 17:55:12 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-8506cc74-0023-4944-8572-c40f47bb4c73 tempest-VolumesSnapshotNegativeTestJSON-834288006 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-ad7c5bd6-cab5-46f1-bae5-272a80283761" returned: 0 in 0.798s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:55:12 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-8506cc74-0023-4944-8572-c40f47bb4c73 tempest-VolumesSnapshotNegativeTestJSON-834288006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-ad7c5bd6-cab5-46f1-bae5-272a80283761.0a220976-bbb1-4710-9684-c8eb8e3280d0 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:55:12 devstack sudo[87559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-ad7c5bd6-cab5-46f1-bae5-272a80283761.0a220976-bbb1-4710-9684-c8eb8e3280d0 Apr 22 17:55:12 devstack sudo[87559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:55:13 devstack sudo[87559]: pam_unix(sudo:session): session closed for user root Apr 22 17:55:13 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-8506cc74-0023-4944-8572-c40f47bb4c73 tempest-VolumesSnapshotNegativeTestJSON-834288006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-ad7c5bd6-cab5-46f1-bae5-272a80283761.0a220976-bbb1-4710-9684-c8eb8e3280d0" returned: 0 in 0.834s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:55:13 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-8506cc74-0023-4944-8572-c40f47bb4c73 tempest-VolumesSnapshotNegativeTestJSON-834288006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-ad7c5bd6-cab5-46f1-bae5-272a80283761.0a220976-bbb1-4710-9684-c8eb8e3280d0 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:55:13 devstack sudo[87565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-ad7c5bd6-cab5-46f1-bae5-272a80283761.0a220976-bbb1-4710-9684-c8eb8e3280d0 Apr 22 17:55:13 devstack sudo[87565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:55:14 devstack sudo[87565]: pam_unix(sudo:session): session closed for user root Apr 22 17:55:14 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-8506cc74-0023-4944-8572-c40f47bb4c73 tempest-VolumesSnapshotNegativeTestJSON-834288006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-ad7c5bd6-cab5-46f1-bae5-272a80283761.0a220976-bbb1-4710-9684-c8eb8e3280d0" returned: 0 in 0.670s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:55:14 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-8506cc74-0023-4944-8572-c40f47bb4c73 tempest-VolumesSnapshotNegativeTestJSON-834288006 None] Lock "cinder-quobyte-0a220976-bbb1-4710-9684-c8eb8e3280d0" released by "_delete_snapshot" :: held 3.182s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:55:14 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-8506cc74-0023-4944-8572-c40f47bb4c73 tempest-VolumesSnapshotNegativeTestJSON-834288006 None] Lock "cinder-quobyte-ad7c5bd6-cab5-46f1-bae5-272a80283761" released by "delete_snapshot" :: held 3.215s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:55:14 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-8506cc74-0023-4944-8572-c40f47bb4c73 tempest-VolumesSnapshotNegativeTestJSON-834288006 None] Created reservations ['5d69a5a3-25f1-468e-9191-2d433bf6dfd7', 'e99be477-86c0-4227-843a-e7ff61d25b56', '9985bcc8-706a-4876-8d9a-507a9865515e', '64bfc647-f1a1-4f97-a6b6-c9838ab8e9fb'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 17:55:14 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-8506cc74-0023-4944-8572-c40f47bb4c73 tempest-VolumesSnapshotNegativeTestJSON-834288006 None] Delete snapshot completed successfully. Apr 22 17:55:14 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-8506cc74-0023-4944-8572-c40f47bb4c73 tempest-VolumesSnapshotNegativeTestJSON-834288006 None] Lock "cinder-0a220976-bbb1-4710-9684-c8eb8e3280d0-delete_snapshot" released by "delete_snapshot" :: held 3.419s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:55:14 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-fce04e07-14dc-4cc5-9020-6da337b348bb tempest-GroupsTest-1625537742 None] Group tempest-Group1-245792415: creating Apr 22 17:55:14 devstack cinder-volume[81771]: DEBUG cinder.volume.flows.manager.create_volume [None req-01dd474a-cd40-4d01-a304-8d80a6de38b2 tempest-VolumesDeleteCascade-308204417 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 17:55:14 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-01dd474a-cd40-4d01-a304-8d80a6de38b2 tempest-VolumesDeleteCascade-308204417 None] Flow 'volume_create_manager' (da819d85-8826-4236-8931-36f39eb29bde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:55:14 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-01dd474a-cd40-4d01-a304-8d80a6de38b2 tempest-VolumesDeleteCascade-308204417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44224f6e-0bbd-4be7-a57e-dafb72f9fda0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:55:14 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-01dd474a-cd40-4d01-a304-8d80a6de38b2 tempest-VolumesDeleteCascade-308204417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44224f6e-0bbd-4be7-a57e-dafb72f9fda0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:55:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-164722398',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=667b3cea-3545-4dde-b030-251b7d9c761a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='154083d43f2f440aaa83a702c5251116',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:55:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:55:15Z,use_quota=True,user_id='c8ae13f6f3664463b4fe3ae68f68126c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:55:14 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-01dd474a-cd40-4d01-a304-8d80a6de38b2 tempest-VolumesDeleteCascade-308204417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33f1b3c0-d447-4f44-98a8-18be624f5d7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:55:14 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-01dd474a-cd40-4d01-a304-8d80a6de38b2 tempest-VolumesDeleteCascade-308204417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33f1b3c0-d447-4f44-98a8-18be624f5d7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:55:14 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-01dd474a-cd40-4d01-a304-8d80a6de38b2 tempest-VolumesDeleteCascade-308204417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (597a2892-6497-43a4-bc05-890f4da1b874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:55:14 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-01dd474a-cd40-4d01-a304-8d80a6de38b2 tempest-VolumesDeleteCascade-308204417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (597a2892-6497-43a4-bc05-890f4da1b874) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '667b3cea-3545-4dde-b030-251b7d9c761a', 'volume_name': 'volume-667b3cea-3545-4dde-b030-251b7d9c761a', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:55:14 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-01dd474a-cd40-4d01-a304-8d80a6de38b2 tempest-VolumesDeleteCascade-308204417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26c05bf7-b99b-402a-9868-2a20c7469033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:55:14 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-01dd474a-cd40-4d01-a304-8d80a6de38b2 tempest-VolumesDeleteCascade-308204417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26c05bf7-b99b-402a-9868-2a20c7469033) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:55:14 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-01dd474a-cd40-4d01-a304-8d80a6de38b2 tempest-VolumesDeleteCascade-308204417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8672d06-ca11-481a-a0ae-262f3649d643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:55:14 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-01dd474a-cd40-4d01-a304-8d80a6de38b2 tempest-VolumesDeleteCascade-308204417 None] Volume 667b3cea-3545-4dde-b030-251b7d9c761a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-667b3cea-3545-4dde-b030-251b7d9c761a', 'volume_size': 1} Apr 22 17:55:14 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-01dd474a-cd40-4d01-a304-8d80a6de38b2 tempest-VolumesDeleteCascade-308204417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:55:14 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-01dd474a-cd40-4d01-a304-8d80a6de38b2 tempest-VolumesDeleteCascade-308204417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:55:14 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-01dd474a-cd40-4d01-a304-8d80a6de38b2 tempest-VolumesDeleteCascade-308204417 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:55:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-164722398',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=667b3cea-3545-4dde-b030-251b7d9c761a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='154083d43f2f440aaa83a702c5251116',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:55:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:55:15Z,use_quota=True,user_id='c8ae13f6f3664463b4fe3ae68f68126c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)}" {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 17:55:14 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-01dd474a-cd40-4d01-a304-8d80a6de38b2 tempest-VolumesDeleteCascade-308204417 None] Creating volume 667b3cea-3545-4dde-b030-251b7d9c761a {{(pid=81771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 17:55:14 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-01dd474a-cd40-4d01-a304-8d80a6de38b2 tempest-VolumesDeleteCascade-308204417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:55:14 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-01dd474a-cd40-4d01-a304-8d80a6de38b2 tempest-VolumesDeleteCascade-308204417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:55:14 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-01dd474a-cd40-4d01-a304-8d80a6de38b2 tempest-VolumesDeleteCascade-308204417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:55:14 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-01dd474a-cd40-4d01-a304-8d80a6de38b2 tempest-VolumesDeleteCascade-308204417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:55:14 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-01dd474a-cd40-4d01-a304-8d80a6de38b2 tempest-VolumesDeleteCascade-308204417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:55:14 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-01dd474a-cd40-4d01-a304-8d80a6de38b2 tempest-VolumesDeleteCascade-308204417 None] Selected osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 as target Quobyte volume. {{(pid=81771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 17:55:14 devstack cinder-volume[81771]: INFO cinder.volume.drivers.remotefs [None req-01dd474a-cd40-4d01-a304-8d80a6de38b2 tempest-VolumesDeleteCascade-308204417 None] casted to osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 Apr 22 17:55:14 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-01dd474a-cd40-4d01-a304-8d80a6de38b2 tempest-VolumesDeleteCascade-308204417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-667b3cea-3545-4dde-b030-251b7d9c761a 1073741824 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:55:14 devstack sudo[87584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-667b3cea-3545-4dde-b030-251b7d9c761a 1073741824 Apr 22 17:55:14 devstack sudo[87584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:55:14 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-fce04e07-14dc-4cc5-9020-6da337b348bb tempest-GroupsTest-1625537742 None] Group tempest-Group1-245792415: created successfully Apr 22 17:55:14 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-fce04e07-14dc-4cc5-9020-6da337b348bb tempest-GroupsTest-1625537742 None] Create group completed successfully. Apr 22 17:55:15 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-ede84b20-d0ac-4146-8a48-4a6e1b1800a5 tempest-VolumesSnapshotNegativeTestJSON-834288006 None] Acquiring lock "cinder-ad7c5bd6-cab5-46f1-bae5-272a80283761-delete_volume" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:55:15 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-ede84b20-d0ac-4146-8a48-4a6e1b1800a5 tempest-VolumesSnapshotNegativeTestJSON-834288006 None] Lock "cinder-ad7c5bd6-cab5-46f1-bae5-272a80283761-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:55:15 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-ede84b20-d0ac-4146-8a48-4a6e1b1800a5 tempest-VolumesSnapshotNegativeTestJSON-834288006 None] Acquiring lock "cinder-quobyte-ad7c5bd6-cab5-46f1-bae5-272a80283761" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:55:15 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-ede84b20-d0ac-4146-8a48-4a6e1b1800a5 tempest-VolumesSnapshotNegativeTestJSON-834288006 None] Lock "cinder-quobyte-ad7c5bd6-cab5-46f1-bae5-272a80283761" acquired by "delete_volume" :: waited 0.028s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:55:15 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdc19fc3-0bb5-4a65-803e-12efe000f033]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:55:15 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-ede84b20-d0ac-4146-8a48-4a6e1b1800a5 tempest-VolumesSnapshotNegativeTestJSON-834288006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-ad7c5bd6-cab5-46f1-bae5-272a80283761 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:55:15 devstack sudo[87589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-ad7c5bd6-cab5-46f1-bae5-272a80283761 Apr 22 17:55:15 devstack sudo[87589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:55:15 devstack sudo[87584]: pam_unix(sudo:session): session closed for user root Apr 22 17:55:15 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-01dd474a-cd40-4d01-a304-8d80a6de38b2 tempest-VolumesDeleteCascade-308204417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-667b3cea-3545-4dde-b030-251b7d9c761a 1073741824" returned: 0 in 0.713s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:55:15 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-01dd474a-cd40-4d01-a304-8d80a6de38b2 tempest-VolumesDeleteCascade-308204417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-667b3cea-3545-4dde-b030-251b7d9c761a {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:55:15 devstack sudo[87591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-667b3cea-3545-4dde-b030-251b7d9c761a Apr 22 17:55:15 devstack sudo[87591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:55:16 devstack sudo[87589]: pam_unix(sudo:session): session closed for user root Apr 22 17:55:16 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-ede84b20-d0ac-4146-8a48-4a6e1b1800a5 tempest-VolumesSnapshotNegativeTestJSON-834288006 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-ad7c5bd6-cab5-46f1-bae5-272a80283761" returned: 0 in 0.588s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:55:16 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-ede84b20-d0ac-4146-8a48-4a6e1b1800a5 tempest-VolumesSnapshotNegativeTestJSON-834288006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-ad7c5bd6-cab5-46f1-bae5-272a80283761 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:55:16 devstack sudo[87596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-ad7c5bd6-cab5-46f1-bae5-272a80283761 Apr 22 17:55:16 devstack sudo[87596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:55:16 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-8e7497d8-4fd3-47ff-9ad7-f53960ff33c1 tempest-GroupsTest-1625537742 None] Group tempest-Group2-1427014760: creating Apr 22 17:55:16 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-8e7497d8-4fd3-47ff-9ad7-f53960ff33c1 tempest-GroupsTest-1625537742 None] Group tempest-Group2-1427014760: created successfully Apr 22 17:55:16 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-8e7497d8-4fd3-47ff-9ad7-f53960ff33c1 tempest-GroupsTest-1625537742 None] Create group completed successfully. Apr 22 17:55:16 devstack sudo[87591]: pam_unix(sudo:session): session closed for user root Apr 22 17:55:16 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-01dd474a-cd40-4d01-a304-8d80a6de38b2 tempest-VolumesDeleteCascade-308204417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-667b3cea-3545-4dde-b030-251b7d9c761a" returned: 0 in 0.501s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:55:16 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-01dd474a-cd40-4d01-a304-8d80a6de38b2 tempest-VolumesDeleteCascade-308204417 None] <== create_volume: return (1253ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'} {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 17:55:16 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-01dd474a-cd40-4d01-a304-8d80a6de38b2 tempest-VolumesDeleteCascade-308204417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.256s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:55:16 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-01dd474a-cd40-4d01-a304-8d80a6de38b2 tempest-VolumesDeleteCascade-308204417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8672d06-ca11-481a-a0ae-262f3649d643) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-667b3cea-3545-4dde-b030-251b7d9c761a', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:55:16 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-01dd474a-cd40-4d01-a304-8d80a6de38b2 tempest-VolumesDeleteCascade-308204417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39ee0fa5-b927-44bc-8a82-acec3ca68597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:55:16 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-01dd474a-cd40-4d01-a304-8d80a6de38b2 tempest-VolumesDeleteCascade-308204417 None] Volume volume-667b3cea-3545-4dde-b030-251b7d9c761a (667b3cea-3545-4dde-b030-251b7d9c761a): created successfully Apr 22 17:55:16 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-01dd474a-cd40-4d01-a304-8d80a6de38b2 tempest-VolumesDeleteCascade-308204417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39ee0fa5-b927-44bc-8a82-acec3ca68597) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:55:16 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-01dd474a-cd40-4d01-a304-8d80a6de38b2 tempest-VolumesDeleteCascade-308204417 None] Flow 'volume_create_manager' (da819d85-8826-4236-8931-36f39eb29bde) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:55:16 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-01dd474a-cd40-4d01-a304-8d80a6de38b2 tempest-VolumesDeleteCascade-308204417 None] Created volume successfully. Apr 22 17:55:16 devstack sudo[87596]: pam_unix(sudo:session): session closed for user root Apr 22 17:55:16 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-ede84b20-d0ac-4146-8a48-4a6e1b1800a5 tempest-VolumesSnapshotNegativeTestJSON-834288006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-ad7c5bd6-cab5-46f1-bae5-272a80283761" returned: 0 in 0.528s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:55:16 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-ede84b20-d0ac-4146-8a48-4a6e1b1800a5 tempest-VolumesSnapshotNegativeTestJSON-834288006 None] Lock "cinder-quobyte-ad7c5bd6-cab5-46f1-bae5-272a80283761" released by "delete_volume" :: held 1.190s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:55:16 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-ede84b20-d0ac-4146-8a48-4a6e1b1800a5 tempest-VolumesSnapshotNegativeTestJSON-834288006 None] Created reservations ['50e0e6db-a1a6-4e87-ac1f-83f313c66ece', '08e2f899-321c-4736-87b0-8e78576f48b6', '16f9a01b-8790-4687-a464-e37029ae7fc0', 'a4d73721-228e-4698-a794-f4f850db83fc'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 17:55:16 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-ede84b20-d0ac-4146-8a48-4a6e1b1800a5 tempest-VolumesSnapshotNegativeTestJSON-834288006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:55:16 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-ede84b20-d0ac-4146-8a48-4a6e1b1800a5 tempest-VolumesSnapshotNegativeTestJSON-834288006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:55:16 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-ede84b20-d0ac-4146-8a48-4a6e1b1800a5 tempest-VolumesSnapshotNegativeTestJSON-834288006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:55:16 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-ede84b20-d0ac-4146-8a48-4a6e1b1800a5 tempest-VolumesSnapshotNegativeTestJSON-834288006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:55:16 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-ede84b20-d0ac-4146-8a48-4a6e1b1800a5 tempest-VolumesSnapshotNegativeTestJSON-834288006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:55:16 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-ede84b20-d0ac-4146-8a48-4a6e1b1800a5 tempest-VolumesSnapshotNegativeTestJSON-834288006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:55:16 devstack sudo[87600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 Apr 22 17:55:16 devstack sudo[87600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:55:17 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-c295fc43-b332-4505-bca5-0c4128d71d62 tempest-VolumesDeleteCascade-308204417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:55:17 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-c295fc43-b332-4505-bca5-0c4128d71d62 tempest-VolumesDeleteCascade-308204417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:55:17 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-c295fc43-b332-4505-bca5-0c4128d71d62 tempest-VolumesDeleteCascade-308204417 None] Creating offline snapshot d43e6202-6d1c-443d-a2bf-a097013d0aed of volume 667b3cea-3545-4dde-b030-251b7d9c761a {{(pid=81771) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 22 17:55:17 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[917318a5-a869-40c8-b1ab-628552b04345]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:55:17 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-c295fc43-b332-4505-bca5-0c4128d71d62 tempest-VolumesDeleteCascade-308204417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-667b3cea-3545-4dde-b030-251b7d9c761a {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:55:17 devstack sudo[87600]: pam_unix(sudo:session): session closed for user root Apr 22 17:55:17 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-ede84b20-d0ac-4146-8a48-4a6e1b1800a5 tempest-VolumesSnapshotNegativeTestJSON-834288006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33" returned: 0 in 0.542s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:55:17 devstack cinder-volume[81771]: DEBUG cinder.manager [None req-ede84b20-d0ac-4146-8a48-4a6e1b1800a5 tempest-VolumesSnapshotNegativeTestJSON-834288006 None] Notifying Schedulers of capabilities ... {{(pid=81771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 17:55:17 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-ede84b20-d0ac-4146-8a48-4a6e1b1800a5 tempest-VolumesSnapshotNegativeTestJSON-834288006 None] Deleted volume successfully. Apr 22 17:55:17 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-ede84b20-d0ac-4146-8a48-4a6e1b1800a5 tempest-VolumesSnapshotNegativeTestJSON-834288006 None] Lock "cinder-ad7c5bd6-cab5-46f1-bae5-272a80283761-delete_volume" released by "delete_volume" :: held 1.966s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:55:17 devstack sudo[87604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-667b3cea-3545-4dde-b030-251b7d9c761a Apr 22 17:55:17 devstack sudo[87604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:55:17 devstack cinder-volume[81771]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbf7b670-8201-47f7-8434-260d17f4b6f9 tempest-GroupsTest-1625537742 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 17:55:17 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-bbf7b670-8201-47f7-8434-260d17f4b6f9 tempest-GroupsTest-1625537742 None] Flow 'volume_create_manager' (962adf55-cf12-441c-a5a4-4e47583c07c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:55:17 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-bbf7b670-8201-47f7-8434-260d17f4b6f9 tempest-GroupsTest-1625537742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c19f8de4-771c-4d7f-a49a-4692c7fcb412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:55:17 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-bbf7b670-8201-47f7-8434-260d17f4b6f9 tempest-GroupsTest-1625537742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c19f8de4-771c-4d7f-a49a-4692c7fcb412) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:55:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-257093284',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f6b81a39-a24b-4b7d-933d-f32ebffa92b7,host='devstack@QuobyteHD#QuobyteHD',id=12492feb-bc3b-4f9a-800c-35096ba94739,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbd20e328ab94b02a81e783994305701',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:55:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:55:18Z,use_quota=True,user_id='a76a7c73186547ee8d70613c7ca959bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcb728ac-6576-4259-96a5-8a2402d87163),volume_type_id=fcb728ac-6576-4259-96a5-8a2402d87163)' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:55:17 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-bbf7b670-8201-47f7-8434-260d17f4b6f9 tempest-GroupsTest-1625537742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21aeafd4-4bfc-45ad-881a-a03a4b7b3f97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:55:17 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-bbf7b670-8201-47f7-8434-260d17f4b6f9 tempest-GroupsTest-1625537742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21aeafd4-4bfc-45ad-881a-a03a4b7b3f97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:55:17 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-bbf7b670-8201-47f7-8434-260d17f4b6f9 tempest-GroupsTest-1625537742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a89ceb9c-851c-41da-ac2d-798d970c4f87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:55:17 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-bbf7b670-8201-47f7-8434-260d17f4b6f9 tempest-GroupsTest-1625537742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a89ceb9c-851c-41da-ac2d-798d970c4f87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12492feb-bc3b-4f9a-800c-35096ba94739', 'volume_name': 'volume-12492feb-bc3b-4f9a-800c-35096ba94739', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:55:17 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-bbf7b670-8201-47f7-8434-260d17f4b6f9 tempest-GroupsTest-1625537742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (023b6428-daa2-41b0-9a76-80614bb0dfbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:55:17 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-bbf7b670-8201-47f7-8434-260d17f4b6f9 tempest-GroupsTest-1625537742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (023b6428-daa2-41b0-9a76-80614bb0dfbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:55:17 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-bbf7b670-8201-47f7-8434-260d17f4b6f9 tempest-GroupsTest-1625537742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe072ee6-90e1-4903-8304-ff889a2e4f44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:55:17 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-bbf7b670-8201-47f7-8434-260d17f4b6f9 tempest-GroupsTest-1625537742 None] Volume 12492feb-bc3b-4f9a-800c-35096ba94739: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12492feb-bc3b-4f9a-800c-35096ba94739', 'volume_size': 1} Apr 22 17:55:17 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-bbf7b670-8201-47f7-8434-260d17f4b6f9 tempest-GroupsTest-1625537742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:55:17 devstack sudo[87604]: pam_unix(sudo:session): session closed for user root Apr 22 17:55:17 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-c295fc43-b332-4505-bca5-0c4128d71d62 tempest-VolumesDeleteCascade-308204417 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-667b3cea-3545-4dde-b030-251b7d9c761a" returned: 0 in 0.615s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:55:17 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-c295fc43-b332-4505-bca5-0c4128d71d62 tempest-VolumesDeleteCascade-308204417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-667b3cea-3545-4dde-b030-251b7d9c761a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-667b3cea-3545-4dde-b030-251b7d9c761a.d43e6202-6d1c-443d-a2bf-a097013d0aed 1G {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:55:17 devstack sudo[87613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-667b3cea-3545-4dde-b030-251b7d9c761a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-667b3cea-3545-4dde-b030-251b7d9c761a.d43e6202-6d1c-443d-a2bf-a097013d0aed 1G Apr 22 17:55:17 devstack sudo[87613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:55:18 devstack sudo[87613]: pam_unix(sudo:session): session closed for user root Apr 22 17:55:18 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-c295fc43-b332-4505-bca5-0c4128d71d62 tempest-VolumesDeleteCascade-308204417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-667b3cea-3545-4dde-b030-251b7d9c761a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-667b3cea-3545-4dde-b030-251b7d9c761a.d43e6202-6d1c-443d-a2bf-a097013d0aed 1G" returned: 0 in 0.691s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:55:18 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-c295fc43-b332-4505-bca5-0c4128d71d62 tempest-VolumesDeleteCascade-308204417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-667b3cea-3545-4dde-b030-251b7d9c761a -F qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-667b3cea-3545-4dde-b030-251b7d9c761a.d43e6202-6d1c-443d-a2bf-a097013d0aed {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:55:18 devstack sudo[87618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-667b3cea-3545-4dde-b030-251b7d9c761a -F qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-667b3cea-3545-4dde-b030-251b7d9c761a.d43e6202-6d1c-443d-a2bf-a097013d0aed Apr 22 17:55:18 devstack sudo[87618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:55:19 devstack sudo[87618]: pam_unix(sudo:session): session closed for user root Apr 22 17:55:19 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-c295fc43-b332-4505-bca5-0c4128d71d62 tempest-VolumesDeleteCascade-308204417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-667b3cea-3545-4dde-b030-251b7d9c761a -F qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-667b3cea-3545-4dde-b030-251b7d9c761a.d43e6202-6d1c-443d-a2bf-a097013d0aed" returned: 0 in 0.609s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:55:19 devstack cinder-volume[81771]: WARNING cinder.volume.drivers.remotefs [None req-c295fc43-b332-4505-bca5-0c4128d71d62 tempest-VolumesDeleteCascade-308204417 None] /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-667b3cea-3545-4dde-b030-251b7d9c761a.d43e6202-6d1c-443d-a2bf-a097013d0aed is being set with open permissions: ugo+rw Apr 22 17:55:19 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-c295fc43-b332-4505-bca5-0c4128d71d62 tempest-VolumesDeleteCascade-308204417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-667b3cea-3545-4dde-b030-251b7d9c761a.d43e6202-6d1c-443d-a2bf-a097013d0aed {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:55:19 devstack sudo[87623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-667b3cea-3545-4dde-b030-251b7d9c761a.d43e6202-6d1c-443d-a2bf-a097013d0aed Apr 22 17:55:19 devstack sudo[87623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:55:19 devstack sudo[87623]: pam_unix(sudo:session): session closed for user root Apr 22 17:55:19 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-c295fc43-b332-4505-bca5-0c4128d71d62 tempest-VolumesDeleteCascade-308204417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-667b3cea-3545-4dde-b030-251b7d9c761a.d43e6202-6d1c-443d-a2bf-a097013d0aed" returned: 0 in 0.556s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:55:19 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-c295fc43-b332-4505-bca5-0c4128d71d62 tempest-VolumesDeleteCascade-308204417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-667b3cea-3545-4dde-b030-251b7d9c761a.info {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:55:19 devstack sudo[87632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-667b3cea-3545-4dde-b030-251b7d9c761a.info Apr 22 17:55:19 devstack sudo[87632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:55:20 devstack sudo[87632]: pam_unix(sudo:session): session closed for user root Apr 22 17:55:20 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-c295fc43-b332-4505-bca5-0c4128d71d62 tempest-VolumesDeleteCascade-308204417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-667b3cea-3545-4dde-b030-251b7d9c761a.info" returned: 0 in 0.534s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:55:20 devstack cinder-volume[81771]: WARNING cinder.volume.drivers.remotefs [None req-c295fc43-b332-4505-bca5-0c4128d71d62 tempest-VolumesDeleteCascade-308204417 None] /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-667b3cea-3545-4dde-b030-251b7d9c761a.info is being set with open permissions: ugo+rw Apr 22 17:55:20 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-c295fc43-b332-4505-bca5-0c4128d71d62 tempest-VolumesDeleteCascade-308204417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-667b3cea-3545-4dde-b030-251b7d9c761a.info {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:55:20 devstack sudo[87643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-667b3cea-3545-4dde-b030-251b7d9c761a.info Apr 22 17:55:20 devstack sudo[87643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:55:20 devstack cinder-volume[81771]: DEBUG cinder.volume.flows.manager.create_volume [None req-648c8f7f-1685-4a76-831a-c71980cec973 tempest-CreateVolumesFromImageTest-478817080 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 17:55:20 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-648c8f7f-1685-4a76-831a-c71980cec973 tempest-CreateVolumesFromImageTest-478817080 None] Flow 'volume_create_manager' (10312f89-d57b-4f3e-887c-3f352b096b9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:55:20 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-648c8f7f-1685-4a76-831a-c71980cec973 tempest-CreateVolumesFromImageTest-478817080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f023a0b0-cc49-42ea-a355-2123c10b3f4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:55:20 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-648c8f7f-1685-4a76-831a-c71980cec973 tempest-CreateVolumesFromImageTest-478817080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f023a0b0-cc49-42ea-a355-2123c10b3f4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:55:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1580304950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=689a0626-3452-4772-9c58-65dc083fb435,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2fff6c0cb364d189c469567b26f8a6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:55:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:55:20Z,use_quota=True,user_id='02703e1eb0d3464d8ffa7d946be94bf3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:55:20 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-648c8f7f-1685-4a76-831a-c71980cec973 tempest-CreateVolumesFromImageTest-478817080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa418788-14a2-4df9-b258-1bac5c5941e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:55:20 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-648c8f7f-1685-4a76-831a-c71980cec973 tempest-CreateVolumesFromImageTest-478817080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa418788-14a2-4df9-b258-1bac5c5941e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:55:20 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-648c8f7f-1685-4a76-831a-c71980cec973 tempest-CreateVolumesFromImageTest-478817080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82faf624-4934-47e1-a370-95574ec55884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:55:20 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-648c8f7f-1685-4a76-831a-c71980cec973 tempest-CreateVolumesFromImageTest-478817080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82faf624-4934-47e1-a370-95574ec55884) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '689a0626-3452-4772-9c58-65dc083fb435', 'volume_name': 'volume-689a0626-3452-4772-9c58-65dc083fb435', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:55:20 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-648c8f7f-1685-4a76-831a-c71980cec973 tempest-CreateVolumesFromImageTest-478817080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (876c6dfc-dba5-44f4-854c-795e8f50e511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:55:20 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-648c8f7f-1685-4a76-831a-c71980cec973 tempest-CreateVolumesFromImageTest-478817080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (876c6dfc-dba5-44f4-854c-795e8f50e511) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:55:20 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-648c8f7f-1685-4a76-831a-c71980cec973 tempest-CreateVolumesFromImageTest-478817080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e917960-2c09-46ba-be22-772ad9fa638d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:55:20 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-648c8f7f-1685-4a76-831a-c71980cec973 tempest-CreateVolumesFromImageTest-478817080 None] Volume 689a0626-3452-4772-9c58-65dc083fb435: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-689a0626-3452-4772-9c58-65dc083fb435', 'volume_size': 1} Apr 22 17:55:20 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-648c8f7f-1685-4a76-831a-c71980cec973 tempest-CreateVolumesFromImageTest-478817080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:55:20 devstack cinder-volume[81771]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7bbd4ca-1067-4b03-8eb2-7207c74fdc2c tempest-CreateVolumesFromImageTest-478817080 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 17:55:20 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-f7bbd4ca-1067-4b03-8eb2-7207c74fdc2c tempest-CreateVolumesFromImageTest-478817080 None] Flow 'volume_create_manager' (e03b30f9-1436-47c2-be37-6425cd0c771f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:55:20 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-f7bbd4ca-1067-4b03-8eb2-7207c74fdc2c tempest-CreateVolumesFromImageTest-478817080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87dc43ae-2e6a-4b24-a0d3-2c6ddf0c1a21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:55:20 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-f7bbd4ca-1067-4b03-8eb2-7207c74fdc2c tempest-CreateVolumesFromImageTest-478817080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87dc43ae-2e6a-4b24-a0d3-2c6ddf0c1a21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:55:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-400205067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36d827f3-71a6-445c-959f-9f1f6e1e8ec6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2fff6c0cb364d189c469567b26f8a6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:55:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:55:21Z,use_quota=True,user_id='02703e1eb0d3464d8ffa7d946be94bf3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:55:20 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-f7bbd4ca-1067-4b03-8eb2-7207c74fdc2c tempest-CreateVolumesFromImageTest-478817080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (259c1d7d-4a9d-4be1-9557-5eefa50399e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:55:20 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-f7bbd4ca-1067-4b03-8eb2-7207c74fdc2c tempest-CreateVolumesFromImageTest-478817080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (259c1d7d-4a9d-4be1-9557-5eefa50399e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:55:20 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-f7bbd4ca-1067-4b03-8eb2-7207c74fdc2c tempest-CreateVolumesFromImageTest-478817080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc77d301-9816-4d11-b076-81b4123bef92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:55:20 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-f7bbd4ca-1067-4b03-8eb2-7207c74fdc2c tempest-CreateVolumesFromImageTest-478817080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc77d301-9816-4d11-b076-81b4123bef92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36d827f3-71a6-445c-959f-9f1f6e1e8ec6', 'volume_name': 'volume-36d827f3-71a6-445c-959f-9f1f6e1e8ec6', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:55:20 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-f7bbd4ca-1067-4b03-8eb2-7207c74fdc2c tempest-CreateVolumesFromImageTest-478817080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22d6c2d2-a339-498a-82c3-72c5a2218e47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:55:20 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-f7bbd4ca-1067-4b03-8eb2-7207c74fdc2c tempest-CreateVolumesFromImageTest-478817080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22d6c2d2-a339-498a-82c3-72c5a2218e47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:55:21 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-f7bbd4ca-1067-4b03-8eb2-7207c74fdc2c tempest-CreateVolumesFromImageTest-478817080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3228703c-934f-4e8d-ad5f-90f72faa8e1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:55:21 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-f7bbd4ca-1067-4b03-8eb2-7207c74fdc2c tempest-CreateVolumesFromImageTest-478817080 None] Volume 36d827f3-71a6-445c-959f-9f1f6e1e8ec6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36d827f3-71a6-445c-959f-9f1f6e1e8ec6', 'volume_size': 1} Apr 22 17:55:21 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-f7bbd4ca-1067-4b03-8eb2-7207c74fdc2c tempest-CreateVolumesFromImageTest-478817080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:55:21 devstack cinder-volume[81771]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8248e60-5fd9-4ecc-b6de-158f850fd302 tempest-CreateVolumesFromImageTest-478817080 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 17:55:21 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-d8248e60-5fd9-4ecc-b6de-158f850fd302 tempest-CreateVolumesFromImageTest-478817080 None] Flow 'volume_create_manager' (013b804d-d973-4f4d-bc40-098f69b7bc47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:55:21 devstack sudo[87643]: pam_unix(sudo:session): session closed for user root Apr 22 17:55:21 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-d8248e60-5fd9-4ecc-b6de-158f850fd302 tempest-CreateVolumesFromImageTest-478817080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acf3a2a5-9bdc-412e-988d-77659b26b782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:55:21 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-c295fc43-b332-4505-bca5-0c4128d71d62 tempest-VolumesDeleteCascade-308204417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-667b3cea-3545-4dde-b030-251b7d9c761a.info" returned: 0 in 1.168s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:55:21 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-c295fc43-b332-4505-bca5-0c4128d71d62 tempest-VolumesDeleteCascade-308204417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.318s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:55:21 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-bbf7b670-8201-47f7-8434-260d17f4b6f9 tempest-GroupsTest-1625537742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.797s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:55:21 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-bbf7b670-8201-47f7-8434-260d17f4b6f9 tempest-GroupsTest-1625537742 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f6b81a39-a24b-4b7d-933d-f32ebffa92b7,created_at=2026-04-22T15:55:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-257093284',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f6b81a39-a24b-4b7d-933d-f32ebffa92b7,host='devstack@QuobyteHD#QuobyteHD',id=12492feb-bc3b-4f9a-800c-35096ba94739,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbd20e328ab94b02a81e783994305701',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:55:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:55:18Z,use_quota=True,user_id='a76a7c73186547ee8d70613c7ca959bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcb728ac-6576-4259-96a5-8a2402d87163),volume_type_id=fcb728ac-6576-4259-96a5-8a2402d87163)}" {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 17:55:21 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-bbf7b670-8201-47f7-8434-260d17f4b6f9 tempest-GroupsTest-1625537742 None] Creating volume 12492feb-bc3b-4f9a-800c-35096ba94739 {{(pid=81771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 17:55:21 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-bbf7b670-8201-47f7-8434-260d17f4b6f9 tempest-GroupsTest-1625537742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:55:21 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-bbf7b670-8201-47f7-8434-260d17f4b6f9 tempest-GroupsTest-1625537742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:55:21 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-bbf7b670-8201-47f7-8434-260d17f4b6f9 tempest-GroupsTest-1625537742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:55:21 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-bbf7b670-8201-47f7-8434-260d17f4b6f9 tempest-GroupsTest-1625537742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:55:21 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-bbf7b670-8201-47f7-8434-260d17f4b6f9 tempest-GroupsTest-1625537742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:55:21 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-bbf7b670-8201-47f7-8434-260d17f4b6f9 tempest-GroupsTest-1625537742 None] Selected osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 as target Quobyte volume. {{(pid=81771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 17:55:21 devstack cinder-volume[81771]: INFO cinder.volume.drivers.remotefs [None req-bbf7b670-8201-47f7-8434-260d17f4b6f9 tempest-GroupsTest-1625537742 None] casted to osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 Apr 22 17:55:21 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-bbf7b670-8201-47f7-8434-260d17f4b6f9 tempest-GroupsTest-1625537742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-12492feb-bc3b-4f9a-800c-35096ba94739 1073741824 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:55:21 devstack sudo[87677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-12492feb-bc3b-4f9a-800c-35096ba94739 1073741824 Apr 22 17:55:21 devstack sudo[87677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:55:21 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-d8248e60-5fd9-4ecc-b6de-158f850fd302 tempest-CreateVolumesFromImageTest-478817080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acf3a2a5-9bdc-412e-988d-77659b26b782) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:55:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-884697288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae01bf4d-00ea-4fb2-b96c-3fc4ef1fb3c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2fff6c0cb364d189c469567b26f8a6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:55:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:55:21Z,use_quota=True,user_id='02703e1eb0d3464d8ffa7d946be94bf3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:55:21 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-d8248e60-5fd9-4ecc-b6de-158f850fd302 tempest-CreateVolumesFromImageTest-478817080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7a1ab77-1aa4-4957-b307-65e1e347234e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:55:21 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-d8248e60-5fd9-4ecc-b6de-158f850fd302 tempest-CreateVolumesFromImageTest-478817080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7a1ab77-1aa4-4957-b307-65e1e347234e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:55:21 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-d8248e60-5fd9-4ecc-b6de-158f850fd302 tempest-CreateVolumesFromImageTest-478817080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b5604fc-74cb-4458-87da-04b3e9e51069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:55:21 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-d8248e60-5fd9-4ecc-b6de-158f850fd302 tempest-CreateVolumesFromImageTest-478817080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b5604fc-74cb-4458-87da-04b3e9e51069) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae01bf4d-00ea-4fb2-b96c-3fc4ef1fb3c0', 'volume_name': 'volume-ae01bf4d-00ea-4fb2-b96c-3fc4ef1fb3c0', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:55:21 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-d8248e60-5fd9-4ecc-b6de-158f850fd302 tempest-CreateVolumesFromImageTest-478817080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b48b82dc-e406-4a47-98f5-a040423752e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:55:21 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-d8248e60-5fd9-4ecc-b6de-158f850fd302 tempest-CreateVolumesFromImageTest-478817080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b48b82dc-e406-4a47-98f5-a040423752e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:55:21 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-d8248e60-5fd9-4ecc-b6de-158f850fd302 tempest-CreateVolumesFromImageTest-478817080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d597198-b092-4a31-812b-abbc9a285ae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:55:21 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-d8248e60-5fd9-4ecc-b6de-158f850fd302 tempest-CreateVolumesFromImageTest-478817080 None] Volume ae01bf4d-00ea-4fb2-b96c-3fc4ef1fb3c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae01bf4d-00ea-4fb2-b96c-3fc4ef1fb3c0', 'volume_size': 1} Apr 22 17:55:21 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-d8248e60-5fd9-4ecc-b6de-158f850fd302 tempest-CreateVolumesFromImageTest-478817080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:55:21 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-c295fc43-b332-4505-bca5-0c4128d71d62 tempest-VolumesDeleteCascade-308204417 None] Create snapshot completed successfully Apr 22 17:55:21 devstack cinder-volume[81771]: DEBUG cinder.volume.flows.manager.create_volume [None req-755bf0ee-8c59-4a59-96f2-f2940d15c5ff tempest-CreateVolumesFromImageTest-478817080 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 17:55:21 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-755bf0ee-8c59-4a59-96f2-f2940d15c5ff tempest-CreateVolumesFromImageTest-478817080 None] Flow 'volume_create_manager' (eb3dda75-66c5-4ea2-a6c8-b7deedbdfb88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:55:21 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-755bf0ee-8c59-4a59-96f2-f2940d15c5ff tempest-CreateVolumesFromImageTest-478817080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4afa77f7-3aef-4de4-952e-ef03c7ffbd2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:55:21 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-755bf0ee-8c59-4a59-96f2-f2940d15c5ff tempest-CreateVolumesFromImageTest-478817080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4afa77f7-3aef-4de4-952e-ef03c7ffbd2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:55:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1428309701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30e3e625-1531-4632-a7f6-56ae9ce53715,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2fff6c0cb364d189c469567b26f8a6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:55:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:55:22Z,use_quota=True,user_id='02703e1eb0d3464d8ffa7d946be94bf3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:55:21 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-755bf0ee-8c59-4a59-96f2-f2940d15c5ff tempest-CreateVolumesFromImageTest-478817080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (161fab6c-26bc-49cf-a9a9-3e181799f7a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:55:21 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-755bf0ee-8c59-4a59-96f2-f2940d15c5ff tempest-CreateVolumesFromImageTest-478817080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (161fab6c-26bc-49cf-a9a9-3e181799f7a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:55:21 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-755bf0ee-8c59-4a59-96f2-f2940d15c5ff tempest-CreateVolumesFromImageTest-478817080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b2c77c4-015f-44b4-8c47-bafb3d5fc242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:55:21 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-755bf0ee-8c59-4a59-96f2-f2940d15c5ff tempest-CreateVolumesFromImageTest-478817080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b2c77c4-015f-44b4-8c47-bafb3d5fc242) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30e3e625-1531-4632-a7f6-56ae9ce53715', 'volume_name': 'volume-30e3e625-1531-4632-a7f6-56ae9ce53715', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:55:22 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-755bf0ee-8c59-4a59-96f2-f2940d15c5ff tempest-CreateVolumesFromImageTest-478817080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9241fbfa-e381-4e91-ae6b-98f0f768878e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:55:22 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-755bf0ee-8c59-4a59-96f2-f2940d15c5ff tempest-CreateVolumesFromImageTest-478817080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9241fbfa-e381-4e91-ae6b-98f0f768878e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:55:22 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-755bf0ee-8c59-4a59-96f2-f2940d15c5ff tempest-CreateVolumesFromImageTest-478817080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c2d3622-0bdd-460b-b353-9658d4324ca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:55:22 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-755bf0ee-8c59-4a59-96f2-f2940d15c5ff tempest-CreateVolumesFromImageTest-478817080 None] Volume 30e3e625-1531-4632-a7f6-56ae9ce53715: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30e3e625-1531-4632-a7f6-56ae9ce53715', 'volume_size': 1} Apr 22 17:55:22 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-755bf0ee-8c59-4a59-96f2-f2940d15c5ff tempest-CreateVolumesFromImageTest-478817080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:55:22 devstack cinder-volume[81771]: DEBUG cinder.volume.flows.manager.create_volume [None req-f486539a-2ff6-4dd1-b847-1428133bc9fe tempest-CreateVolumesFromImageTest-478817080 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 17:55:22 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-f486539a-2ff6-4dd1-b847-1428133bc9fe tempest-CreateVolumesFromImageTest-478817080 None] Flow 'volume_create_manager' (dd9c7210-d1ae-4b98-b231-b369a84c8d1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:55:22 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-f486539a-2ff6-4dd1-b847-1428133bc9fe tempest-CreateVolumesFromImageTest-478817080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9c58024-d93b-475f-9a98-e54bbd683ec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:55:22 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-f486539a-2ff6-4dd1-b847-1428133bc9fe tempest-CreateVolumesFromImageTest-478817080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9c58024-d93b-475f-9a98-e54bbd683ec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:55:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1862867914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a12c8e45-6bf5-4ad3-a0ba-b97e0bf5557e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2fff6c0cb364d189c469567b26f8a6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:55:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:55:22Z,use_quota=True,user_id='02703e1eb0d3464d8ffa7d946be94bf3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:55:22 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-f486539a-2ff6-4dd1-b847-1428133bc9fe tempest-CreateVolumesFromImageTest-478817080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ce650ac-7180-4dc9-840f-7fb58050f879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:55:22 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-f486539a-2ff6-4dd1-b847-1428133bc9fe tempest-CreateVolumesFromImageTest-478817080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ce650ac-7180-4dc9-840f-7fb58050f879) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:55:22 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-f486539a-2ff6-4dd1-b847-1428133bc9fe tempest-CreateVolumesFromImageTest-478817080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cb9e50b-9e80-42b0-ada4-384763d7457f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:55:22 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-f486539a-2ff6-4dd1-b847-1428133bc9fe tempest-CreateVolumesFromImageTest-478817080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cb9e50b-9e80-42b0-ada4-384763d7457f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a12c8e45-6bf5-4ad3-a0ba-b97e0bf5557e', 'volume_name': 'volume-a12c8e45-6bf5-4ad3-a0ba-b97e0bf5557e', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:55:22 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-f486539a-2ff6-4dd1-b847-1428133bc9fe tempest-CreateVolumesFromImageTest-478817080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dd0ff0a-3eb3-4fe6-aa66-8ccd7c49c561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:55:22 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-f486539a-2ff6-4dd1-b847-1428133bc9fe tempest-CreateVolumesFromImageTest-478817080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dd0ff0a-3eb3-4fe6-aa66-8ccd7c49c561) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:55:22 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-f486539a-2ff6-4dd1-b847-1428133bc9fe tempest-CreateVolumesFromImageTest-478817080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a1d9584-7ea9-465c-bb45-c921790b5dd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:55:22 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-f486539a-2ff6-4dd1-b847-1428133bc9fe tempest-CreateVolumesFromImageTest-478817080 None] Volume a12c8e45-6bf5-4ad3-a0ba-b97e0bf5557e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a12c8e45-6bf5-4ad3-a0ba-b97e0bf5557e', 'volume_size': 1} Apr 22 17:55:22 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-f486539a-2ff6-4dd1-b847-1428133bc9fe tempest-CreateVolumesFromImageTest-478817080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:55:22 devstack sudo[87677]: pam_unix(sudo:session): session closed for user root Apr 22 17:55:22 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-bbf7b670-8201-47f7-8434-260d17f4b6f9 tempest-GroupsTest-1625537742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-12492feb-bc3b-4f9a-800c-35096ba94739 1073741824" returned: 0 in 0.910s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:55:22 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-bbf7b670-8201-47f7-8434-260d17f4b6f9 tempest-GroupsTest-1625537742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-12492feb-bc3b-4f9a-800c-35096ba94739 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:55:22 devstack sudo[87683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-12492feb-bc3b-4f9a-800c-35096ba94739 Apr 22 17:55:22 devstack sudo[87683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:55:22 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-6c6746f7-e6ba-4635-9ad8-9b9ce5bdf227 tempest-VolumesDeleteCascade-308204417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:55:23 devstack sudo[87683]: pam_unix(sudo:session): session closed for user root Apr 22 17:55:23 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-bbf7b670-8201-47f7-8434-260d17f4b6f9 tempest-GroupsTest-1625537742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-12492feb-bc3b-4f9a-800c-35096ba94739" returned: 0 in 0.521s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:55:23 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-bbf7b670-8201-47f7-8434-260d17f4b6f9 tempest-GroupsTest-1625537742 None] <== create_volume: return (1481ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'} {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 17:55:23 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-bbf7b670-8201-47f7-8434-260d17f4b6f9 tempest-GroupsTest-1625537742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.486s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:55:23 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-648c8f7f-1685-4a76-831a-c71980cec973 tempest-CreateVolumesFromImageTest-478817080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.620s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:55:23 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-648c8f7f-1685-4a76-831a-c71980cec973 tempest-CreateVolumesFromImageTest-478817080 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:55:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1580304950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=689a0626-3452-4772-9c58-65dc083fb435,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2fff6c0cb364d189c469567b26f8a6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:55:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:55:20Z,use_quota=True,user_id='02703e1eb0d3464d8ffa7d946be94bf3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)}" {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 17:55:23 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-648c8f7f-1685-4a76-831a-c71980cec973 tempest-CreateVolumesFromImageTest-478817080 None] Creating volume 689a0626-3452-4772-9c58-65dc083fb435 {{(pid=81771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 17:55:23 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-648c8f7f-1685-4a76-831a-c71980cec973 tempest-CreateVolumesFromImageTest-478817080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:55:23 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-648c8f7f-1685-4a76-831a-c71980cec973 tempest-CreateVolumesFromImageTest-478817080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:55:23 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-648c8f7f-1685-4a76-831a-c71980cec973 tempest-CreateVolumesFromImageTest-478817080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:55:23 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-648c8f7f-1685-4a76-831a-c71980cec973 tempest-CreateVolumesFromImageTest-478817080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:55:23 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-648c8f7f-1685-4a76-831a-c71980cec973 tempest-CreateVolumesFromImageTest-478817080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:55:23 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-648c8f7f-1685-4a76-831a-c71980cec973 tempest-CreateVolumesFromImageTest-478817080 None] Selected osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 as target Quobyte volume. {{(pid=81771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 17:55:23 devstack cinder-volume[81771]: INFO cinder.volume.drivers.remotefs [None req-648c8f7f-1685-4a76-831a-c71980cec973 tempest-CreateVolumesFromImageTest-478817080 None] casted to osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 Apr 22 17:55:23 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-648c8f7f-1685-4a76-831a-c71980cec973 tempest-CreateVolumesFromImageTest-478817080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-689a0626-3452-4772-9c58-65dc083fb435 1073741824 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:55:23 devstack sudo[87686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-689a0626-3452-4772-9c58-65dc083fb435 1073741824 Apr 22 17:55:23 devstack sudo[87686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:55:23 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-bbf7b670-8201-47f7-8434-260d17f4b6f9 tempest-GroupsTest-1625537742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe072ee6-90e1-4903-8304-ff889a2e4f44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12492feb-bc3b-4f9a-800c-35096ba94739', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:55:23 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-bbf7b670-8201-47f7-8434-260d17f4b6f9 tempest-GroupsTest-1625537742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (124f17b9-41ea-4311-a1de-5f2009196d24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:55:23 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-bbf7b670-8201-47f7-8434-260d17f4b6f9 tempest-GroupsTest-1625537742 None] Volume volume-12492feb-bc3b-4f9a-800c-35096ba94739 (12492feb-bc3b-4f9a-800c-35096ba94739): created successfully Apr 22 17:55:23 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-bbf7b670-8201-47f7-8434-260d17f4b6f9 tempest-GroupsTest-1625537742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (124f17b9-41ea-4311-a1de-5f2009196d24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:55:23 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-bbf7b670-8201-47f7-8434-260d17f4b6f9 tempest-GroupsTest-1625537742 None] Flow 'volume_create_manager' (962adf55-cf12-441c-a5a4-4e47583c07c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:55:23 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-bbf7b670-8201-47f7-8434-260d17f4b6f9 tempest-GroupsTest-1625537742 None] Created volume successfully. Apr 22 17:55:23 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-49708597-46c3-4868-b875-9d7fdd36b8af tempest-VolumesActionsTest-84916959 None] Acquiring lock "cinder-e3664582-4810-4ace-9346-f53375c65ed6" by "attach_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:55:23 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-49708597-46c3-4868-b875-9d7fdd36b8af tempest-VolumesActionsTest-84916959 None] Lock "cinder-e3664582-4810-4ace-9346-f53375c65ed6" acquired by "attach_volume" :: waited 0.032s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:55:23 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-49708597-46c3-4868-b875-9d7fdd36b8af tempest-VolumesActionsTest-84916959 None] Attaching volume e3664582-4810-4ace-9346-f53375c65ed6 to instance 038f2b7b-700c-4bdb-ae58-5add53d7f637 at mountpoint /dev/vdb on host None. Apr 22 17:55:23 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-49708597-46c3-4868-b875-9d7fdd36b8af tempest-VolumesActionsTest-84916959 None] Attach volume completed successfully. Apr 22 17:55:23 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-49708597-46c3-4868-b875-9d7fdd36b8af tempest-VolumesActionsTest-84916959 None] Lock "cinder-e3664582-4810-4ace-9346-f53375c65ed6" released by "attach_volume" :: held 0.180s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:55:23 devstack sudo[87686]: pam_unix(sudo:session): session closed for user root Apr 22 17:55:23 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-648c8f7f-1685-4a76-831a-c71980cec973 tempest-CreateVolumesFromImageTest-478817080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-689a0626-3452-4772-9c58-65dc083fb435 1073741824" returned: 0 in 0.951s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:55:24 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-648c8f7f-1685-4a76-831a-c71980cec973 tempest-CreateVolumesFromImageTest-478817080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-689a0626-3452-4772-9c58-65dc083fb435 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:55:24 devstack sudo[87691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-689a0626-3452-4772-9c58-65dc083fb435 Apr 22 17:55:24 devstack sudo[87691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:55:24 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-0aadb9a1-2b67-450a-b420-aff7e5998aff tempest-GroupsTest-1625537742 None] Acquiring lock "cinder-quobyte-12492feb-bc3b-4f9a-800c-35096ba94739" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:55:24 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-0aadb9a1-2b67-450a-b420-aff7e5998aff tempest-GroupsTest-1625537742 None] Lock "cinder-quobyte-12492feb-bc3b-4f9a-800c-35096ba94739" acquired by "delete_volume" :: waited 0.025s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:55:24 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d673ccb-423b-49e0-a096-3f85c0f0f8f6]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:55:24 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-0aadb9a1-2b67-450a-b420-aff7e5998aff tempest-GroupsTest-1625537742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-12492feb-bc3b-4f9a-800c-35096ba94739 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:55:24 devstack sudo[87693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-12492feb-bc3b-4f9a-800c-35096ba94739 Apr 22 17:55:24 devstack sudo[87693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:55:24 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-655ddb9e-f852-412e-942b-3f1bf60cc156 tempest-VolumesActionsTest-84916959 None] Acquiring lock "cinder-e3664582-4810-4ace-9346-f53375c65ed6-detach_volume" by "detach_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:55:24 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-655ddb9e-f852-412e-942b-3f1bf60cc156 tempest-VolumesActionsTest-84916959 None] Lock "cinder-e3664582-4810-4ace-9346-f53375c65ed6-detach_volume" acquired by "detach_volume" :: waited 0.022s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:55:24 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-655ddb9e-f852-412e-942b-3f1bf60cc156 tempest-VolumesActionsTest-84916959 None] Detaching volume e3664582-4810-4ace-9346-f53375c65ed6 from instance 038f2b7b-700c-4bdb-ae58-5add53d7f637. Apr 22 17:55:24 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-655ddb9e-f852-412e-942b-3f1bf60cc156 tempest-VolumesActionsTest-84916959 None] Detach volume completed successfully. Apr 22 17:55:24 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-655ddb9e-f852-412e-942b-3f1bf60cc156 tempest-VolumesActionsTest-84916959 None] Lock "cinder-e3664582-4810-4ace-9346-f53375c65ed6-detach_volume" released by "detach_volume" :: held 0.070s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:55:24 devstack sudo[87691]: pam_unix(sudo:session): session closed for user root Apr 22 17:55:24 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-648c8f7f-1685-4a76-831a-c71980cec973 tempest-CreateVolumesFromImageTest-478817080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-689a0626-3452-4772-9c58-65dc083fb435" returned: 0 in 0.650s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:55:24 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-648c8f7f-1685-4a76-831a-c71980cec973 tempest-CreateVolumesFromImageTest-478817080 None] <== create_volume: return (1656ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'} {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 17:55:24 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-648c8f7f-1685-4a76-831a-c71980cec973 tempest-CreateVolumesFromImageTest-478817080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.661s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:55:24 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-f7bbd4ca-1067-4b03-8eb2-7207c74fdc2c tempest-CreateVolumesFromImageTest-478817080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.696s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:55:24 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-f7bbd4ca-1067-4b03-8eb2-7207c74fdc2c tempest-CreateVolumesFromImageTest-478817080 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:55:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-400205067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36d827f3-71a6-445c-959f-9f1f6e1e8ec6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2fff6c0cb364d189c469567b26f8a6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:55:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:55:21Z,use_quota=True,user_id='02703e1eb0d3464d8ffa7d946be94bf3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)}" {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 17:55:24 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-f7bbd4ca-1067-4b03-8eb2-7207c74fdc2c tempest-CreateVolumesFromImageTest-478817080 None] Creating volume 36d827f3-71a6-445c-959f-9f1f6e1e8ec6 {{(pid=81771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 17:55:24 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-f7bbd4ca-1067-4b03-8eb2-7207c74fdc2c tempest-CreateVolumesFromImageTest-478817080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:55:24 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-f7bbd4ca-1067-4b03-8eb2-7207c74fdc2c tempest-CreateVolumesFromImageTest-478817080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:55:24 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-f7bbd4ca-1067-4b03-8eb2-7207c74fdc2c tempest-CreateVolumesFromImageTest-478817080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:55:24 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-f7bbd4ca-1067-4b03-8eb2-7207c74fdc2c tempest-CreateVolumesFromImageTest-478817080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:55:24 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-f7bbd4ca-1067-4b03-8eb2-7207c74fdc2c tempest-CreateVolumesFromImageTest-478817080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:55:24 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-f7bbd4ca-1067-4b03-8eb2-7207c74fdc2c tempest-CreateVolumesFromImageTest-478817080 None] Selected osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 as target Quobyte volume. {{(pid=81771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 17:55:24 devstack cinder-volume[81771]: INFO cinder.volume.drivers.remotefs [None req-f7bbd4ca-1067-4b03-8eb2-7207c74fdc2c tempest-CreateVolumesFromImageTest-478817080 None] casted to osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 Apr 22 17:55:24 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-f7bbd4ca-1067-4b03-8eb2-7207c74fdc2c tempest-CreateVolumesFromImageTest-478817080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-36d827f3-71a6-445c-959f-9f1f6e1e8ec6 1073741824 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:55:24 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-648c8f7f-1685-4a76-831a-c71980cec973 tempest-CreateVolumesFromImageTest-478817080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e917960-2c09-46ba-be22-772ad9fa638d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-689a0626-3452-4772-9c58-65dc083fb435', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:55:24 devstack sudo[87696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-36d827f3-71a6-445c-959f-9f1f6e1e8ec6 1073741824 Apr 22 17:55:24 devstack sudo[87696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:55:24 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-648c8f7f-1685-4a76-831a-c71980cec973 tempest-CreateVolumesFromImageTest-478817080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1348313-a68a-441b-871e-a91d43e7d7da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:55:24 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-648c8f7f-1685-4a76-831a-c71980cec973 tempest-CreateVolumesFromImageTest-478817080 None] Volume volume-689a0626-3452-4772-9c58-65dc083fb435 (689a0626-3452-4772-9c58-65dc083fb435): created successfully Apr 22 17:55:24 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-648c8f7f-1685-4a76-831a-c71980cec973 tempest-CreateVolumesFromImageTest-478817080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1348313-a68a-441b-871e-a91d43e7d7da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:55:24 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-648c8f7f-1685-4a76-831a-c71980cec973 tempest-CreateVolumesFromImageTest-478817080 None] Flow 'volume_create_manager' (10312f89-d57b-4f3e-887c-3f352b096b9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:55:24 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-648c8f7f-1685-4a76-831a-c71980cec973 tempest-CreateVolumesFromImageTest-478817080 None] Created volume successfully. Apr 22 17:55:24 devstack sudo[87693]: pam_unix(sudo:session): session closed for user root Apr 22 17:55:24 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-0aadb9a1-2b67-450a-b420-aff7e5998aff tempest-GroupsTest-1625537742 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-12492feb-bc3b-4f9a-800c-35096ba94739" returned: 0 in 0.617s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:55:24 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-0aadb9a1-2b67-450a-b420-aff7e5998aff tempest-GroupsTest-1625537742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-12492feb-bc3b-4f9a-800c-35096ba94739 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:55:24 devstack sudo[87701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-12492feb-bc3b-4f9a-800c-35096ba94739 Apr 22 17:55:24 devstack sudo[87701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:55:25 devstack sudo[87701]: pam_unix(sudo:session): session closed for user root Apr 22 17:55:25 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-0aadb9a1-2b67-450a-b420-aff7e5998aff tempest-GroupsTest-1625537742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-12492feb-bc3b-4f9a-800c-35096ba94739" returned: 0 in 0.623s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:55:25 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-0aadb9a1-2b67-450a-b420-aff7e5998aff tempest-GroupsTest-1625537742 None] Lock "cinder-quobyte-12492feb-bc3b-4f9a-800c-35096ba94739" released by "delete_volume" :: held 1.316s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:55:25 devstack sudo[87696]: pam_unix(sudo:session): session closed for user root Apr 22 17:55:25 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-f7bbd4ca-1067-4b03-8eb2-7207c74fdc2c tempest-CreateVolumesFromImageTest-478817080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-36d827f3-71a6-445c-959f-9f1f6e1e8ec6 1073741824" returned: 0 in 0.901s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:55:25 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-0aadb9a1-2b67-450a-b420-aff7e5998aff tempest-GroupsTest-1625537742 None] Created reservations ['d00b95bf-ed43-462b-a82e-4f4a95ad0fa7'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 17:55:25 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-f7bbd4ca-1067-4b03-8eb2-7207c74fdc2c tempest-CreateVolumesFromImageTest-478817080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-36d827f3-71a6-445c-959f-9f1f6e1e8ec6 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:55:25 devstack cinder-volume[81771]: WARNING cinder.quota [None req-0aadb9a1-2b67-450a-b420-aff7e5998aff tempest-GroupsTest-1625537742 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-560957427 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-560957427, it is now deprecated. Please use the default quota class for default quota. Apr 22 17:55:25 devstack cinder-volume[81771]: WARNING cinder.quota [None req-0aadb9a1-2b67-450a-b420-aff7e5998aff tempest-GroupsTest-1625537742 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-560957427 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-560957427, it is now deprecated. Please use the default quota class for default quota. Apr 22 17:55:25 devstack sudo[87708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-36d827f3-71a6-445c-959f-9f1f6e1e8ec6 Apr 22 17:55:25 devstack sudo[87708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:55:25 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-0aadb9a1-2b67-450a-b420-aff7e5998aff tempest-GroupsTest-1625537742 None] Created reservations ['a9cf21e9-3b7e-42e4-89cc-84d7e4d179a4', '48473122-625f-4127-81cd-1a5d805611f7', '00f56bf2-4422-414f-a35e-2c4c07c034ce', '25059646-5755-475f-9f9e-bf60b78fc609'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 17:55:25 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-0aadb9a1-2b67-450a-b420-aff7e5998aff tempest-GroupsTest-1625537742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:55:25 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-0aadb9a1-2b67-450a-b420-aff7e5998aff tempest-GroupsTest-1625537742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:55:25 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-0aadb9a1-2b67-450a-b420-aff7e5998aff tempest-GroupsTest-1625537742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:55:25 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-0aadb9a1-2b67-450a-b420-aff7e5998aff tempest-GroupsTest-1625537742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:55:25 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-0aadb9a1-2b67-450a-b420-aff7e5998aff tempest-GroupsTest-1625537742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:55:25 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-0aadb9a1-2b67-450a-b420-aff7e5998aff tempest-GroupsTest-1625537742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:55:25 devstack sudo[87710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 Apr 22 17:55:25 devstack sudo[87710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:55:26 devstack sudo[87708]: pam_unix(sudo:session): session closed for user root Apr 22 17:55:26 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-f7bbd4ca-1067-4b03-8eb2-7207c74fdc2c tempest-CreateVolumesFromImageTest-478817080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-36d827f3-71a6-445c-959f-9f1f6e1e8ec6" returned: 0 in 0.525s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:55:26 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-f7bbd4ca-1067-4b03-8eb2-7207c74fdc2c tempest-CreateVolumesFromImageTest-478817080 None] <== create_volume: return (1482ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'} {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 17:55:26 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-f7bbd4ca-1067-4b03-8eb2-7207c74fdc2c tempest-CreateVolumesFromImageTest-478817080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.491s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:55:26 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-d8248e60-5fd9-4ecc-b6de-158f850fd302 tempest-CreateVolumesFromImageTest-478817080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.547s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:55:26 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-d8248e60-5fd9-4ecc-b6de-158f850fd302 tempest-CreateVolumesFromImageTest-478817080 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:55:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-884697288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae01bf4d-00ea-4fb2-b96c-3fc4ef1fb3c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2fff6c0cb364d189c469567b26f8a6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:55:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:55:21Z,use_quota=True,user_id='02703e1eb0d3464d8ffa7d946be94bf3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)}" {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 17:55:26 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-d8248e60-5fd9-4ecc-b6de-158f850fd302 tempest-CreateVolumesFromImageTest-478817080 None] Creating volume ae01bf4d-00ea-4fb2-b96c-3fc4ef1fb3c0 {{(pid=81771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 17:55:26 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-d8248e60-5fd9-4ecc-b6de-158f850fd302 tempest-CreateVolumesFromImageTest-478817080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:55:26 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-d8248e60-5fd9-4ecc-b6de-158f850fd302 tempest-CreateVolumesFromImageTest-478817080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:55:26 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-d8248e60-5fd9-4ecc-b6de-158f850fd302 tempest-CreateVolumesFromImageTest-478817080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:55:26 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-d8248e60-5fd9-4ecc-b6de-158f850fd302 tempest-CreateVolumesFromImageTest-478817080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:55:26 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-d8248e60-5fd9-4ecc-b6de-158f850fd302 tempest-CreateVolumesFromImageTest-478817080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:55:26 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-d8248e60-5fd9-4ecc-b6de-158f850fd302 tempest-CreateVolumesFromImageTest-478817080 None] Selected osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 as target Quobyte volume. {{(pid=81771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 17:55:26 devstack cinder-volume[81771]: INFO cinder.volume.drivers.remotefs [None req-d8248e60-5fd9-4ecc-b6de-158f850fd302 tempest-CreateVolumesFromImageTest-478817080 None] casted to osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 Apr 22 17:55:26 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-d8248e60-5fd9-4ecc-b6de-158f850fd302 tempest-CreateVolumesFromImageTest-478817080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-ae01bf4d-00ea-4fb2-b96c-3fc4ef1fb3c0 1073741824 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:55:26 devstack cinder-volume[81771]: DEBUG dbcounter [-] [81771] Writing DB stats cinder:SELECT=144,cinder:UPDATE=165,cinder:DELETE=11,cinder:INSERT=44 {{(pid=81771) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 22 17:55:26 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-f7bbd4ca-1067-4b03-8eb2-7207c74fdc2c tempest-CreateVolumesFromImageTest-478817080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3228703c-934f-4e8d-ad5f-90f72faa8e1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36d827f3-71a6-445c-959f-9f1f6e1e8ec6', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:55:26 devstack sudo[87713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-ae01bf4d-00ea-4fb2-b96c-3fc4ef1fb3c0 1073741824 Apr 22 17:55:26 devstack sudo[87713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:55:26 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-f7bbd4ca-1067-4b03-8eb2-7207c74fdc2c tempest-CreateVolumesFromImageTest-478817080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a969645-98fa-4a26-a600-b9584cc45cd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:55:26 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-f7bbd4ca-1067-4b03-8eb2-7207c74fdc2c tempest-CreateVolumesFromImageTest-478817080 None] Volume volume-36d827f3-71a6-445c-959f-9f1f6e1e8ec6 (36d827f3-71a6-445c-959f-9f1f6e1e8ec6): created successfully Apr 22 17:55:26 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-f7bbd4ca-1067-4b03-8eb2-7207c74fdc2c tempest-CreateVolumesFromImageTest-478817080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a969645-98fa-4a26-a600-b9584cc45cd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:55:26 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-f7bbd4ca-1067-4b03-8eb2-7207c74fdc2c tempest-CreateVolumesFromImageTest-478817080 None] Flow 'volume_create_manager' (e03b30f9-1436-47c2-be37-6425cd0c771f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:55:26 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-f7bbd4ca-1067-4b03-8eb2-7207c74fdc2c tempest-CreateVolumesFromImageTest-478817080 None] Created volume successfully. Apr 22 17:55:26 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-b0cdf532-4d32-4082-8124-d3af0776bbd2 tempest-GroupsTest-1625537742 None] Created reservations ['134bc725-c69d-4144-8dc9-21274e2f3ea4'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 17:55:26 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-b0cdf532-4d32-4082-8124-d3af0776bbd2 tempest-GroupsTest-1625537742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:55:26 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-b0cdf532-4d32-4082-8124-d3af0776bbd2 tempest-GroupsTest-1625537742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:55:26 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-b0cdf532-4d32-4082-8124-d3af0776bbd2 tempest-GroupsTest-1625537742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:55:26 devstack sudo[87710]: pam_unix(sudo:session): session closed for user root Apr 22 17:55:26 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-b0cdf532-4d32-4082-8124-d3af0776bbd2 tempest-GroupsTest-1625537742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:55:26 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-b0cdf532-4d32-4082-8124-d3af0776bbd2 tempest-GroupsTest-1625537742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:55:26 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-b0cdf532-4d32-4082-8124-d3af0776bbd2 tempest-GroupsTest-1625537742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:55:26 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-0aadb9a1-2b67-450a-b420-aff7e5998aff tempest-GroupsTest-1625537742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33" returned: 0 in 1.067s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:55:26 devstack cinder-volume[81771]: DEBUG cinder.manager [None req-0aadb9a1-2b67-450a-b420-aff7e5998aff tempest-GroupsTest-1625537742 None] Notifying Schedulers of capabilities ... {{(pid=81771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 17:55:26 devstack sudo[87746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 Apr 22 17:55:26 devstack sudo[87746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:55:26 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-0aadb9a1-2b67-450a-b420-aff7e5998aff tempest-GroupsTest-1625537742 None] Delete group completed successfully. Apr 22 17:55:27 devstack sudo[87713]: pam_unix(sudo:session): session closed for user root Apr 22 17:55:27 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-d8248e60-5fd9-4ecc-b6de-158f850fd302 tempest-CreateVolumesFromImageTest-478817080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-ae01bf4d-00ea-4fb2-b96c-3fc4ef1fb3c0 1073741824" returned: 0 in 1.041s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:55:27 devstack cinder-volume[81771]: DEBUG dbcounter [-] [81771] Writing DB stats cinder:UPDATE=152,cinder:SELECT=145,cinder:INSERT=41,cinder:DELETE=13 {{(pid=81771) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 22 17:55:27 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-d8248e60-5fd9-4ecc-b6de-158f850fd302 tempest-CreateVolumesFromImageTest-478817080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-ae01bf4d-00ea-4fb2-b96c-3fc4ef1fb3c0 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:55:27 devstack sudo[87753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-ae01bf4d-00ea-4fb2-b96c-3fc4ef1fb3c0 Apr 22 17:55:27 devstack sudo[87753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:55:27 devstack sudo[87746]: pam_unix(sudo:session): session closed for user root Apr 22 17:55:27 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-b0cdf532-4d32-4082-8124-d3af0776bbd2 tempest-GroupsTest-1625537742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33" returned: 0 in 0.579s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:55:27 devstack cinder-volume[81771]: DEBUG cinder.manager [None req-b0cdf532-4d32-4082-8124-d3af0776bbd2 tempest-GroupsTest-1625537742 None] Notifying Schedulers of capabilities ... {{(pid=81771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 17:55:27 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-b0cdf532-4d32-4082-8124-d3af0776bbd2 tempest-GroupsTest-1625537742 None] Delete group completed successfully. Apr 22 17:55:27 devstack sudo[87753]: pam_unix(sudo:session): session closed for user root Apr 22 17:55:27 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-d8248e60-5fd9-4ecc-b6de-158f850fd302 tempest-CreateVolumesFromImageTest-478817080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-ae01bf4d-00ea-4fb2-b96c-3fc4ef1fb3c0" returned: 0 in 0.495s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:55:27 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-d8248e60-5fd9-4ecc-b6de-158f850fd302 tempest-CreateVolumesFromImageTest-478817080 None] <== create_volume: return (1596ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'} {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 17:55:27 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-d8248e60-5fd9-4ecc-b6de-158f850fd302 tempest-CreateVolumesFromImageTest-478817080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.601s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:55:27 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-755bf0ee-8c59-4a59-96f2-f2940d15c5ff tempest-CreateVolumesFromImageTest-478817080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.782s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:55:27 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-755bf0ee-8c59-4a59-96f2-f2940d15c5ff tempest-CreateVolumesFromImageTest-478817080 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:55:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1428309701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30e3e625-1531-4632-a7f6-56ae9ce53715,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2fff6c0cb364d189c469567b26f8a6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:55:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:55:22Z,use_quota=True,user_id='02703e1eb0d3464d8ffa7d946be94bf3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)}" {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 17:55:27 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-755bf0ee-8c59-4a59-96f2-f2940d15c5ff tempest-CreateVolumesFromImageTest-478817080 None] Creating volume 30e3e625-1531-4632-a7f6-56ae9ce53715 {{(pid=81771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 17:55:27 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-755bf0ee-8c59-4a59-96f2-f2940d15c5ff tempest-CreateVolumesFromImageTest-478817080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:55:27 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-755bf0ee-8c59-4a59-96f2-f2940d15c5ff tempest-CreateVolumesFromImageTest-478817080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:55:27 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-755bf0ee-8c59-4a59-96f2-f2940d15c5ff tempest-CreateVolumesFromImageTest-478817080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:55:27 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-755bf0ee-8c59-4a59-96f2-f2940d15c5ff tempest-CreateVolumesFromImageTest-478817080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:55:27 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-755bf0ee-8c59-4a59-96f2-f2940d15c5ff tempest-CreateVolumesFromImageTest-478817080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:55:27 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-755bf0ee-8c59-4a59-96f2-f2940d15c5ff tempest-CreateVolumesFromImageTest-478817080 None] Selected osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 as target Quobyte volume. {{(pid=81771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 17:55:27 devstack cinder-volume[81771]: INFO cinder.volume.drivers.remotefs [None req-755bf0ee-8c59-4a59-96f2-f2940d15c5ff tempest-CreateVolumesFromImageTest-478817080 None] casted to osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 Apr 22 17:55:27 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-755bf0ee-8c59-4a59-96f2-f2940d15c5ff tempest-CreateVolumesFromImageTest-478817080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-30e3e625-1531-4632-a7f6-56ae9ce53715 1073741824 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:55:27 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-d8248e60-5fd9-4ecc-b6de-158f850fd302 tempest-CreateVolumesFromImageTest-478817080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d597198-b092-4a31-812b-abbc9a285ae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae01bf4d-00ea-4fb2-b96c-3fc4ef1fb3c0', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:55:27 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-d8248e60-5fd9-4ecc-b6de-158f850fd302 tempest-CreateVolumesFromImageTest-478817080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (effb0313-f185-4958-a229-dfe4823402d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:55:27 devstack sudo[87757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-30e3e625-1531-4632-a7f6-56ae9ce53715 1073741824 Apr 22 17:55:27 devstack sudo[87757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:55:27 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-d8248e60-5fd9-4ecc-b6de-158f850fd302 tempest-CreateVolumesFromImageTest-478817080 None] Volume volume-ae01bf4d-00ea-4fb2-b96c-3fc4ef1fb3c0 (ae01bf4d-00ea-4fb2-b96c-3fc4ef1fb3c0): created successfully Apr 22 17:55:27 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-d8248e60-5fd9-4ecc-b6de-158f850fd302 tempest-CreateVolumesFromImageTest-478817080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (effb0313-f185-4958-a229-dfe4823402d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:55:27 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-d8248e60-5fd9-4ecc-b6de-158f850fd302 tempest-CreateVolumesFromImageTest-478817080 None] Flow 'volume_create_manager' (013b804d-d973-4f4d-bc40-098f69b7bc47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:55:27 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-d8248e60-5fd9-4ecc-b6de-158f850fd302 tempest-CreateVolumesFromImageTest-478817080 None] Created volume successfully. Apr 22 17:55:28 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-111adb48-976f-42da-b16d-b51302472dd4 tempest-GroupsTest-1625537742 None] Group tempest-GroupsTest-Group-374173469: creating Apr 22 17:55:28 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-111adb48-976f-42da-b16d-b51302472dd4 tempest-GroupsTest-1625537742 None] Group tempest-GroupsTest-Group-374173469: created successfully Apr 22 17:55:28 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-111adb48-976f-42da-b16d-b51302472dd4 tempest-GroupsTest-1625537742 None] Create group completed successfully. Apr 22 17:55:28 devstack sudo[87757]: pam_unix(sudo:session): session closed for user root Apr 22 17:55:28 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-755bf0ee-8c59-4a59-96f2-f2940d15c5ff tempest-CreateVolumesFromImageTest-478817080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-30e3e625-1531-4632-a7f6-56ae9ce53715 1073741824" returned: 0 in 0.818s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:55:28 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-755bf0ee-8c59-4a59-96f2-f2940d15c5ff tempest-CreateVolumesFromImageTest-478817080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-30e3e625-1531-4632-a7f6-56ae9ce53715 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:55:28 devstack sudo[87764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-30e3e625-1531-4632-a7f6-56ae9ce53715 Apr 22 17:55:28 devstack sudo[87764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:55:29 devstack sudo[87764]: pam_unix(sudo:session): session closed for user root Apr 22 17:55:29 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-755bf0ee-8c59-4a59-96f2-f2940d15c5ff tempest-CreateVolumesFromImageTest-478817080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-30e3e625-1531-4632-a7f6-56ae9ce53715" returned: 0 in 0.477s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:55:29 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-755bf0ee-8c59-4a59-96f2-f2940d15c5ff tempest-CreateVolumesFromImageTest-478817080 None] <== create_volume: return (1334ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'} {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 17:55:29 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-755bf0ee-8c59-4a59-96f2-f2940d15c5ff tempest-CreateVolumesFromImageTest-478817080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.337s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:55:29 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-f486539a-2ff6-4dd1-b847-1428133bc9fe tempest-CreateVolumesFromImageTest-478817080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.775s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:55:29 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-f486539a-2ff6-4dd1-b847-1428133bc9fe tempest-CreateVolumesFromImageTest-478817080 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:55:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1862867914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a12c8e45-6bf5-4ad3-a0ba-b97e0bf5557e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2fff6c0cb364d189c469567b26f8a6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:55:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:55:22Z,use_quota=True,user_id='02703e1eb0d3464d8ffa7d946be94bf3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)}" {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 17:55:29 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-f486539a-2ff6-4dd1-b847-1428133bc9fe tempest-CreateVolumesFromImageTest-478817080 None] Creating volume a12c8e45-6bf5-4ad3-a0ba-b97e0bf5557e {{(pid=81771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 17:55:29 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-f486539a-2ff6-4dd1-b847-1428133bc9fe tempest-CreateVolumesFromImageTest-478817080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:55:29 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-f486539a-2ff6-4dd1-b847-1428133bc9fe tempest-CreateVolumesFromImageTest-478817080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:55:29 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-f486539a-2ff6-4dd1-b847-1428133bc9fe tempest-CreateVolumesFromImageTest-478817080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:55:29 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-f486539a-2ff6-4dd1-b847-1428133bc9fe tempest-CreateVolumesFromImageTest-478817080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:55:29 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-f486539a-2ff6-4dd1-b847-1428133bc9fe tempest-CreateVolumesFromImageTest-478817080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:55:29 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-f486539a-2ff6-4dd1-b847-1428133bc9fe tempest-CreateVolumesFromImageTest-478817080 None] Selected osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 as target Quobyte volume. {{(pid=81771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 17:55:29 devstack cinder-volume[81771]: INFO cinder.volume.drivers.remotefs [None req-f486539a-2ff6-4dd1-b847-1428133bc9fe tempest-CreateVolumesFromImageTest-478817080 None] casted to osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 Apr 22 17:55:29 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-f486539a-2ff6-4dd1-b847-1428133bc9fe tempest-CreateVolumesFromImageTest-478817080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a12c8e45-6bf5-4ad3-a0ba-b97e0bf5557e 1073741824 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:55:29 devstack sudo[87767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a12c8e45-6bf5-4ad3-a0ba-b97e0bf5557e 1073741824 Apr 22 17:55:29 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-755bf0ee-8c59-4a59-96f2-f2940d15c5ff tempest-CreateVolumesFromImageTest-478817080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c2d3622-0bdd-460b-b353-9658d4324ca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30e3e625-1531-4632-a7f6-56ae9ce53715', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:55:29 devstack sudo[87767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:55:29 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-755bf0ee-8c59-4a59-96f2-f2940d15c5ff tempest-CreateVolumesFromImageTest-478817080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76dfa050-2195-4613-bf25-306b58620a0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:55:29 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-755bf0ee-8c59-4a59-96f2-f2940d15c5ff tempest-CreateVolumesFromImageTest-478817080 None] Volume volume-30e3e625-1531-4632-a7f6-56ae9ce53715 (30e3e625-1531-4632-a7f6-56ae9ce53715): created successfully Apr 22 17:55:29 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-755bf0ee-8c59-4a59-96f2-f2940d15c5ff tempest-CreateVolumesFromImageTest-478817080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76dfa050-2195-4613-bf25-306b58620a0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:55:29 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-755bf0ee-8c59-4a59-96f2-f2940d15c5ff tempest-CreateVolumesFromImageTest-478817080 None] Flow 'volume_create_manager' (eb3dda75-66c5-4ea2-a6c8-b7deedbdfb88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:55:29 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-755bf0ee-8c59-4a59-96f2-f2940d15c5ff tempest-CreateVolumesFromImageTest-478817080 None] Created volume successfully. Apr 22 17:55:29 devstack cinder-volume[81771]: DEBUG cinder.volume.flows.manager.create_volume [None req-834e1ab0-a45d-494f-9713-f88292070efe tempest-GroupsTest-1625537742 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 17:55:29 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-834e1ab0-a45d-494f-9713-f88292070efe tempest-GroupsTest-1625537742 None] Flow 'volume_create_manager' (1beea38e-92f1-47d1-9674-4f3a5f623ce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:55:29 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-834e1ab0-a45d-494f-9713-f88292070efe tempest-GroupsTest-1625537742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (323180c9-9213-4d64-b399-17202ba4ef3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:55:29 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-834e1ab0-a45d-494f-9713-f88292070efe tempest-GroupsTest-1625537742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (323180c9-9213-4d64-b399-17202ba4ef3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:55:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-696453445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7f45486e-9052-494b-8e29-081f537d5029,host='devstack@QuobyteHD#QuobyteHD',id=23b808ca-c7cb-46e7-baaa-7b10fc5231b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbd20e328ab94b02a81e783994305701',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:55:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:55:30Z,use_quota=True,user_id='a76a7c73186547ee8d70613c7ca959bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed0bc887-8332-4846-a104-b4d09130bb28),volume_type_id=ed0bc887-8332-4846-a104-b4d09130bb28)' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:55:29 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-834e1ab0-a45d-494f-9713-f88292070efe tempest-GroupsTest-1625537742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b40adaaa-5174-412c-a064-b5004d1f491b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:55:29 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-834e1ab0-a45d-494f-9713-f88292070efe tempest-GroupsTest-1625537742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b40adaaa-5174-412c-a064-b5004d1f491b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:55:29 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-834e1ab0-a45d-494f-9713-f88292070efe tempest-GroupsTest-1625537742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9f97592-9d54-44d2-9aae-f3f4668a3441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:55:29 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-834e1ab0-a45d-494f-9713-f88292070efe tempest-GroupsTest-1625537742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9f97592-9d54-44d2-9aae-f3f4668a3441) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23b808ca-c7cb-46e7-baaa-7b10fc5231b7', 'volume_name': 'volume-23b808ca-c7cb-46e7-baaa-7b10fc5231b7', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:55:29 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-834e1ab0-a45d-494f-9713-f88292070efe tempest-GroupsTest-1625537742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12c3514f-dd15-46f6-bbc4-585396ce69e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:55:29 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-834e1ab0-a45d-494f-9713-f88292070efe tempest-GroupsTest-1625537742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12c3514f-dd15-46f6-bbc4-585396ce69e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:55:29 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-834e1ab0-a45d-494f-9713-f88292070efe tempest-GroupsTest-1625537742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2063ff8-7752-4176-a6a5-3746b1a515bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:55:29 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-834e1ab0-a45d-494f-9713-f88292070efe tempest-GroupsTest-1625537742 None] Volume 23b808ca-c7cb-46e7-baaa-7b10fc5231b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23b808ca-c7cb-46e7-baaa-7b10fc5231b7', 'volume_size': 1} Apr 22 17:55:29 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-834e1ab0-a45d-494f-9713-f88292070efe tempest-GroupsTest-1625537742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:55:29 devstack cinder-volume[81771]: DEBUG oslo_service.periodic_task [None req-1a7bdab5-8190-4e00-a2e2-843e5894ab49 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81771) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 22 17:55:29 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-1a7bdab5-8190-4e00-a2e2-843e5894ab49 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:55:29 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-1a7bdab5-8190-4e00-a2e2-843e5894ab49 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:55:29 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-1a7bdab5-8190-4e00-a2e2-843e5894ab49 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:55:29 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-1a7bdab5-8190-4e00-a2e2-843e5894ab49 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:55:29 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-1a7bdab5-8190-4e00-a2e2-843e5894ab49 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:55:29 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-1a7bdab5-8190-4e00-a2e2-843e5894ab49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:55:29 devstack sudo[87767]: pam_unix(sudo:session): session closed for user root Apr 22 17:55:29 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-f486539a-2ff6-4dd1-b847-1428133bc9fe tempest-CreateVolumesFromImageTest-478817080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a12c8e45-6bf5-4ad3-a0ba-b97e0bf5557e 1073741824" returned: 0 in 0.761s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:55:29 devstack sudo[87778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 Apr 22 17:55:29 devstack sudo[87778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:55:29 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-f486539a-2ff6-4dd1-b847-1428133bc9fe tempest-CreateVolumesFromImageTest-478817080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a12c8e45-6bf5-4ad3-a0ba-b97e0bf5557e {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:55:29 devstack sudo[87780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a12c8e45-6bf5-4ad3-a0ba-b97e0bf5557e Apr 22 17:55:29 devstack sudo[87780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:55:30 devstack sudo[87778]: pam_unix(sudo:session): session closed for user root Apr 22 17:55:30 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-1a7bdab5-8190-4e00-a2e2-843e5894ab49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33" returned: 0 in 0.512s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:55:30 devstack cinder-volume[81771]: DEBUG cinder.manager [None req-1a7bdab5-8190-4e00-a2e2-843e5894ab49 None None] Notifying Schedulers of capabilities ... {{(pid=81771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 17:55:30 devstack sudo[87780]: pam_unix(sudo:session): session closed for user root Apr 22 17:55:30 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-f486539a-2ff6-4dd1-b847-1428133bc9fe tempest-CreateVolumesFromImageTest-478817080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a12c8e45-6bf5-4ad3-a0ba-b97e0bf5557e" returned: 0 in 0.482s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:55:30 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-f486539a-2ff6-4dd1-b847-1428133bc9fe tempest-CreateVolumesFromImageTest-478817080 None] <== create_volume: return (1281ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'} {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 17:55:30 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-f486539a-2ff6-4dd1-b847-1428133bc9fe tempest-CreateVolumesFromImageTest-478817080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.284s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:55:30 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-6c6746f7-e6ba-4635-9ad8-9b9ce5bdf227 tempest-VolumesDeleteCascade-308204417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.753s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:55:30 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-f486539a-2ff6-4dd1-b847-1428133bc9fe tempest-CreateVolumesFromImageTest-478817080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a1d9584-7ea9-465c-bb45-c921790b5dd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a12c8e45-6bf5-4ad3-a0ba-b97e0bf5557e', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:55:30 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-f486539a-2ff6-4dd1-b847-1428133bc9fe tempest-CreateVolumesFromImageTest-478817080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (010d440b-04e4-459c-9000-c57a10bd630d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:55:30 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-6c6746f7-e6ba-4635-9ad8-9b9ce5bdf227 tempest-VolumesDeleteCascade-308204417 None] Creating offline snapshot ab65faa6-4e14-48a0-bcad-7e6d86403757 of volume 667b3cea-3545-4dde-b030-251b7d9c761a {{(pid=81771) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 22 17:55:30 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-f486539a-2ff6-4dd1-b847-1428133bc9fe tempest-CreateVolumesFromImageTest-478817080 None] Volume volume-a12c8e45-6bf5-4ad3-a0ba-b97e0bf5557e (a12c8e45-6bf5-4ad3-a0ba-b97e0bf5557e): created successfully Apr 22 17:55:30 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-f486539a-2ff6-4dd1-b847-1428133bc9fe tempest-CreateVolumesFromImageTest-478817080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (010d440b-04e4-459c-9000-c57a10bd630d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:55:30 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-f486539a-2ff6-4dd1-b847-1428133bc9fe tempest-CreateVolumesFromImageTest-478817080 None] Flow 'volume_create_manager' (dd9c7210-d1ae-4b98-b231-b369a84c8d1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:55:30 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[4db7213c-fd68-45de-b9e5-632eb920b471]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:55:30 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-6c6746f7-e6ba-4635-9ad8-9b9ce5bdf227 tempest-VolumesDeleteCascade-308204417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-667b3cea-3545-4dde-b030-251b7d9c761a.d43e6202-6d1c-443d-a2bf-a097013d0aed {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:55:30 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-f486539a-2ff6-4dd1-b847-1428133bc9fe tempest-CreateVolumesFromImageTest-478817080 None] Created volume successfully. Apr 22 17:55:30 devstack sudo[87784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-667b3cea-3545-4dde-b030-251b7d9c761a.d43e6202-6d1c-443d-a2bf-a097013d0aed Apr 22 17:55:30 devstack sudo[87784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:55:31 devstack sudo[87784]: pam_unix(sudo:session): session closed for user root Apr 22 17:55:31 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-6c6746f7-e6ba-4635-9ad8-9b9ce5bdf227 tempest-VolumesDeleteCascade-308204417 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-667b3cea-3545-4dde-b030-251b7d9c761a.d43e6202-6d1c-443d-a2bf-a097013d0aed" returned: 0 in 0.562s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:55:31 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-6c6746f7-e6ba-4635-9ad8-9b9ce5bdf227 tempest-VolumesDeleteCascade-308204417 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-667b3cea-3545-4dde-b030-251b7d9c761a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81771) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 22 17:55:31 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-6c6746f7-e6ba-4635-9ad8-9b9ce5bdf227 tempest-VolumesDeleteCascade-308204417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-667b3cea-3545-4dde-b030-251b7d9c761a.d43e6202-6d1c-443d-a2bf-a097013d0aed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-667b3cea-3545-4dde-b030-251b7d9c761a.ab65faa6-4e14-48a0-bcad-7e6d86403757 1G {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:55:31 devstack sudo[87789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-667b3cea-3545-4dde-b030-251b7d9c761a.d43e6202-6d1c-443d-a2bf-a097013d0aed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-667b3cea-3545-4dde-b030-251b7d9c761a.ab65faa6-4e14-48a0-bcad-7e6d86403757 1G Apr 22 17:55:31 devstack sudo[87789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:55:31 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-20327013-c4b4-4fe2-9101-2937d1dc0564 tempest-CreateVolumesFromImageTest-478817080 None] Acquiring lock "cinder-a12c8e45-6bf5-4ad3-a0ba-b97e0bf5557e-delete_volume" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:55:31 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-20327013-c4b4-4fe2-9101-2937d1dc0564 tempest-CreateVolumesFromImageTest-478817080 None] Lock "cinder-a12c8e45-6bf5-4ad3-a0ba-b97e0bf5557e-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:55:31 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-20327013-c4b4-4fe2-9101-2937d1dc0564 tempest-CreateVolumesFromImageTest-478817080 None] Acquiring lock "cinder-quobyte-a12c8e45-6bf5-4ad3-a0ba-b97e0bf5557e" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:55:31 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-20327013-c4b4-4fe2-9101-2937d1dc0564 tempest-CreateVolumesFromImageTest-478817080 None] Lock "cinder-quobyte-a12c8e45-6bf5-4ad3-a0ba-b97e0bf5557e" acquired by "delete_volume" :: waited 0.024s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:55:31 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f88843f-7ac1-4a8e-8df7-9379ca99ae96]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:55:31 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-20327013-c4b4-4fe2-9101-2937d1dc0564 tempest-CreateVolumesFromImageTest-478817080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a12c8e45-6bf5-4ad3-a0ba-b97e0bf5557e {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:55:31 devstack sudo[87791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a12c8e45-6bf5-4ad3-a0ba-b97e0bf5557e Apr 22 17:55:31 devstack sudo[87791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:55:31 devstack sudo[87789]: pam_unix(sudo:session): session closed for user root Apr 22 17:55:31 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-6c6746f7-e6ba-4635-9ad8-9b9ce5bdf227 tempest-VolumesDeleteCascade-308204417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-667b3cea-3545-4dde-b030-251b7d9c761a.d43e6202-6d1c-443d-a2bf-a097013d0aed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-667b3cea-3545-4dde-b030-251b7d9c761a.ab65faa6-4e14-48a0-bcad-7e6d86403757 1G" returned: 0 in 0.692s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:55:31 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-6c6746f7-e6ba-4635-9ad8-9b9ce5bdf227 tempest-VolumesDeleteCascade-308204417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-667b3cea-3545-4dde-b030-251b7d9c761a.d43e6202-6d1c-443d-a2bf-a097013d0aed -F qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-667b3cea-3545-4dde-b030-251b7d9c761a.ab65faa6-4e14-48a0-bcad-7e6d86403757 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:55:31 devstack sudo[87797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-667b3cea-3545-4dde-b030-251b7d9c761a.d43e6202-6d1c-443d-a2bf-a097013d0aed -F qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-667b3cea-3545-4dde-b030-251b7d9c761a.ab65faa6-4e14-48a0-bcad-7e6d86403757 Apr 22 17:55:31 devstack sudo[87797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:55:31 devstack sudo[87791]: pam_unix(sudo:session): session closed for user root Apr 22 17:55:32 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-20327013-c4b4-4fe2-9101-2937d1dc0564 tempest-CreateVolumesFromImageTest-478817080 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a12c8e45-6bf5-4ad3-a0ba-b97e0bf5557e" returned: 0 in 0.628s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:55:32 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-20327013-c4b4-4fe2-9101-2937d1dc0564 tempest-CreateVolumesFromImageTest-478817080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a12c8e45-6bf5-4ad3-a0ba-b97e0bf5557e {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:55:32 devstack sudo[87802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a12c8e45-6bf5-4ad3-a0ba-b97e0bf5557e Apr 22 17:55:32 devstack sudo[87802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:55:32 devstack sudo[87797]: pam_unix(sudo:session): session closed for user root Apr 22 17:55:32 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-6c6746f7-e6ba-4635-9ad8-9b9ce5bdf227 tempest-VolumesDeleteCascade-308204417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-667b3cea-3545-4dde-b030-251b7d9c761a.d43e6202-6d1c-443d-a2bf-a097013d0aed -F qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-667b3cea-3545-4dde-b030-251b7d9c761a.ab65faa6-4e14-48a0-bcad-7e6d86403757" returned: 0 in 0.576s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:55:32 devstack cinder-volume[81771]: WARNING cinder.volume.drivers.remotefs [None req-6c6746f7-e6ba-4635-9ad8-9b9ce5bdf227 tempest-VolumesDeleteCascade-308204417 None] /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-667b3cea-3545-4dde-b030-251b7d9c761a.ab65faa6-4e14-48a0-bcad-7e6d86403757 is being set with open permissions: ugo+rw Apr 22 17:55:32 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-6c6746f7-e6ba-4635-9ad8-9b9ce5bdf227 tempest-VolumesDeleteCascade-308204417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-667b3cea-3545-4dde-b030-251b7d9c761a.ab65faa6-4e14-48a0-bcad-7e6d86403757 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:55:32 devstack sudo[87807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-667b3cea-3545-4dde-b030-251b7d9c761a.ab65faa6-4e14-48a0-bcad-7e6d86403757 Apr 22 17:55:32 devstack sudo[87807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:55:32 devstack sudo[87802]: pam_unix(sudo:session): session closed for user root Apr 22 17:55:32 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-20327013-c4b4-4fe2-9101-2937d1dc0564 tempest-CreateVolumesFromImageTest-478817080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a12c8e45-6bf5-4ad3-a0ba-b97e0bf5557e" returned: 0 in 0.517s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:55:32 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-20327013-c4b4-4fe2-9101-2937d1dc0564 tempest-CreateVolumesFromImageTest-478817080 None] Lock "cinder-quobyte-a12c8e45-6bf5-4ad3-a0ba-b97e0bf5557e" released by "delete_volume" :: held 1.186s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:55:32 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-20327013-c4b4-4fe2-9101-2937d1dc0564 tempest-CreateVolumesFromImageTest-478817080 None] Created reservations ['6d2cf19b-1488-4954-8e0a-c26a784101b4', '900cbf24-9c88-44d6-b91d-82651ef33041', '4407ddd8-75ac-44d4-ae6a-9f45490b0d43', 'a5f676cf-70df-4416-bdb5-629bba59d7c2'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 17:55:32 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-20327013-c4b4-4fe2-9101-2937d1dc0564 tempest-CreateVolumesFromImageTest-478817080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:55:32 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-20327013-c4b4-4fe2-9101-2937d1dc0564 tempest-CreateVolumesFromImageTest-478817080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:55:32 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-20327013-c4b4-4fe2-9101-2937d1dc0564 tempest-CreateVolumesFromImageTest-478817080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:55:32 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-20327013-c4b4-4fe2-9101-2937d1dc0564 tempest-CreateVolumesFromImageTest-478817080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:55:32 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-20327013-c4b4-4fe2-9101-2937d1dc0564 tempest-CreateVolumesFromImageTest-478817080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:55:32 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-20327013-c4b4-4fe2-9101-2937d1dc0564 tempest-CreateVolumesFromImageTest-478817080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:55:32 devstack sudo[87810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 Apr 22 17:55:32 devstack sudo[87810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:55:32 devstack sudo[87807]: pam_unix(sudo:session): session closed for user root Apr 22 17:55:32 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-6c6746f7-e6ba-4635-9ad8-9b9ce5bdf227 tempest-VolumesDeleteCascade-308204417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-667b3cea-3545-4dde-b030-251b7d9c761a.ab65faa6-4e14-48a0-bcad-7e6d86403757" returned: 0 in 0.509s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:55:32 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-6c6746f7-e6ba-4635-9ad8-9b9ce5bdf227 tempest-VolumesDeleteCascade-308204417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.463s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:55:32 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-834e1ab0-a45d-494f-9713-f88292070efe tempest-GroupsTest-1625537742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.011s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:55:32 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-834e1ab0-a45d-494f-9713-f88292070efe tempest-GroupsTest-1625537742 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7f45486e-9052-494b-8e29-081f537d5029,created_at=2026-04-22T15:55:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-696453445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7f45486e-9052-494b-8e29-081f537d5029,host='devstack@QuobyteHD#QuobyteHD',id=23b808ca-c7cb-46e7-baaa-7b10fc5231b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbd20e328ab94b02a81e783994305701',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:55:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:55:30Z,use_quota=True,user_id='a76a7c73186547ee8d70613c7ca959bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed0bc887-8332-4846-a104-b4d09130bb28),volume_type_id=ed0bc887-8332-4846-a104-b4d09130bb28)}" {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 17:55:32 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-834e1ab0-a45d-494f-9713-f88292070efe tempest-GroupsTest-1625537742 None] Creating volume 23b808ca-c7cb-46e7-baaa-7b10fc5231b7 {{(pid=81771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 17:55:32 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-834e1ab0-a45d-494f-9713-f88292070efe tempest-GroupsTest-1625537742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:55:32 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-834e1ab0-a45d-494f-9713-f88292070efe tempest-GroupsTest-1625537742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:55:32 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-834e1ab0-a45d-494f-9713-f88292070efe tempest-GroupsTest-1625537742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:55:32 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-834e1ab0-a45d-494f-9713-f88292070efe tempest-GroupsTest-1625537742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:55:32 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-834e1ab0-a45d-494f-9713-f88292070efe tempest-GroupsTest-1625537742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:55:32 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-834e1ab0-a45d-494f-9713-f88292070efe tempest-GroupsTest-1625537742 None] Selected osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 as target Quobyte volume. {{(pid=81771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 17:55:32 devstack cinder-volume[81771]: INFO cinder.volume.drivers.remotefs [None req-834e1ab0-a45d-494f-9713-f88292070efe tempest-GroupsTest-1625537742 None] casted to osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 Apr 22 17:55:32 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-834e1ab0-a45d-494f-9713-f88292070efe tempest-GroupsTest-1625537742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-23b808ca-c7cb-46e7-baaa-7b10fc5231b7 1073741824 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:55:32 devstack sudo[87813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-23b808ca-c7cb-46e7-baaa-7b10fc5231b7 1073741824 Apr 22 17:55:32 devstack sudo[87813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:55:32 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-6c6746f7-e6ba-4635-9ad8-9b9ce5bdf227 tempest-VolumesDeleteCascade-308204417 None] Create snapshot completed successfully Apr 22 17:55:33 devstack sudo[87810]: pam_unix(sudo:session): session closed for user root Apr 22 17:55:33 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-20327013-c4b4-4fe2-9101-2937d1dc0564 tempest-CreateVolumesFromImageTest-478817080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33" returned: 0 in 0.526s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:55:33 devstack cinder-volume[81771]: DEBUG cinder.manager [None req-20327013-c4b4-4fe2-9101-2937d1dc0564 tempest-CreateVolumesFromImageTest-478817080 None] Notifying Schedulers of capabilities ... {{(pid=81771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 17:55:33 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-20327013-c4b4-4fe2-9101-2937d1dc0564 tempest-CreateVolumesFromImageTest-478817080 None] Deleted volume successfully. Apr 22 17:55:33 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-20327013-c4b4-4fe2-9101-2937d1dc0564 tempest-CreateVolumesFromImageTest-478817080 None] Lock "cinder-a12c8e45-6bf5-4ad3-a0ba-b97e0bf5557e-delete_volume" released by "delete_volume" :: held 1.932s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:55:33 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-6aefc87a-0900-4f37-9c4d-31e59eff58ce tempest-VolumesDeleteCascade-308204417 None] Acquiring lock "cinder-667b3cea-3545-4dde-b030-251b7d9c761a-delete_volume" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:55:33 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-6aefc87a-0900-4f37-9c4d-31e59eff58ce tempest-VolumesDeleteCascade-308204417 None] Lock "cinder-667b3cea-3545-4dde-b030-251b7d9c761a-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:55:33 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-6aefc87a-0900-4f37-9c4d-31e59eff58ce tempest-VolumesDeleteCascade-308204417 None] Performing cascade delete. {{(pid=81771) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 22 17:55:33 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-6aefc87a-0900-4f37-9c4d-31e59eff58ce tempest-VolumesDeleteCascade-308204417 None] Acquiring lock "cinder-ab65faa6-4e14-48a0-bcad-7e6d86403757-delete_snapshot" by "delete_snapshot" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:55:33 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-6aefc87a-0900-4f37-9c4d-31e59eff58ce tempest-VolumesDeleteCascade-308204417 None] Lock "cinder-ab65faa6-4e14-48a0-bcad-7e6d86403757-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:55:33 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-6aefc87a-0900-4f37-9c4d-31e59eff58ce tempest-VolumesDeleteCascade-308204417 None] Acquiring lock "cinder-quobyte-667b3cea-3545-4dde-b030-251b7d9c761a" by "delete_snapshot" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:55:33 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-6aefc87a-0900-4f37-9c4d-31e59eff58ce tempest-VolumesDeleteCascade-308204417 None] Lock "cinder-quobyte-667b3cea-3545-4dde-b030-251b7d9c761a" acquired by "delete_snapshot" :: waited 0.019s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:55:33 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-6aefc87a-0900-4f37-9c4d-31e59eff58ce tempest-VolumesDeleteCascade-308204417 None] Acquiring lock "cinder-quobyte-ab65faa6-4e14-48a0-bcad-7e6d86403757" by "_delete_snapshot" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:55:33 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-6aefc87a-0900-4f37-9c4d-31e59eff58ce tempest-VolumesDeleteCascade-308204417 None] Lock "cinder-quobyte-ab65faa6-4e14-48a0-bcad-7e6d86403757" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:55:33 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-6aefc87a-0900-4f37-9c4d-31e59eff58ce tempest-VolumesDeleteCascade-308204417 None] Deleting offline snapshot ab65faa6-4e14-48a0-bcad-7e6d86403757 of volume 667b3cea-3545-4dde-b030-251b7d9c761a {{(pid=81771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 22 17:55:33 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-6aefc87a-0900-4f37-9c4d-31e59eff58ce tempest-VolumesDeleteCascade-308204417 None] snapshot_file for this snap is: volume-667b3cea-3545-4dde-b030-251b7d9c761a.ab65faa6-4e14-48a0-bcad-7e6d86403757 {{(pid=81771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 22 17:55:33 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[b884ec8e-5818-4e46-aa69-b6efc8499baa]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:55:33 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-6aefc87a-0900-4f37-9c4d-31e59eff58ce tempest-VolumesDeleteCascade-308204417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-667b3cea-3545-4dde-b030-251b7d9c761a.ab65faa6-4e14-48a0-bcad-7e6d86403757 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:55:33 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-07ee1c6e-7063-40b7-baf4-2609091e44c5 tempest-CreateVolumesFromImageTest-478817080 None] Acquiring lock "cinder-30e3e625-1531-4632-a7f6-56ae9ce53715-delete_volume" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:55:33 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-07ee1c6e-7063-40b7-baf4-2609091e44c5 tempest-CreateVolumesFromImageTest-478817080 None] Lock "cinder-30e3e625-1531-4632-a7f6-56ae9ce53715-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:55:33 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-b8166595-bcfe-4fb5-855b-0f90cddf9c5c tempest-VolumesActionsTest-84916959 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:55:33 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-07ee1c6e-7063-40b7-baf4-2609091e44c5 tempest-CreateVolumesFromImageTest-478817080 None] Acquiring lock "cinder-quobyte-30e3e625-1531-4632-a7f6-56ae9ce53715" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:55:33 devstack sudo[87819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-667b3cea-3545-4dde-b030-251b7d9c761a.ab65faa6-4e14-48a0-bcad-7e6d86403757 Apr 22 17:55:33 devstack sudo[87819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:55:33 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-07ee1c6e-7063-40b7-baf4-2609091e44c5 tempest-CreateVolumesFromImageTest-478817080 None] Lock "cinder-quobyte-30e3e625-1531-4632-a7f6-56ae9ce53715" acquired by "delete_volume" :: waited 0.019s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:55:33 devstack sudo[87813]: pam_unix(sudo:session): session closed for user root Apr 22 17:55:33 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b644279-3e0c-468a-bc4b-3530ef2776d0]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:55:33 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-07ee1c6e-7063-40b7-baf4-2609091e44c5 tempest-CreateVolumesFromImageTest-478817080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-30e3e625-1531-4632-a7f6-56ae9ce53715 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:55:33 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-834e1ab0-a45d-494f-9713-f88292070efe tempest-GroupsTest-1625537742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-23b808ca-c7cb-46e7-baaa-7b10fc5231b7 1073741824" returned: 0 in 0.803s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:55:33 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-834e1ab0-a45d-494f-9713-f88292070efe tempest-GroupsTest-1625537742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-23b808ca-c7cb-46e7-baaa-7b10fc5231b7 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:55:33 devstack sudo[87822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-23b808ca-c7cb-46e7-baaa-7b10fc5231b7 Apr 22 17:55:33 devstack sudo[87822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:55:33 devstack sudo[87821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-30e3e625-1531-4632-a7f6-56ae9ce53715 Apr 22 17:55:33 devstack sudo[87821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:55:34 devstack sudo[87819]: pam_unix(sudo:session): session closed for user root Apr 22 17:55:34 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-6aefc87a-0900-4f37-9c4d-31e59eff58ce tempest-VolumesDeleteCascade-308204417 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-667b3cea-3545-4dde-b030-251b7d9c761a.ab65faa6-4e14-48a0-bcad-7e6d86403757" returned: 0 in 0.614s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:55:34 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-6aefc87a-0900-4f37-9c4d-31e59eff58ce tempest-VolumesDeleteCascade-308204417 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-667b3cea-3545-4dde-b030-251b7d9c761a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81771) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 22 17:55:34 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb47a3e1-f850-4987-af3a-28a192501abf]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:55:34 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-6aefc87a-0900-4f37-9c4d-31e59eff58ce tempest-VolumesDeleteCascade-308204417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-667b3cea-3545-4dde-b030-251b7d9c761a.d43e6202-6d1c-443d-a2bf-a097013d0aed {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:55:34 devstack sudo[87822]: pam_unix(sudo:session): session closed for user root Apr 22 17:55:34 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-834e1ab0-a45d-494f-9713-f88292070efe tempest-GroupsTest-1625537742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-23b808ca-c7cb-46e7-baaa-7b10fc5231b7" returned: 0 in 0.495s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:55:34 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-834e1ab0-a45d-494f-9713-f88292070efe tempest-GroupsTest-1625537742 None] <== create_volume: return (1343ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'} {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 17:55:34 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-834e1ab0-a45d-494f-9713-f88292070efe tempest-GroupsTest-1625537742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.345s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:55:34 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-b8166595-bcfe-4fb5-855b-0f90cddf9c5c tempest-VolumesActionsTest-84916959 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.609s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:55:34 devstack sudo[87821]: pam_unix(sudo:session): session closed for user root Apr 22 17:55:34 devstack sudo[87832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-667b3cea-3545-4dde-b030-251b7d9c761a.d43e6202-6d1c-443d-a2bf-a097013d0aed Apr 22 17:55:34 devstack sudo[87832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:55:34 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-834e1ab0-a45d-494f-9713-f88292070efe tempest-GroupsTest-1625537742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2063ff8-7752-4176-a6a5-3746b1a515bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23b808ca-c7cb-46e7-baaa-7b10fc5231b7', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:55:34 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-834e1ab0-a45d-494f-9713-f88292070efe tempest-GroupsTest-1625537742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (222353a6-1585-4225-936b-5a54f2da22ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:55:34 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0e5b46d-da72-4c7a-bef7-282413f328f6]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:55:34 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-b8166595-bcfe-4fb5-855b-0f90cddf9c5c tempest-VolumesActionsTest-84916959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e3664582-4810-4ace-9346-f53375c65ed6 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:55:34 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-07ee1c6e-7063-40b7-baf4-2609091e44c5 tempest-CreateVolumesFromImageTest-478817080 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-30e3e625-1531-4632-a7f6-56ae9ce53715" returned: 0 in 0.582s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:55:34 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-07ee1c6e-7063-40b7-baf4-2609091e44c5 tempest-CreateVolumesFromImageTest-478817080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-30e3e625-1531-4632-a7f6-56ae9ce53715 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:55:34 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-834e1ab0-a45d-494f-9713-f88292070efe tempest-GroupsTest-1625537742 None] Volume volume-23b808ca-c7cb-46e7-baaa-7b10fc5231b7 (23b808ca-c7cb-46e7-baaa-7b10fc5231b7): created successfully Apr 22 17:55:34 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-834e1ab0-a45d-494f-9713-f88292070efe tempest-GroupsTest-1625537742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (222353a6-1585-4225-936b-5a54f2da22ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:55:34 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-834e1ab0-a45d-494f-9713-f88292070efe tempest-GroupsTest-1625537742 None] Flow 'volume_create_manager' (1beea38e-92f1-47d1-9674-4f3a5f623ce6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:55:34 devstack sudo[87835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-30e3e625-1531-4632-a7f6-56ae9ce53715 Apr 22 17:55:34 devstack sudo[87835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:55:34 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-834e1ab0-a45d-494f-9713-f88292070efe tempest-GroupsTest-1625537742 None] Created volume successfully. Apr 22 17:55:34 devstack sudo[87834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e3664582-4810-4ace-9346-f53375c65ed6 Apr 22 17:55:34 devstack sudo[87834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:55:34 devstack sudo[87832]: pam_unix(sudo:session): session closed for user root Apr 22 17:55:34 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-6aefc87a-0900-4f37-9c4d-31e59eff58ce tempest-VolumesDeleteCascade-308204417 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-667b3cea-3545-4dde-b030-251b7d9c761a.d43e6202-6d1c-443d-a2bf-a097013d0aed" returned: 0 in 0.586s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:55:34 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-6aefc87a-0900-4f37-9c4d-31e59eff58ce tempest-VolumesDeleteCascade-308204417 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-667b3cea-3545-4dde-b030-251b7d9c761a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81771) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 22 17:55:34 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-6aefc87a-0900-4f37-9c4d-31e59eff58ce tempest-VolumesDeleteCascade-308204417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-667b3cea-3545-4dde-b030-251b7d9c761a.ab65faa6-4e14-48a0-bcad-7e6d86403757 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:55:34 devstack sudo[87835]: pam_unix(sudo:session): session closed for user root Apr 22 17:55:34 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-07ee1c6e-7063-40b7-baf4-2609091e44c5 tempest-CreateVolumesFromImageTest-478817080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-30e3e625-1531-4632-a7f6-56ae9ce53715" returned: 0 in 0.504s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:55:34 devstack sudo[87844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-667b3cea-3545-4dde-b030-251b7d9c761a.ab65faa6-4e14-48a0-bcad-7e6d86403757 Apr 22 17:55:34 devstack sudo[87844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:55:34 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-07ee1c6e-7063-40b7-baf4-2609091e44c5 tempest-CreateVolumesFromImageTest-478817080 None] Lock "cinder-quobyte-30e3e625-1531-4632-a7f6-56ae9ce53715" released by "delete_volume" :: held 1.126s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:55:34 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-07ee1c6e-7063-40b7-baf4-2609091e44c5 tempest-CreateVolumesFromImageTest-478817080 None] Created reservations ['49eb456a-967f-4df6-a3f6-367c313263f3', '293e9132-1502-4a40-a732-d18f527508b0', '4c3f70ba-9a5a-4667-a2eb-ff0e4428c2fd', 'de1a9215-d7ea-4b82-b562-bfd71485af0c'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 17:55:34 devstack sudo[87834]: pam_unix(sudo:session): session closed for user root Apr 22 17:55:34 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-b8166595-bcfe-4fb5-855b-0f90cddf9c5c tempest-VolumesActionsTest-84916959 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e3664582-4810-4ace-9346-f53375c65ed6" returned: 0 in 0.611s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:55:34 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb363f5b-ec60-4483-838e-34d9902a1f6b]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:55:34 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-b8166595-bcfe-4fb5-855b-0f90cddf9c5c tempest-VolumesActionsTest-84916959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e3664582-4810-4ace-9346-f53375c65ed6 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:55:34 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-07ee1c6e-7063-40b7-baf4-2609091e44c5 tempest-CreateVolumesFromImageTest-478817080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:55:34 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-07ee1c6e-7063-40b7-baf4-2609091e44c5 tempest-CreateVolumesFromImageTest-478817080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:55:34 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-07ee1c6e-7063-40b7-baf4-2609091e44c5 tempest-CreateVolumesFromImageTest-478817080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:55:34 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-07ee1c6e-7063-40b7-baf4-2609091e44c5 tempest-CreateVolumesFromImageTest-478817080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:55:34 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-07ee1c6e-7063-40b7-baf4-2609091e44c5 tempest-CreateVolumesFromImageTest-478817080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:55:34 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-07ee1c6e-7063-40b7-baf4-2609091e44c5 tempest-CreateVolumesFromImageTest-478817080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:55:34 devstack sudo[87848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 Apr 22 17:55:34 devstack sudo[87848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:55:34 devstack sudo[87847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e3664582-4810-4ace-9346-f53375c65ed6 Apr 22 17:55:34 devstack sudo[87847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:55:35 devstack sudo[87844]: pam_unix(sudo:session): session closed for user root Apr 22 17:55:35 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-6aefc87a-0900-4f37-9c4d-31e59eff58ce tempest-VolumesDeleteCascade-308204417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-667b3cea-3545-4dde-b030-251b7d9c761a.ab65faa6-4e14-48a0-bcad-7e6d86403757" returned: 0 in 0.656s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:55:35 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-6aefc87a-0900-4f37-9c4d-31e59eff58ce tempest-VolumesDeleteCascade-308204417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-667b3cea-3545-4dde-b030-251b7d9c761a.ab65faa6-4e14-48a0-bcad-7e6d86403757 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:55:35 devstack sudo[87848]: pam_unix(sudo:session): session closed for user root Apr 22 17:55:35 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-07ee1c6e-7063-40b7-baf4-2609091e44c5 tempest-CreateVolumesFromImageTest-478817080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33" returned: 0 in 0.505s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:55:35 devstack cinder-volume[81771]: DEBUG cinder.manager [None req-07ee1c6e-7063-40b7-baf4-2609091e44c5 tempest-CreateVolumesFromImageTest-478817080 None] Notifying Schedulers of capabilities ... {{(pid=81771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 17:55:35 devstack sudo[87858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-667b3cea-3545-4dde-b030-251b7d9c761a.ab65faa6-4e14-48a0-bcad-7e6d86403757 Apr 22 17:55:35 devstack sudo[87858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:55:35 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-07ee1c6e-7063-40b7-baf4-2609091e44c5 tempest-CreateVolumesFromImageTest-478817080 None] Deleted volume successfully. Apr 22 17:55:35 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-07ee1c6e-7063-40b7-baf4-2609091e44c5 tempest-CreateVolumesFromImageTest-478817080 None] Lock "cinder-30e3e625-1531-4632-a7f6-56ae9ce53715-delete_volume" released by "delete_volume" :: held 1.902s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:55:35 devstack sudo[87847]: pam_unix(sudo:session): session closed for user root Apr 22 17:55:35 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-b8166595-bcfe-4fb5-855b-0f90cddf9c5c tempest-VolumesActionsTest-84916959 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e3664582-4810-4ace-9346-f53375c65ed6" returned: 0 in 0.617s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:55:35 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-b8166595-bcfe-4fb5-855b-0f90cddf9c5c tempest-VolumesActionsTest-84916959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e3664582-4810-4ace-9346-f53375c65ed6 /opt/stack/data/cinder/conversion/e3664582-4810-4ace-9346-f53375c65ed6.temp_image.9f3c3395-6745-4fc4-a59f-33cc2ee4643b22zv1eos.img {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:55:35 devstack sudo[87860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e3664582-4810-4ace-9346-f53375c65ed6 /opt/stack/data/cinder/conversion/e3664582-4810-4ace-9346-f53375c65ed6.temp_image.9f3c3395-6745-4fc4-a59f-33cc2ee4643b22zv1eos.img Apr 22 17:55:35 devstack sudo[87860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:55:35 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-d4dc4544-3222-4414-93cc-3a2c75f13778 tempest-CreateVolumesFromImageTest-478817080 None] Acquiring lock "cinder-ae01bf4d-00ea-4fb2-b96c-3fc4ef1fb3c0-delete_volume" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:55:35 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-d4dc4544-3222-4414-93cc-3a2c75f13778 tempest-CreateVolumesFromImageTest-478817080 None] Lock "cinder-ae01bf4d-00ea-4fb2-b96c-3fc4ef1fb3c0-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:55:35 devstack cinder-volume[81771]: DEBUG cinder.volume.flows.manager.create_volume [None req-4bb54373-a0a7-410e-8dfc-eb0d86d93ae6 tempest-GroupsTest-1625537742 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 17:55:35 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-4bb54373-a0a7-410e-8dfc-eb0d86d93ae6 tempest-GroupsTest-1625537742 None] Flow 'volume_create_manager' (e1392353-122b-4b3e-b637-bfc87db472d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:55:35 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-4bb54373-a0a7-410e-8dfc-eb0d86d93ae6 tempest-GroupsTest-1625537742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38a7ca01-d7d2-4e77-945a-e75a5119ae9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:55:35 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-4bb54373-a0a7-410e-8dfc-eb0d86d93ae6 tempest-GroupsTest-1625537742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38a7ca01-d7d2-4e77-945a-e75a5119ae9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:55:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1106477505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7f45486e-9052-494b-8e29-081f537d5029,host='devstack@QuobyteHD#QuobyteHD',id=88ee3840-8fda-46e7-896b-d5641436d632,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbd20e328ab94b02a81e783994305701',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:55:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:55:36Z,use_quota=True,user_id='a76a7c73186547ee8d70613c7ca959bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed0bc887-8332-4846-a104-b4d09130bb28),volume_type_id=ed0bc887-8332-4846-a104-b4d09130bb28)' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:55:35 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-4bb54373-a0a7-410e-8dfc-eb0d86d93ae6 tempest-GroupsTest-1625537742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00453a58-e0c4-41b5-a737-6badce7a9679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:55:35 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-4bb54373-a0a7-410e-8dfc-eb0d86d93ae6 tempest-GroupsTest-1625537742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00453a58-e0c4-41b5-a737-6badce7a9679) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:55:35 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-4bb54373-a0a7-410e-8dfc-eb0d86d93ae6 tempest-GroupsTest-1625537742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ff8a3a8-24a9-4f16-be92-4d1fd36aecb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:55:35 devstack sudo[87858]: pam_unix(sudo:session): session closed for user root Apr 22 17:55:35 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-4bb54373-a0a7-410e-8dfc-eb0d86d93ae6 tempest-GroupsTest-1625537742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ff8a3a8-24a9-4f16-be92-4d1fd36aecb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88ee3840-8fda-46e7-896b-d5641436d632', 'volume_name': 'volume-88ee3840-8fda-46e7-896b-d5641436d632', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:55:35 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-4bb54373-a0a7-410e-8dfc-eb0d86d93ae6 tempest-GroupsTest-1625537742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (900feb0e-5c72-4b94-82c3-34c69a90ba4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:55:35 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-4bb54373-a0a7-410e-8dfc-eb0d86d93ae6 tempest-GroupsTest-1625537742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (900feb0e-5c72-4b94-82c3-34c69a90ba4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:55:35 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-4bb54373-a0a7-410e-8dfc-eb0d86d93ae6 tempest-GroupsTest-1625537742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20addcf1-40d0-4318-a48e-096d3e6b3da1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:55:35 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-4bb54373-a0a7-410e-8dfc-eb0d86d93ae6 tempest-GroupsTest-1625537742 None] Volume 88ee3840-8fda-46e7-896b-d5641436d632: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88ee3840-8fda-46e7-896b-d5641436d632', 'volume_size': 1} Apr 22 17:55:35 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-4bb54373-a0a7-410e-8dfc-eb0d86d93ae6 tempest-GroupsTest-1625537742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:55:35 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-6aefc87a-0900-4f37-9c4d-31e59eff58ce tempest-VolumesDeleteCascade-308204417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-667b3cea-3545-4dde-b030-251b7d9c761a.ab65faa6-4e14-48a0-bcad-7e6d86403757" returned: 0 in 0.541s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:55:36 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-6aefc87a-0900-4f37-9c4d-31e59eff58ce tempest-VolumesDeleteCascade-308204417 None] Lock "cinder-quobyte-ab65faa6-4e14-48a0-bcad-7e6d86403757" released by "_delete_snapshot" :: held 2.504s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:55:36 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-6aefc87a-0900-4f37-9c4d-31e59eff58ce tempest-VolumesDeleteCascade-308204417 None] Lock "cinder-quobyte-667b3cea-3545-4dde-b030-251b7d9c761a" released by "delete_snapshot" :: held 2.532s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:55:36 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-d4dc4544-3222-4414-93cc-3a2c75f13778 tempest-CreateVolumesFromImageTest-478817080 None] Acquiring lock "cinder-quobyte-ae01bf4d-00ea-4fb2-b96c-3fc4ef1fb3c0" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:55:36 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-d4dc4544-3222-4414-93cc-3a2c75f13778 tempest-CreateVolumesFromImageTest-478817080 None] Lock "cinder-quobyte-ae01bf4d-00ea-4fb2-b96c-3fc4ef1fb3c0" acquired by "delete_volume" :: waited 0.041s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:55:36 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad3053e5-a048-4c77-bf2c-9d38e717c10a]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:55:36 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-d4dc4544-3222-4414-93cc-3a2c75f13778 tempest-CreateVolumesFromImageTest-478817080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-ae01bf4d-00ea-4fb2-b96c-3fc4ef1fb3c0 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:55:36 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-6aefc87a-0900-4f37-9c4d-31e59eff58ce tempest-VolumesDeleteCascade-308204417 None] Created reservations ['ada260f2-08b2-44e9-a236-afe015457abe', 'dd0cc0de-cca0-42a9-af44-ee6e5bd88d02', 'ba86b4c7-3993-4e73-ba5c-665571709327', '97e74561-3d99-4fe8-abdd-873169c17325'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 17:55:36 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-6aefc87a-0900-4f37-9c4d-31e59eff58ce tempest-VolumesDeleteCascade-308204417 None] Delete snapshot completed successfully. Apr 22 17:55:36 devstack sudo[87872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-ae01bf4d-00ea-4fb2-b96c-3fc4ef1fb3c0 Apr 22 17:55:36 devstack sudo[87872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:55:36 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-6aefc87a-0900-4f37-9c4d-31e59eff58ce tempest-VolumesDeleteCascade-308204417 None] Lock "cinder-ab65faa6-4e14-48a0-bcad-7e6d86403757-delete_snapshot" released by "delete_snapshot" :: held 2.951s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:55:36 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-6aefc87a-0900-4f37-9c4d-31e59eff58ce tempest-VolumesDeleteCascade-308204417 None] Acquiring lock "cinder-d43e6202-6d1c-443d-a2bf-a097013d0aed-delete_snapshot" by "delete_snapshot" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:55:36 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-6aefc87a-0900-4f37-9c4d-31e59eff58ce tempest-VolumesDeleteCascade-308204417 None] Lock "cinder-d43e6202-6d1c-443d-a2bf-a097013d0aed-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:55:36 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-6aefc87a-0900-4f37-9c4d-31e59eff58ce tempest-VolumesDeleteCascade-308204417 None] Acquiring lock "cinder-quobyte-667b3cea-3545-4dde-b030-251b7d9c761a" by "delete_snapshot" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:55:36 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-6aefc87a-0900-4f37-9c4d-31e59eff58ce tempest-VolumesDeleteCascade-308204417 None] Lock "cinder-quobyte-667b3cea-3545-4dde-b030-251b7d9c761a" acquired by "delete_snapshot" :: waited 0.044s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:55:36 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-6aefc87a-0900-4f37-9c4d-31e59eff58ce tempest-VolumesDeleteCascade-308204417 None] Acquiring lock "cinder-quobyte-d43e6202-6d1c-443d-a2bf-a097013d0aed" by "_delete_snapshot" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:55:36 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-6aefc87a-0900-4f37-9c4d-31e59eff58ce tempest-VolumesDeleteCascade-308204417 None] Lock "cinder-quobyte-d43e6202-6d1c-443d-a2bf-a097013d0aed" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:55:36 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-6aefc87a-0900-4f37-9c4d-31e59eff58ce tempest-VolumesDeleteCascade-308204417 None] Deleting offline snapshot d43e6202-6d1c-443d-a2bf-a097013d0aed of volume 667b3cea-3545-4dde-b030-251b7d9c761a {{(pid=81771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 22 17:55:36 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-6aefc87a-0900-4f37-9c4d-31e59eff58ce tempest-VolumesDeleteCascade-308204417 None] snapshot_file for this snap is: volume-667b3cea-3545-4dde-b030-251b7d9c761a.d43e6202-6d1c-443d-a2bf-a097013d0aed {{(pid=81771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 22 17:55:36 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cb28349-2f65-4eae-a273-3da341bacfb0]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:55:36 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-6aefc87a-0900-4f37-9c4d-31e59eff58ce tempest-VolumesDeleteCascade-308204417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-667b3cea-3545-4dde-b030-251b7d9c761a.d43e6202-6d1c-443d-a2bf-a097013d0aed {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:55:36 devstack sudo[87875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-667b3cea-3545-4dde-b030-251b7d9c761a.d43e6202-6d1c-443d-a2bf-a097013d0aed Apr 22 17:55:36 devstack sudo[87875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:55:37 devstack sudo[87872]: pam_unix(sudo:session): session closed for user root Apr 22 17:55:37 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-d4dc4544-3222-4414-93cc-3a2c75f13778 tempest-CreateVolumesFromImageTest-478817080 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-ae01bf4d-00ea-4fb2-b96c-3fc4ef1fb3c0" returned: 0 in 1.621s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:55:37 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-d4dc4544-3222-4414-93cc-3a2c75f13778 tempest-CreateVolumesFromImageTest-478817080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-ae01bf4d-00ea-4fb2-b96c-3fc4ef1fb3c0 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:55:37 devstack sudo[87884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-ae01bf4d-00ea-4fb2-b96c-3fc4ef1fb3c0 Apr 22 17:55:37 devstack sudo[87884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:55:37 devstack sudo[87875]: pam_unix(sudo:session): session closed for user root Apr 22 17:55:37 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-6aefc87a-0900-4f37-9c4d-31e59eff58ce tempest-VolumesDeleteCascade-308204417 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-667b3cea-3545-4dde-b030-251b7d9c761a.d43e6202-6d1c-443d-a2bf-a097013d0aed" returned: 0 in 1.282s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:55:37 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-6aefc87a-0900-4f37-9c4d-31e59eff58ce tempest-VolumesDeleteCascade-308204417 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-667b3cea-3545-4dde-b030-251b7d9c761a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81771) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 22 17:55:38 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[3275a891-4402-48dd-8e48-2ec3cbd0eac7]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:55:38 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-6aefc87a-0900-4f37-9c4d-31e59eff58ce tempest-VolumesDeleteCascade-308204417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-667b3cea-3545-4dde-b030-251b7d9c761a {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:55:38 devstack sudo[87886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-667b3cea-3545-4dde-b030-251b7d9c761a Apr 22 17:55:38 devstack sudo[87886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:55:38 devstack sudo[87884]: pam_unix(sudo:session): session closed for user root Apr 22 17:55:38 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-d4dc4544-3222-4414-93cc-3a2c75f13778 tempest-CreateVolumesFromImageTest-478817080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-ae01bf4d-00ea-4fb2-b96c-3fc4ef1fb3c0" returned: 0 in 1.139s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:55:38 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-d4dc4544-3222-4414-93cc-3a2c75f13778 tempest-CreateVolumesFromImageTest-478817080 None] Lock "cinder-quobyte-ae01bf4d-00ea-4fb2-b96c-3fc4ef1fb3c0" released by "delete_volume" :: held 2.848s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:55:39 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-d4dc4544-3222-4414-93cc-3a2c75f13778 tempest-CreateVolumesFromImageTest-478817080 None] Created reservations ['30379bf7-c86b-439e-aa4d-a81ee0f5dcfc', '2f18b72e-efbf-488a-b43f-b5657f90c714', '14495653-e971-47a5-ab22-9bb2a07568d1', '81b213b3-2667-4be0-9ebb-acaa0dd8b6d6'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 17:55:39 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-d4dc4544-3222-4414-93cc-3a2c75f13778 tempest-CreateVolumesFromImageTest-478817080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:55:39 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-d4dc4544-3222-4414-93cc-3a2c75f13778 tempest-CreateVolumesFromImageTest-478817080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:55:39 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-d4dc4544-3222-4414-93cc-3a2c75f13778 tempest-CreateVolumesFromImageTest-478817080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:55:39 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-d4dc4544-3222-4414-93cc-3a2c75f13778 tempest-CreateVolumesFromImageTest-478817080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:55:39 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-d4dc4544-3222-4414-93cc-3a2c75f13778 tempest-CreateVolumesFromImageTest-478817080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:55:39 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-d4dc4544-3222-4414-93cc-3a2c75f13778 tempest-CreateVolumesFromImageTest-478817080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:55:39 devstack sudo[87889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 Apr 22 17:55:39 devstack sudo[87889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:55:39 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-5b50600f-0952-40c8-9268-94ceb3ad205a tempest-CreateVolumesFromImageTest-478817080 None] Acquiring lock "cinder-36d827f3-71a6-445c-959f-9f1f6e1e8ec6-delete_volume" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:55:39 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-5b50600f-0952-40c8-9268-94ceb3ad205a tempest-CreateVolumesFromImageTest-478817080 None] Lock "cinder-36d827f3-71a6-445c-959f-9f1f6e1e8ec6-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:55:39 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-5b50600f-0952-40c8-9268-94ceb3ad205a tempest-CreateVolumesFromImageTest-478817080 None] Acquiring lock "cinder-quobyte-36d827f3-71a6-445c-959f-9f1f6e1e8ec6" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:55:39 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-5b50600f-0952-40c8-9268-94ceb3ad205a tempest-CreateVolumesFromImageTest-478817080 None] Lock "cinder-quobyte-36d827f3-71a6-445c-959f-9f1f6e1e8ec6" acquired by "delete_volume" :: waited 0.049s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:55:39 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b8e202a-8068-4bac-8b4e-4ca9a6172c27]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:55:39 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-5b50600f-0952-40c8-9268-94ceb3ad205a tempest-CreateVolumesFromImageTest-478817080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-36d827f3-71a6-445c-959f-9f1f6e1e8ec6 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:55:39 devstack sudo[87886]: pam_unix(sudo:session): session closed for user root Apr 22 17:55:39 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-6aefc87a-0900-4f37-9c4d-31e59eff58ce tempest-VolumesDeleteCascade-308204417 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-667b3cea-3545-4dde-b030-251b7d9c761a" returned: 0 in 1.891s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:55:39 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-6aefc87a-0900-4f37-9c4d-31e59eff58ce tempest-VolumesDeleteCascade-308204417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-667b3cea-3545-4dde-b030-251b7d9c761a.d43e6202-6d1c-443d-a2bf-a097013d0aed {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:55:40 devstack sudo[87895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-667b3cea-3545-4dde-b030-251b7d9c761a.d43e6202-6d1c-443d-a2bf-a097013d0aed Apr 22 17:55:40 devstack sudo[87895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:55:40 devstack sudo[87894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-36d827f3-71a6-445c-959f-9f1f6e1e8ec6 Apr 22 17:55:40 devstack sudo[87894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:55:40 devstack sudo[87889]: pam_unix(sudo:session): session closed for user root Apr 22 17:55:40 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-d4dc4544-3222-4414-93cc-3a2c75f13778 tempest-CreateVolumesFromImageTest-478817080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33" returned: 0 in 1.498s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:55:40 devstack cinder-volume[81771]: DEBUG cinder.manager [None req-d4dc4544-3222-4414-93cc-3a2c75f13778 tempest-CreateVolumesFromImageTest-478817080 None] Notifying Schedulers of capabilities ... {{(pid=81771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 17:55:40 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-d4dc4544-3222-4414-93cc-3a2c75f13778 tempest-CreateVolumesFromImageTest-478817080 None] Deleted volume successfully. Apr 22 17:55:40 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-d4dc4544-3222-4414-93cc-3a2c75f13778 tempest-CreateVolumesFromImageTest-478817080 None] Lock "cinder-ae01bf4d-00ea-4fb2-b96c-3fc4ef1fb3c0-delete_volume" released by "delete_volume" :: held 4.891s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:55:41 devstack sudo[87894]: pam_unix(sudo:session): session closed for user root Apr 22 17:55:41 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-5b50600f-0952-40c8-9268-94ceb3ad205a tempest-CreateVolumesFromImageTest-478817080 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-36d827f3-71a6-445c-959f-9f1f6e1e8ec6" returned: 0 in 1.286s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:55:41 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-5b50600f-0952-40c8-9268-94ceb3ad205a tempest-CreateVolumesFromImageTest-478817080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-36d827f3-71a6-445c-959f-9f1f6e1e8ec6 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:55:41 devstack sudo[87904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-36d827f3-71a6-445c-959f-9f1f6e1e8ec6 Apr 22 17:55:41 devstack sudo[87904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:55:41 devstack sudo[87860]: pam_unix(sudo:session): session closed for user root Apr 22 17:55:41 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-b8166595-bcfe-4fb5-855b-0f90cddf9c5c tempest-VolumesActionsTest-84916959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e3664582-4810-4ace-9346-f53375c65ed6 /opt/stack/data/cinder/conversion/e3664582-4810-4ace-9346-f53375c65ed6.temp_image.9f3c3395-6745-4fc4-a59f-33cc2ee4643b22zv1eos.img" returned: 0 in 5.755s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:55:41 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca3454c2-f714-454b-84bb-86a4b6c76b71]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:55:41 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-b8166595-bcfe-4fb5-855b-0f90cddf9c5c tempest-VolumesActionsTest-84916959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e3664582-4810-4ace-9346-f53375c65ed6 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:55:41 devstack sudo[87895]: pam_unix(sudo:session): session closed for user root Apr 22 17:55:41 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-6aefc87a-0900-4f37-9c4d-31e59eff58ce tempest-VolumesDeleteCascade-308204417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-667b3cea-3545-4dde-b030-251b7d9c761a.d43e6202-6d1c-443d-a2bf-a097013d0aed" returned: 0 in 1.420s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:55:41 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-6aefc87a-0900-4f37-9c4d-31e59eff58ce tempest-VolumesDeleteCascade-308204417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-667b3cea-3545-4dde-b030-251b7d9c761a.d43e6202-6d1c-443d-a2bf-a097013d0aed {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:55:41 devstack sudo[87907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e3664582-4810-4ace-9346-f53375c65ed6 Apr 22 17:55:41 devstack sudo[87907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:55:41 devstack sudo[87908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-667b3cea-3545-4dde-b030-251b7d9c761a.d43e6202-6d1c-443d-a2bf-a097013d0aed Apr 22 17:55:41 devstack sudo[87908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:55:41 devstack sudo[87904]: pam_unix(sudo:session): session closed for user root Apr 22 17:55:41 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-5b50600f-0952-40c8-9268-94ceb3ad205a tempest-CreateVolumesFromImageTest-478817080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-36d827f3-71a6-445c-959f-9f1f6e1e8ec6" returned: 0 in 0.485s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:55:41 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-5b50600f-0952-40c8-9268-94ceb3ad205a tempest-CreateVolumesFromImageTest-478817080 None] Lock "cinder-quobyte-36d827f3-71a6-445c-959f-9f1f6e1e8ec6" released by "delete_volume" :: held 1.904s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:55:41 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-5b50600f-0952-40c8-9268-94ceb3ad205a tempest-CreateVolumesFromImageTest-478817080 None] Created reservations ['4aefadbe-294e-4825-b6b4-ee0f3e7a41ab', '5f118659-b4b7-407b-ac06-e438bf49e84c', 'fc74f9e2-7a8f-471d-8248-c48aafce6e8e', '3f7d9247-f223-42bf-869a-b833f348f7cf'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 17:55:41 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-5b50600f-0952-40c8-9268-94ceb3ad205a tempest-CreateVolumesFromImageTest-478817080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:55:41 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-5b50600f-0952-40c8-9268-94ceb3ad205a tempest-CreateVolumesFromImageTest-478817080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:55:41 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-5b50600f-0952-40c8-9268-94ceb3ad205a tempest-CreateVolumesFromImageTest-478817080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:55:41 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-5b50600f-0952-40c8-9268-94ceb3ad205a tempest-CreateVolumesFromImageTest-478817080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:55:41 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-5b50600f-0952-40c8-9268-94ceb3ad205a tempest-CreateVolumesFromImageTest-478817080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:55:41 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-5b50600f-0952-40c8-9268-94ceb3ad205a tempest-CreateVolumesFromImageTest-478817080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:55:41 devstack sudo[87915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 Apr 22 17:55:41 devstack sudo[87915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:55:41 devstack sudo[87908]: pam_unix(sudo:session): session closed for user root Apr 22 17:55:41 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-6aefc87a-0900-4f37-9c4d-31e59eff58ce tempest-VolumesDeleteCascade-308204417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-667b3cea-3545-4dde-b030-251b7d9c761a.d43e6202-6d1c-443d-a2bf-a097013d0aed" returned: 0 in 0.503s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:55:41 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-6aefc87a-0900-4f37-9c4d-31e59eff58ce tempest-VolumesDeleteCascade-308204417 None] Lock "cinder-quobyte-d43e6202-6d1c-443d-a2bf-a097013d0aed" released by "_delete_snapshot" :: held 5.307s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:55:41 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-6aefc87a-0900-4f37-9c4d-31e59eff58ce tempest-VolumesDeleteCascade-308204417 None] Lock "cinder-quobyte-667b3cea-3545-4dde-b030-251b7d9c761a" released by "delete_snapshot" :: held 5.353s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:55:41 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-6aefc87a-0900-4f37-9c4d-31e59eff58ce tempest-VolumesDeleteCascade-308204417 None] Created reservations ['f1b23141-fd26-43aa-9523-7839489e9506', '6cdb99e0-dcac-461e-9c78-aaa69d50bba4', 'ef7f4ed6-8e5c-45ff-aab4-c6025a0fa75d', '435a3fd0-a991-41d0-a51e-05417c0fb4c4'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 17:55:42 devstack sudo[87907]: pam_unix(sudo:session): session closed for user root Apr 22 17:55:42 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-b8166595-bcfe-4fb5-855b-0f90cddf9c5c tempest-VolumesActionsTest-84916959 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e3664582-4810-4ace-9346-f53375c65ed6" returned: 0 in 0.720s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:55:42 devstack cinder-volume[81771]: DEBUG cinder.image.image_utils [None req-b8166595-bcfe-4fb5-855b-0f90cddf9c5c tempest-VolumesActionsTest-84916959 None] Image conversion details: src /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e3664582-4810-4ace-9346-f53375c65ed6, size 1024.00 MB, duration 5.76 sec, destination /opt/stack/data/cinder/conversion/e3664582-4810-4ace-9346-f53375c65ed6.temp_image.9f3c3395-6745-4fc4-a59f-33cc2ee4643b22zv1eos.img {{(pid=81771) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 22 17:55:42 devstack cinder-volume[81771]: INFO cinder.image.image_utils [None req-b8166595-bcfe-4fb5-855b-0f90cddf9c5c tempest-VolumesActionsTest-84916959 None] Converted 1024.00 MB image at 177.88 MB/s Apr 22 17:55:42 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-6aefc87a-0900-4f37-9c4d-31e59eff58ce tempest-VolumesDeleteCascade-308204417 None] Delete snapshot completed successfully. Apr 22 17:55:42 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-d505ef3c-1445-42ca-b282-0bfbf6d8614f tempest-CreateVolumesFromImageTest-478817080 None] Acquiring lock "cinder-689a0626-3452-4772-9c58-65dc083fb435-delete_volume" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:55:42 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-6aefc87a-0900-4f37-9c4d-31e59eff58ce tempest-VolumesDeleteCascade-308204417 None] Lock "cinder-d43e6202-6d1c-443d-a2bf-a097013d0aed-delete_snapshot" released by "delete_snapshot" :: held 5.610s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:55:42 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-6aefc87a-0900-4f37-9c4d-31e59eff58ce tempest-VolumesDeleteCascade-308204417 None] Snapshots deleted, issuing volume delete {{(pid=81771) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 22 17:55:42 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-6aefc87a-0900-4f37-9c4d-31e59eff58ce tempest-VolumesDeleteCascade-308204417 None] Acquiring lock "cinder-quobyte-667b3cea-3545-4dde-b030-251b7d9c761a" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:55:42 devstack cinder-volume[81771]: DEBUG cinder.image.image_utils [None req-b8166595-bcfe-4fb5-855b-0f90cddf9c5c tempest-VolumesActionsTest-84916959 None] 9f3c3395-6745-4fc4-a59f-33cc2ee4643b was raw, no need to convert to raw {{(pid=81771) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1159}} Apr 22 17:55:42 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-d505ef3c-1445-42ca-b282-0bfbf6d8614f tempest-CreateVolumesFromImageTest-478817080 None] Lock "cinder-689a0626-3452-4772-9c58-65dc083fb435-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:55:42 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-6aefc87a-0900-4f37-9c4d-31e59eff58ce tempest-VolumesDeleteCascade-308204417 None] Lock "cinder-quobyte-667b3cea-3545-4dde-b030-251b7d9c761a" acquired by "delete_volume" :: waited 0.052s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:55:42 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[147be49a-87a4-4ebd-893f-6fd0ef4990b7]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:55:42 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-6aefc87a-0900-4f37-9c4d-31e59eff58ce tempest-VolumesDeleteCascade-308204417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-667b3cea-3545-4dde-b030-251b7d9c761a {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:55:42 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-d505ef3c-1445-42ca-b282-0bfbf6d8614f tempest-CreateVolumesFromImageTest-478817080 None] Acquiring lock "cinder-quobyte-689a0626-3452-4772-9c58-65dc083fb435" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:55:42 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-d505ef3c-1445-42ca-b282-0bfbf6d8614f tempest-CreateVolumesFromImageTest-478817080 None] Lock "cinder-quobyte-689a0626-3452-4772-9c58-65dc083fb435" acquired by "delete_volume" :: waited 0.019s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:55:42 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[c64a24a0-7c0b-4444-8267-0ea33f7190af]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:55:42 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-d505ef3c-1445-42ca-b282-0bfbf6d8614f tempest-CreateVolumesFromImageTest-478817080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-689a0626-3452-4772-9c58-65dc083fb435 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:55:42 devstack sudo[87920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-689a0626-3452-4772-9c58-65dc083fb435 Apr 22 17:55:42 devstack sudo[87920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:55:42 devstack sudo[87919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-667b3cea-3545-4dde-b030-251b7d9c761a Apr 22 17:55:42 devstack sudo[87919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:55:42 devstack sudo[87915]: pam_unix(sudo:session): session closed for user root Apr 22 17:55:42 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-5b50600f-0952-40c8-9268-94ceb3ad205a tempest-CreateVolumesFromImageTest-478817080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33" returned: 0 in 0.735s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:55:42 devstack cinder-volume[81771]: DEBUG cinder.manager [None req-5b50600f-0952-40c8-9268-94ceb3ad205a tempest-CreateVolumesFromImageTest-478817080 None] Notifying Schedulers of capabilities ... {{(pid=81771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 17:55:42 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-5b50600f-0952-40c8-9268-94ceb3ad205a tempest-CreateVolumesFromImageTest-478817080 None] Deleted volume successfully. Apr 22 17:55:42 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-5b50600f-0952-40c8-9268-94ceb3ad205a tempest-CreateVolumesFromImageTest-478817080 None] Lock "cinder-36d827f3-71a6-445c-959f-9f1f6e1e8ec6-delete_volume" released by "delete_volume" :: held 2.968s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:55:42 devstack sudo[87920]: pam_unix(sudo:session): session closed for user root Apr 22 17:55:42 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-d505ef3c-1445-42ca-b282-0bfbf6d8614f tempest-CreateVolumesFromImageTest-478817080 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-689a0626-3452-4772-9c58-65dc083fb435" returned: 0 in 0.676s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:55:42 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-d505ef3c-1445-42ca-b282-0bfbf6d8614f tempest-CreateVolumesFromImageTest-478817080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-689a0626-3452-4772-9c58-65dc083fb435 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:55:42 devstack sudo[87919]: pam_unix(sudo:session): session closed for user root Apr 22 17:55:42 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-6aefc87a-0900-4f37-9c4d-31e59eff58ce tempest-VolumesDeleteCascade-308204417 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-667b3cea-3545-4dde-b030-251b7d9c761a" returned: 0 in 0.792s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:55:42 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-6aefc87a-0900-4f37-9c4d-31e59eff58ce tempest-VolumesDeleteCascade-308204417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-667b3cea-3545-4dde-b030-251b7d9c761a {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:55:42 devstack sudo[87932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-689a0626-3452-4772-9c58-65dc083fb435 Apr 22 17:55:42 devstack sudo[87932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:55:42 devstack sudo[87933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-667b3cea-3545-4dde-b030-251b7d9c761a Apr 22 17:55:42 devstack sudo[87933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:55:43 devstack sudo[87932]: pam_unix(sudo:session): session closed for user root Apr 22 17:55:43 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-d505ef3c-1445-42ca-b282-0bfbf6d8614f tempest-CreateVolumesFromImageTest-478817080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-689a0626-3452-4772-9c58-65dc083fb435" returned: 0 in 0.500s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:55:43 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-d505ef3c-1445-42ca-b282-0bfbf6d8614f tempest-CreateVolumesFromImageTest-478817080 None] Lock "cinder-quobyte-689a0626-3452-4772-9c58-65dc083fb435" released by "delete_volume" :: held 1.219s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:55:43 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-d505ef3c-1445-42ca-b282-0bfbf6d8614f tempest-CreateVolumesFromImageTest-478817080 None] Created reservations ['493cce89-2819-4cff-af21-e64d99bfbd89', '6cc64cd7-2991-461b-af58-8db659e356cd', 'a69a6557-ae78-44e6-890b-ee56b3b5e596', '7ba8b2f3-62b3-4be3-9405-4ad4c2d876f7'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 17:55:43 devstack sudo[87933]: pam_unix(sudo:session): session closed for user root Apr 22 17:55:43 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-6aefc87a-0900-4f37-9c4d-31e59eff58ce tempest-VolumesDeleteCascade-308204417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-667b3cea-3545-4dde-b030-251b7d9c761a" returned: 0 in 0.580s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:55:43 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-6aefc87a-0900-4f37-9c4d-31e59eff58ce tempest-VolumesDeleteCascade-308204417 None] Lock "cinder-quobyte-667b3cea-3545-4dde-b030-251b7d9c761a" released by "delete_volume" :: held 1.474s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:55:43 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-d505ef3c-1445-42ca-b282-0bfbf6d8614f tempest-CreateVolumesFromImageTest-478817080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:55:43 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-d505ef3c-1445-42ca-b282-0bfbf6d8614f tempest-CreateVolumesFromImageTest-478817080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:55:43 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-d505ef3c-1445-42ca-b282-0bfbf6d8614f tempest-CreateVolumesFromImageTest-478817080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:55:43 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-d505ef3c-1445-42ca-b282-0bfbf6d8614f tempest-CreateVolumesFromImageTest-478817080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:55:43 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-d505ef3c-1445-42ca-b282-0bfbf6d8614f tempest-CreateVolumesFromImageTest-478817080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:55:43 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-d505ef3c-1445-42ca-b282-0bfbf6d8614f tempest-CreateVolumesFromImageTest-478817080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:55:43 devstack sudo[87940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 Apr 22 17:55:43 devstack sudo[87940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:55:43 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-6aefc87a-0900-4f37-9c4d-31e59eff58ce tempest-VolumesDeleteCascade-308204417 None] Created reservations ['d661a6de-5c98-44be-9779-50ac71cf8861', 'ca68b1c6-8e54-4b87-92e5-e97e0109687e', '394ca4ad-f289-48d3-a4b1-e0d1fbcf62d6', '54c3b648-5029-464d-86a7-76b399d564e8'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 17:55:43 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-6aefc87a-0900-4f37-9c4d-31e59eff58ce tempest-VolumesDeleteCascade-308204417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:55:43 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-6aefc87a-0900-4f37-9c4d-31e59eff58ce tempest-VolumesDeleteCascade-308204417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:55:43 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-6aefc87a-0900-4f37-9c4d-31e59eff58ce tempest-VolumesDeleteCascade-308204417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:55:43 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-6aefc87a-0900-4f37-9c4d-31e59eff58ce tempest-VolumesDeleteCascade-308204417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:55:43 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-6aefc87a-0900-4f37-9c4d-31e59eff58ce tempest-VolumesDeleteCascade-308204417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:55:43 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-6aefc87a-0900-4f37-9c4d-31e59eff58ce tempest-VolumesDeleteCascade-308204417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:55:43 devstack sudo[87942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 Apr 22 17:55:43 devstack sudo[87942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:55:44 devstack sudo[87940]: pam_unix(sudo:session): session closed for user root Apr 22 17:55:44 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-d505ef3c-1445-42ca-b282-0bfbf6d8614f tempest-CreateVolumesFromImageTest-478817080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33" returned: 0 in 0.681s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:55:44 devstack cinder-volume[81771]: DEBUG cinder.manager [None req-d505ef3c-1445-42ca-b282-0bfbf6d8614f tempest-CreateVolumesFromImageTest-478817080 None] Notifying Schedulers of capabilities ... {{(pid=81771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 17:55:44 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-d505ef3c-1445-42ca-b282-0bfbf6d8614f tempest-CreateVolumesFromImageTest-478817080 None] Deleted volume successfully. Apr 22 17:55:44 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-d505ef3c-1445-42ca-b282-0bfbf6d8614f tempest-CreateVolumesFromImageTest-478817080 None] Lock "cinder-689a0626-3452-4772-9c58-65dc083fb435-delete_volume" released by "delete_volume" :: held 2.266s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:55:44 devstack sudo[87942]: pam_unix(sudo:session): session closed for user root Apr 22 17:55:44 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-6aefc87a-0900-4f37-9c4d-31e59eff58ce tempest-VolumesDeleteCascade-308204417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33" returned: 0 in 0.706s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:55:44 devstack cinder-volume[81771]: DEBUG cinder.manager [None req-6aefc87a-0900-4f37-9c4d-31e59eff58ce tempest-VolumesDeleteCascade-308204417 None] Notifying Schedulers of capabilities ... {{(pid=81771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 17:55:44 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-6aefc87a-0900-4f37-9c4d-31e59eff58ce tempest-VolumesDeleteCascade-308204417 None] Deleted volume successfully. Apr 22 17:55:44 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-6aefc87a-0900-4f37-9c4d-31e59eff58ce tempest-VolumesDeleteCascade-308204417 None] Lock "cinder-667b3cea-3545-4dde-b030-251b7d9c761a-delete_volume" released by "delete_volume" :: held 11.218s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:55:45 devstack cinder-volume[81771]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b885cba-764b-4bfa-87c2-79bab0350d60 tempest-VolumesDeleteCascade-308204417 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 17:55:45 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-7b885cba-764b-4bfa-87c2-79bab0350d60 tempest-VolumesDeleteCascade-308204417 None] Flow 'volume_create_manager' (2348f079-2c90-459a-b516-1d7a86c33bd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:55:45 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-7b885cba-764b-4bfa-87c2-79bab0350d60 tempest-VolumesDeleteCascade-308204417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce43e740-3fde-4870-b029-d663c3df7902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:55:45 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-7b885cba-764b-4bfa-87c2-79bab0350d60 tempest-VolumesDeleteCascade-308204417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce43e740-3fde-4870-b029-d663c3df7902) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:55:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2084762876',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b103161a-7291-4a16-b9ad-872efcc665a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='154083d43f2f440aaa83a702c5251116',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:55:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:55:45Z,use_quota=True,user_id='c8ae13f6f3664463b4fe3ae68f68126c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:55:45 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-7b885cba-764b-4bfa-87c2-79bab0350d60 tempest-VolumesDeleteCascade-308204417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37595ba3-4303-4f5d-944c-9c6a8cf96922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:55:45 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-7b885cba-764b-4bfa-87c2-79bab0350d60 tempest-VolumesDeleteCascade-308204417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37595ba3-4303-4f5d-944c-9c6a8cf96922) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:55:45 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-7b885cba-764b-4bfa-87c2-79bab0350d60 tempest-VolumesDeleteCascade-308204417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00789594-2835-44af-b835-fe27f3d0f75b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:55:45 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-7b885cba-764b-4bfa-87c2-79bab0350d60 tempest-VolumesDeleteCascade-308204417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00789594-2835-44af-b835-fe27f3d0f75b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b103161a-7291-4a16-b9ad-872efcc665a9', 'volume_name': 'volume-b103161a-7291-4a16-b9ad-872efcc665a9', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:55:45 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-7b885cba-764b-4bfa-87c2-79bab0350d60 tempest-VolumesDeleteCascade-308204417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1997bcc-1683-4a29-a89c-bdecfe4ff4ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:55:45 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-7b885cba-764b-4bfa-87c2-79bab0350d60 tempest-VolumesDeleteCascade-308204417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1997bcc-1683-4a29-a89c-bdecfe4ff4ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:55:45 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-7b885cba-764b-4bfa-87c2-79bab0350d60 tempest-VolumesDeleteCascade-308204417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18712310-f308-40d6-9155-f57e4f43e799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:55:45 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-7b885cba-764b-4bfa-87c2-79bab0350d60 tempest-VolumesDeleteCascade-308204417 None] Volume b103161a-7291-4a16-b9ad-872efcc665a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b103161a-7291-4a16-b9ad-872efcc665a9', 'volume_size': 1} Apr 22 17:55:45 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-7b885cba-764b-4bfa-87c2-79bab0350d60 tempest-VolumesDeleteCascade-308204417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:55:47 devstack cinder-volume[81771]: DEBUG cinder.volume.flows.manager.create_volume [None req-45dbef7b-adfd-4737-8d00-6efe64d5c585 tempest-CreateVolumesFromSnapshotTest-401145158 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 17:55:47 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-45dbef7b-adfd-4737-8d00-6efe64d5c585 tempest-CreateVolumesFromSnapshotTest-401145158 None] Flow 'volume_create_manager' (5e4e6e40-090d-44eb-b41a-ffca48caf1ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:55:47 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-45dbef7b-adfd-4737-8d00-6efe64d5c585 tempest-CreateVolumesFromSnapshotTest-401145158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (defe0f21-da0c-4bcd-8175-f960b79a9ddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:55:47 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-45dbef7b-adfd-4737-8d00-6efe64d5c585 tempest-CreateVolumesFromSnapshotTest-401145158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (defe0f21-da0c-4bcd-8175-f960b79a9ddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:55:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1190602591',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99b5cd7d-5139-4613-8517-312f9075d3e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3957959b6ebc404198d60e5c86311307',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:55:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:55:47Z,use_quota=True,user_id='76b25e93fa074cc3b5217e0e35652ef2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:55:47 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-45dbef7b-adfd-4737-8d00-6efe64d5c585 tempest-CreateVolumesFromSnapshotTest-401145158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (171c6f89-1b2a-4f54-aa61-ef6aa2ead7f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:55:47 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-45dbef7b-adfd-4737-8d00-6efe64d5c585 tempest-CreateVolumesFromSnapshotTest-401145158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (171c6f89-1b2a-4f54-aa61-ef6aa2ead7f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:55:47 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-45dbef7b-adfd-4737-8d00-6efe64d5c585 tempest-CreateVolumesFromSnapshotTest-401145158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d77a06e9-0ce0-4ab9-a061-5f18392be677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:55:47 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-45dbef7b-adfd-4737-8d00-6efe64d5c585 tempest-CreateVolumesFromSnapshotTest-401145158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d77a06e9-0ce0-4ab9-a061-5f18392be677) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99b5cd7d-5139-4613-8517-312f9075d3e2', 'volume_name': 'volume-99b5cd7d-5139-4613-8517-312f9075d3e2', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:55:47 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-45dbef7b-adfd-4737-8d00-6efe64d5c585 tempest-CreateVolumesFromSnapshotTest-401145158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25553037-e41c-4d0b-bfb6-90b70798ef99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:55:47 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-45dbef7b-adfd-4737-8d00-6efe64d5c585 tempest-CreateVolumesFromSnapshotTest-401145158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25553037-e41c-4d0b-bfb6-90b70798ef99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:55:47 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-45dbef7b-adfd-4737-8d00-6efe64d5c585 tempest-CreateVolumesFromSnapshotTest-401145158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f408fb28-3d52-455b-b931-a413d29a6075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:55:47 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-45dbef7b-adfd-4737-8d00-6efe64d5c585 tempest-CreateVolumesFromSnapshotTest-401145158 None] Volume 99b5cd7d-5139-4613-8517-312f9075d3e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99b5cd7d-5139-4613-8517-312f9075d3e2', 'volume_size': 1} Apr 22 17:55:47 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-45dbef7b-adfd-4737-8d00-6efe64d5c585 tempest-CreateVolumesFromSnapshotTest-401145158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:55:57 devstack cinder-volume[81771]: DEBUG dbcounter [-] [81771] Writing DB stats cinder:UPDATE=73,cinder:SELECT=52,cinder:INSERT=19,cinder:DELETE=6 {{(pid=81771) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 22 17:55:57 devstack cinder-volume[81771]: DEBUG dbcounter [-] [81771] Writing DB stats cinder:SELECT=58,cinder:UPDATE=74,cinder:INSERT=17,cinder:DELETE=5 {{(pid=81771) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 22 17:55:58 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-b8166595-bcfe-4fb5-855b-0f90cddf9c5c tempest-VolumesActionsTest-84916959 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 24.314s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:55:58 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-b8166595-bcfe-4fb5-855b-0f90cddf9c5c tempest-VolumesActionsTest-84916959 None] Uploaded volume to glance image-id: 9f3c3395-6745-4fc4-a59f-33cc2ee4643b. {{(pid=81771) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 22 17:55:58 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-4bb54373-a0a7-410e-8dfc-eb0d86d93ae6 tempest-GroupsTest-1625537742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 22.609s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:55:58 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-4bb54373-a0a7-410e-8dfc-eb0d86d93ae6 tempest-GroupsTest-1625537742 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7f45486e-9052-494b-8e29-081f537d5029,created_at=2026-04-22T15:55:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1106477505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7f45486e-9052-494b-8e29-081f537d5029,host='devstack@QuobyteHD#QuobyteHD',id=88ee3840-8fda-46e7-896b-d5641436d632,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbd20e328ab94b02a81e783994305701',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:55:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:55:36Z,use_quota=True,user_id='a76a7c73186547ee8d70613c7ca959bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed0bc887-8332-4846-a104-b4d09130bb28),volume_type_id=ed0bc887-8332-4846-a104-b4d09130bb28)}" {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 17:55:58 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-4bb54373-a0a7-410e-8dfc-eb0d86d93ae6 tempest-GroupsTest-1625537742 None] Creating volume 88ee3840-8fda-46e7-896b-d5641436d632 {{(pid=81771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 17:55:58 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-4bb54373-a0a7-410e-8dfc-eb0d86d93ae6 tempest-GroupsTest-1625537742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:55:58 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-4bb54373-a0a7-410e-8dfc-eb0d86d93ae6 tempest-GroupsTest-1625537742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:55:58 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-4bb54373-a0a7-410e-8dfc-eb0d86d93ae6 tempest-GroupsTest-1625537742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:55:58 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-4bb54373-a0a7-410e-8dfc-eb0d86d93ae6 tempest-GroupsTest-1625537742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:55:58 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-4bb54373-a0a7-410e-8dfc-eb0d86d93ae6 tempest-GroupsTest-1625537742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:55:58 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-4bb54373-a0a7-410e-8dfc-eb0d86d93ae6 tempest-GroupsTest-1625537742 None] Selected osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 as target Quobyte volume. {{(pid=81771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 17:55:58 devstack cinder-volume[81771]: INFO cinder.volume.drivers.remotefs [None req-4bb54373-a0a7-410e-8dfc-eb0d86d93ae6 tempest-GroupsTest-1625537742 None] casted to osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 Apr 22 17:55:58 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-4bb54373-a0a7-410e-8dfc-eb0d86d93ae6 tempest-GroupsTest-1625537742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-88ee3840-8fda-46e7-896b-d5641436d632 1073741824 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:55:58 devstack sudo[87982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-88ee3840-8fda-46e7-896b-d5641436d632 1073741824 Apr 22 17:55:58 devstack sudo[87982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:55:58 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-b8166595-bcfe-4fb5-855b-0f90cddf9c5c tempest-VolumesActionsTest-84916959 None] Copy volume to image completed successfully. Apr 22 17:55:59 devstack sudo[87982]: pam_unix(sudo:session): session closed for user root Apr 22 17:55:59 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-4bb54373-a0a7-410e-8dfc-eb0d86d93ae6 tempest-GroupsTest-1625537742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-88ee3840-8fda-46e7-896b-d5641436d632 1073741824" returned: 0 in 0.637s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:55:59 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-4bb54373-a0a7-410e-8dfc-eb0d86d93ae6 tempest-GroupsTest-1625537742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-88ee3840-8fda-46e7-896b-d5641436d632 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:55:59 devstack sudo[87987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-88ee3840-8fda-46e7-896b-d5641436d632 Apr 22 17:55:59 devstack sudo[87987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:55:59 devstack sudo[87987]: pam_unix(sudo:session): session closed for user root Apr 22 17:55:59 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-4bb54373-a0a7-410e-8dfc-eb0d86d93ae6 tempest-GroupsTest-1625537742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-88ee3840-8fda-46e7-896b-d5641436d632" returned: 0 in 0.467s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:55:59 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-4bb54373-a0a7-410e-8dfc-eb0d86d93ae6 tempest-GroupsTest-1625537742 None] <== create_volume: return (1141ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'} {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 17:55:59 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-4bb54373-a0a7-410e-8dfc-eb0d86d93ae6 tempest-GroupsTest-1625537742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.144s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:55:59 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-7b885cba-764b-4bfa-87c2-79bab0350d60 tempest-VolumesDeleteCascade-308204417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.534s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:55:59 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-7b885cba-764b-4bfa-87c2-79bab0350d60 tempest-VolumesDeleteCascade-308204417 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:55:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2084762876',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b103161a-7291-4a16-b9ad-872efcc665a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='154083d43f2f440aaa83a702c5251116',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:55:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:55:45Z,use_quota=True,user_id='c8ae13f6f3664463b4fe3ae68f68126c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)}" {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 17:55:59 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-7b885cba-764b-4bfa-87c2-79bab0350d60 tempest-VolumesDeleteCascade-308204417 None] Creating volume b103161a-7291-4a16-b9ad-872efcc665a9 {{(pid=81771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 17:55:59 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-7b885cba-764b-4bfa-87c2-79bab0350d60 tempest-VolumesDeleteCascade-308204417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:55:59 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-7b885cba-764b-4bfa-87c2-79bab0350d60 tempest-VolumesDeleteCascade-308204417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:55:59 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-7b885cba-764b-4bfa-87c2-79bab0350d60 tempest-VolumesDeleteCascade-308204417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:55:59 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-7b885cba-764b-4bfa-87c2-79bab0350d60 tempest-VolumesDeleteCascade-308204417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:55:59 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-7b885cba-764b-4bfa-87c2-79bab0350d60 tempest-VolumesDeleteCascade-308204417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:55:59 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-7b885cba-764b-4bfa-87c2-79bab0350d60 tempest-VolumesDeleteCascade-308204417 None] Selected osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 as target Quobyte volume. {{(pid=81771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 17:55:59 devstack cinder-volume[81771]: INFO cinder.volume.drivers.remotefs [None req-7b885cba-764b-4bfa-87c2-79bab0350d60 tempest-VolumesDeleteCascade-308204417 None] casted to osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 Apr 22 17:55:59 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-7b885cba-764b-4bfa-87c2-79bab0350d60 tempest-VolumesDeleteCascade-308204417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b103161a-7291-4a16-b9ad-872efcc665a9 1073741824 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:55:59 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-4bb54373-a0a7-410e-8dfc-eb0d86d93ae6 tempest-GroupsTest-1625537742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20addcf1-40d0-4318-a48e-096d3e6b3da1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88ee3840-8fda-46e7-896b-d5641436d632', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:55:59 devstack sudo[87990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b103161a-7291-4a16-b9ad-872efcc665a9 1073741824 Apr 22 17:55:59 devstack sudo[87990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:55:59 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-4bb54373-a0a7-410e-8dfc-eb0d86d93ae6 tempest-GroupsTest-1625537742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd836314-9161-4348-9c0e-12ffe6d2c6e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:55:59 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-4bb54373-a0a7-410e-8dfc-eb0d86d93ae6 tempest-GroupsTest-1625537742 None] Volume volume-88ee3840-8fda-46e7-896b-d5641436d632 (88ee3840-8fda-46e7-896b-d5641436d632): created successfully Apr 22 17:55:59 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-4bb54373-a0a7-410e-8dfc-eb0d86d93ae6 tempest-GroupsTest-1625537742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd836314-9161-4348-9c0e-12ffe6d2c6e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:55:59 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-4bb54373-a0a7-410e-8dfc-eb0d86d93ae6 tempest-GroupsTest-1625537742 None] Flow 'volume_create_manager' (e1392353-122b-4b3e-b637-bfc87db472d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:55:59 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-4bb54373-a0a7-410e-8dfc-eb0d86d93ae6 tempest-GroupsTest-1625537742 None] Created volume successfully. Apr 22 17:56:00 devstack sudo[87990]: pam_unix(sudo:session): session closed for user root Apr 22 17:56:00 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-7b885cba-764b-4bfa-87c2-79bab0350d60 tempest-VolumesDeleteCascade-308204417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b103161a-7291-4a16-b9ad-872efcc665a9 1073741824" returned: 0 in 0.685s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:56:00 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-7b885cba-764b-4bfa-87c2-79bab0350d60 tempest-VolumesDeleteCascade-308204417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b103161a-7291-4a16-b9ad-872efcc665a9 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:56:00 devstack sudo[87996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b103161a-7291-4a16-b9ad-872efcc665a9 Apr 22 17:56:00 devstack sudo[87996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:56:00 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-4e4c5ca1-5aee-4429-b9d8-e182ed450dde tempest-VolumesActionsTest-84916959 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:56:00 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-3516bcdd-89e2-44c5-a940-45403d15c38d tempest-GroupsTest-1625537742 None] Update group completed successfully. Apr 22 17:56:00 devstack sudo[87996]: pam_unix(sudo:session): session closed for user root Apr 22 17:56:00 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-7b885cba-764b-4bfa-87c2-79bab0350d60 tempest-VolumesDeleteCascade-308204417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b103161a-7291-4a16-b9ad-872efcc665a9" returned: 0 in 0.455s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:56:00 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-7b885cba-764b-4bfa-87c2-79bab0350d60 tempest-VolumesDeleteCascade-308204417 None] <== create_volume: return (1181ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'} {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 17:56:00 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-7b885cba-764b-4bfa-87c2-79bab0350d60 tempest-VolumesDeleteCascade-308204417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.184s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:56:00 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-45dbef7b-adfd-4737-8d00-6efe64d5c585 tempest-CreateVolumesFromSnapshotTest-401145158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.494s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:56:00 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-45dbef7b-adfd-4737-8d00-6efe64d5c585 tempest-CreateVolumesFromSnapshotTest-401145158 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:55:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1190602591',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99b5cd7d-5139-4613-8517-312f9075d3e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3957959b6ebc404198d60e5c86311307',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:55:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:55:47Z,use_quota=True,user_id='76b25e93fa074cc3b5217e0e35652ef2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)}" {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 17:56:00 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-45dbef7b-adfd-4737-8d00-6efe64d5c585 tempest-CreateVolumesFromSnapshotTest-401145158 None] Creating volume 99b5cd7d-5139-4613-8517-312f9075d3e2 {{(pid=81771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 17:56:00 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-45dbef7b-adfd-4737-8d00-6efe64d5c585 tempest-CreateVolumesFromSnapshotTest-401145158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:56:00 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-45dbef7b-adfd-4737-8d00-6efe64d5c585 tempest-CreateVolumesFromSnapshotTest-401145158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:56:00 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-45dbef7b-adfd-4737-8d00-6efe64d5c585 tempest-CreateVolumesFromSnapshotTest-401145158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:56:00 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-45dbef7b-adfd-4737-8d00-6efe64d5c585 tempest-CreateVolumesFromSnapshotTest-401145158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:56:00 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-45dbef7b-adfd-4737-8d00-6efe64d5c585 tempest-CreateVolumesFromSnapshotTest-401145158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:56:00 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-45dbef7b-adfd-4737-8d00-6efe64d5c585 tempest-CreateVolumesFromSnapshotTest-401145158 None] Selected osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 as target Quobyte volume. {{(pid=81771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 17:56:00 devstack cinder-volume[81771]: INFO cinder.volume.drivers.remotefs [None req-45dbef7b-adfd-4737-8d00-6efe64d5c585 tempest-CreateVolumesFromSnapshotTest-401145158 None] casted to osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 Apr 22 17:56:00 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-45dbef7b-adfd-4737-8d00-6efe64d5c585 tempest-CreateVolumesFromSnapshotTest-401145158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-99b5cd7d-5139-4613-8517-312f9075d3e2 1073741824 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:56:00 devstack sudo[87999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-99b5cd7d-5139-4613-8517-312f9075d3e2 1073741824 Apr 22 17:56:00 devstack sudo[87999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:56:00 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-7b885cba-764b-4bfa-87c2-79bab0350d60 tempest-VolumesDeleteCascade-308204417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18712310-f308-40d6-9155-f57e4f43e799) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b103161a-7291-4a16-b9ad-872efcc665a9', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:56:00 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-7b885cba-764b-4bfa-87c2-79bab0350d60 tempest-VolumesDeleteCascade-308204417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7023b0f-168f-4929-88d3-263f09842403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:56:00 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-7b885cba-764b-4bfa-87c2-79bab0350d60 tempest-VolumesDeleteCascade-308204417 None] Volume volume-b103161a-7291-4a16-b9ad-872efcc665a9 (b103161a-7291-4a16-b9ad-872efcc665a9): created successfully Apr 22 17:56:00 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-7b885cba-764b-4bfa-87c2-79bab0350d60 tempest-VolumesDeleteCascade-308204417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7023b0f-168f-4929-88d3-263f09842403) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:56:00 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-7b885cba-764b-4bfa-87c2-79bab0350d60 tempest-VolumesDeleteCascade-308204417 None] Flow 'volume_create_manager' (2348f079-2c90-459a-b516-1d7a86c33bd7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:56:00 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-7b885cba-764b-4bfa-87c2-79bab0350d60 tempest-VolumesDeleteCascade-308204417 None] Created volume successfully. Apr 22 17:56:01 devstack sudo[87999]: pam_unix(sudo:session): session closed for user root Apr 22 17:56:01 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-45dbef7b-adfd-4737-8d00-6efe64d5c585 tempest-CreateVolumesFromSnapshotTest-401145158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-99b5cd7d-5139-4613-8517-312f9075d3e2 1073741824" returned: 0 in 0.649s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:56:01 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-45dbef7b-adfd-4737-8d00-6efe64d5c585 tempest-CreateVolumesFromSnapshotTest-401145158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-99b5cd7d-5139-4613-8517-312f9075d3e2 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:56:01 devstack sudo[88004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-99b5cd7d-5139-4613-8517-312f9075d3e2 Apr 22 17:56:01 devstack sudo[88004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:56:01 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-5ac73967-7cb8-4c1a-8817-61c1b12ff655 tempest-GroupsTest-1625537742 None] Update group completed successfully. Apr 22 17:56:02 devstack sudo[88004]: pam_unix(sudo:session): session closed for user root Apr 22 17:56:02 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-45dbef7b-adfd-4737-8d00-6efe64d5c585 tempest-CreateVolumesFromSnapshotTest-401145158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-99b5cd7d-5139-4613-8517-312f9075d3e2" returned: 0 in 0.494s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:56:02 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-45dbef7b-adfd-4737-8d00-6efe64d5c585 tempest-CreateVolumesFromSnapshotTest-401145158 None] <== create_volume: return (1182ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'} {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 17:56:02 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-45dbef7b-adfd-4737-8d00-6efe64d5c585 tempest-CreateVolumesFromSnapshotTest-401145158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.185s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:56:02 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-4e4c5ca1-5aee-4429-b9d8-e182ed450dde tempest-VolumesActionsTest-84916959 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 1.590s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:56:02 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-45dbef7b-adfd-4737-8d00-6efe64d5c585 tempest-CreateVolumesFromSnapshotTest-401145158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f408fb28-3d52-455b-b931-a413d29a6075) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99b5cd7d-5139-4613-8517-312f9075d3e2', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:56:02 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-45dbef7b-adfd-4737-8d00-6efe64d5c585 tempest-CreateVolumesFromSnapshotTest-401145158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (882da9ec-91a1-4c82-a116-33a1f00dfd1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:56:02 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cda1908-fa10-4847-bd43-b777103e91b3]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:56:02 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-4e4c5ca1-5aee-4429-b9d8-e182ed450dde tempest-VolumesActionsTest-84916959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e3664582-4810-4ace-9346-f53375c65ed6 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:56:02 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-45dbef7b-adfd-4737-8d00-6efe64d5c585 tempest-CreateVolumesFromSnapshotTest-401145158 None] Volume volume-99b5cd7d-5139-4613-8517-312f9075d3e2 (99b5cd7d-5139-4613-8517-312f9075d3e2): created successfully Apr 22 17:56:02 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-45dbef7b-adfd-4737-8d00-6efe64d5c585 tempest-CreateVolumesFromSnapshotTest-401145158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (882da9ec-91a1-4c82-a116-33a1f00dfd1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:56:02 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-45dbef7b-adfd-4737-8d00-6efe64d5c585 tempest-CreateVolumesFromSnapshotTest-401145158 None] Flow 'volume_create_manager' (5e4e6e40-090d-44eb-b41a-ffca48caf1ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:56:02 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-45dbef7b-adfd-4737-8d00-6efe64d5c585 tempest-CreateVolumesFromSnapshotTest-401145158 None] Created volume successfully. Apr 22 17:56:02 devstack sudo[88007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e3664582-4810-4ace-9346-f53375c65ed6 Apr 22 17:56:02 devstack sudo[88007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:56:02 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-4aa2dbc6-2dba-4098-b7f9-9ca533372341 tempest-VolumesDeleteCascade-308204417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:56:02 devstack sudo[88007]: pam_unix(sudo:session): session closed for user root Apr 22 17:56:02 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-4e4c5ca1-5aee-4429-b9d8-e182ed450dde tempest-VolumesActionsTest-84916959 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e3664582-4810-4ace-9346-f53375c65ed6" returned: 0 in 0.575s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:56:02 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[858c3929-71c5-4bc8-b1ab-9f87b2495068]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:56:02 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-4e4c5ca1-5aee-4429-b9d8-e182ed450dde tempest-VolumesActionsTest-84916959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e3664582-4810-4ace-9346-f53375c65ed6 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:56:02 devstack sudo[88012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e3664582-4810-4ace-9346-f53375c65ed6 Apr 22 17:56:02 devstack sudo[88012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:56:03 devstack sudo[88012]: pam_unix(sudo:session): session closed for user root Apr 22 17:56:03 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-4e4c5ca1-5aee-4429-b9d8-e182ed450dde tempest-VolumesActionsTest-84916959 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e3664582-4810-4ace-9346-f53375c65ed6" returned: 0 in 0.577s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:56:03 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-4e4c5ca1-5aee-4429-b9d8-e182ed450dde tempest-VolumesActionsTest-84916959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e3664582-4810-4ace-9346-f53375c65ed6 /opt/stack/data/cinder/conversion/e3664582-4810-4ace-9346-f53375c65ed6.temp_image.40916fad-b7e2-4211-b8a6-e7e05537fb28zxxmhzql.img {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:56:03 devstack sudo[88017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e3664582-4810-4ace-9346-f53375c65ed6 /opt/stack/data/cinder/conversion/e3664582-4810-4ace-9346-f53375c65ed6.temp_image.40916fad-b7e2-4211-b8a6-e7e05537fb28zxxmhzql.img Apr 22 17:56:03 devstack sudo[88017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:56:03 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-32664d7e-3060-43b9-a92f-77e5e38fda13 tempest-GroupsTest-1625537742 None] Acquiring lock "cinder-quobyte-23b808ca-c7cb-46e7-baaa-7b10fc5231b7" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:56:03 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-32664d7e-3060-43b9-a92f-77e5e38fda13 tempest-GroupsTest-1625537742 None] Lock "cinder-quobyte-23b808ca-c7cb-46e7-baaa-7b10fc5231b7" acquired by "delete_volume" :: waited 0.038s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:56:03 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d15fd31-906e-47fa-bae3-e07dc73564b0]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:56:03 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-32664d7e-3060-43b9-a92f-77e5e38fda13 tempest-GroupsTest-1625537742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-23b808ca-c7cb-46e7-baaa-7b10fc5231b7 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:56:03 devstack sudo[88019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-23b808ca-c7cb-46e7-baaa-7b10fc5231b7 Apr 22 17:56:03 devstack sudo[88019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:56:03 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-157b8eb7-98e3-419b-928c-31a2da0cce21 tempest-CreateVolumesFromSnapshotTest-401145158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:56:04 devstack sudo[88019]: pam_unix(sudo:session): session closed for user root Apr 22 17:56:04 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-32664d7e-3060-43b9-a92f-77e5e38fda13 tempest-GroupsTest-1625537742 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-23b808ca-c7cb-46e7-baaa-7b10fc5231b7" returned: 0 in 0.930s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:56:04 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-32664d7e-3060-43b9-a92f-77e5e38fda13 tempest-GroupsTest-1625537742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-23b808ca-c7cb-46e7-baaa-7b10fc5231b7 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:56:04 devstack sudo[88034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-23b808ca-c7cb-46e7-baaa-7b10fc5231b7 Apr 22 17:56:04 devstack sudo[88034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:56:05 devstack sudo[88034]: pam_unix(sudo:session): session closed for user root Apr 22 17:56:05 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-32664d7e-3060-43b9-a92f-77e5e38fda13 tempest-GroupsTest-1625537742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-23b808ca-c7cb-46e7-baaa-7b10fc5231b7" returned: 0 in 0.845s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:56:05 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-32664d7e-3060-43b9-a92f-77e5e38fda13 tempest-GroupsTest-1625537742 None] Lock "cinder-quobyte-23b808ca-c7cb-46e7-baaa-7b10fc5231b7" released by "delete_volume" :: held 1.840s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:56:05 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-32664d7e-3060-43b9-a92f-77e5e38fda13 tempest-GroupsTest-1625537742 None] Acquiring lock "cinder-quobyte-88ee3840-8fda-46e7-896b-d5641436d632" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:56:05 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-32664d7e-3060-43b9-a92f-77e5e38fda13 tempest-GroupsTest-1625537742 None] Lock "cinder-quobyte-88ee3840-8fda-46e7-896b-d5641436d632" acquired by "delete_volume" :: waited 0.031s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:56:05 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecb82760-b955-47ed-8322-4ddf45659b33]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:56:05 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-32664d7e-3060-43b9-a92f-77e5e38fda13 tempest-GroupsTest-1625537742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-88ee3840-8fda-46e7-896b-d5641436d632 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:56:05 devstack sudo[88037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-88ee3840-8fda-46e7-896b-d5641436d632 Apr 22 17:56:05 devstack sudo[88037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:56:06 devstack sudo[88037]: pam_unix(sudo:session): session closed for user root Apr 22 17:56:06 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-32664d7e-3060-43b9-a92f-77e5e38fda13 tempest-GroupsTest-1625537742 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-88ee3840-8fda-46e7-896b-d5641436d632" returned: 0 in 1.162s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:56:06 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-32664d7e-3060-43b9-a92f-77e5e38fda13 tempest-GroupsTest-1625537742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-88ee3840-8fda-46e7-896b-d5641436d632 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:56:06 devstack sudo[88042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-88ee3840-8fda-46e7-896b-d5641436d632 Apr 22 17:56:06 devstack sudo[88042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:56:07 devstack sudo[88042]: pam_unix(sudo:session): session closed for user root Apr 22 17:56:07 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-32664d7e-3060-43b9-a92f-77e5e38fda13 tempest-GroupsTest-1625537742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-88ee3840-8fda-46e7-896b-d5641436d632" returned: 0 in 1.321s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:56:07 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-32664d7e-3060-43b9-a92f-77e5e38fda13 tempest-GroupsTest-1625537742 None] Lock "cinder-quobyte-88ee3840-8fda-46e7-896b-d5641436d632" released by "delete_volume" :: held 2.574s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:56:08 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-32664d7e-3060-43b9-a92f-77e5e38fda13 tempest-GroupsTest-1625537742 None] Created reservations ['fc6cc9cd-f203-440e-864e-8e8f9c986ec6'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 17:56:08 devstack cinder-volume[81771]: WARNING cinder.quota [None req-32664d7e-3060-43b9-a92f-77e5e38fda13 tempest-GroupsTest-1625537742 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-2026608160 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-2026608160, it is now deprecated. Please use the default quota class for default quota. Apr 22 17:56:08 devstack cinder-volume[81771]: WARNING cinder.quota [None req-32664d7e-3060-43b9-a92f-77e5e38fda13 tempest-GroupsTest-1625537742 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-2026608160 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-2026608160, it is now deprecated. Please use the default quota class for default quota. Apr 22 17:56:08 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-32664d7e-3060-43b9-a92f-77e5e38fda13 tempest-GroupsTest-1625537742 None] Created reservations ['b752c2a1-9c2d-4a01-8482-56b30c70a9c4', '2a8a760a-7f0f-43b7-b5e8-637270fa53c3', '3379cf57-2728-4336-9fa6-7fe068e8ffcd', '3824da32-8eb9-495f-a778-962a2542ff4b'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 17:56:08 devstack sudo[88017]: pam_unix(sudo:session): session closed for user root Apr 22 17:56:08 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-4e4c5ca1-5aee-4429-b9d8-e182ed450dde tempest-VolumesActionsTest-84916959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e3664582-4810-4ace-9346-f53375c65ed6 /opt/stack/data/cinder/conversion/e3664582-4810-4ace-9346-f53375c65ed6.temp_image.40916fad-b7e2-4211-b8a6-e7e05537fb28zxxmhzql.img" returned: 0 in 5.050s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:56:08 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-32664d7e-3060-43b9-a92f-77e5e38fda13 tempest-GroupsTest-1625537742 None] Created reservations ['4c8a6ce1-d3e6-43f0-8b2b-28b853aa202c', '37fbe67d-e26e-4449-ab33-832413792771', 'e5b87e42-773f-45dd-b31c-823034bfaca4', 'ed50e5c2-668f-412f-af3f-637ebfd48a65'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 17:56:08 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[a117dd22-41f3-4f39-ab92-64235b370d7f]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:56:08 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-4e4c5ca1-5aee-4429-b9d8-e182ed450dde tempest-VolumesActionsTest-84916959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e3664582-4810-4ace-9346-f53375c65ed6 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:56:08 devstack sudo[88046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e3664582-4810-4ace-9346-f53375c65ed6 Apr 22 17:56:08 devstack sudo[88046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:56:08 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-32664d7e-3060-43b9-a92f-77e5e38fda13 tempest-GroupsTest-1625537742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:56:08 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-32664d7e-3060-43b9-a92f-77e5e38fda13 tempest-GroupsTest-1625537742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:56:08 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-32664d7e-3060-43b9-a92f-77e5e38fda13 tempest-GroupsTest-1625537742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:56:08 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-32664d7e-3060-43b9-a92f-77e5e38fda13 tempest-GroupsTest-1625537742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:56:08 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-32664d7e-3060-43b9-a92f-77e5e38fda13 tempest-GroupsTest-1625537742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:56:08 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-32664d7e-3060-43b9-a92f-77e5e38fda13 tempest-GroupsTest-1625537742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:56:08 devstack sudo[88048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 Apr 22 17:56:08 devstack sudo[88048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:56:08 devstack sudo[88048]: pam_unix(sudo:session): session closed for user root Apr 22 17:56:08 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-32664d7e-3060-43b9-a92f-77e5e38fda13 tempest-GroupsTest-1625537742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33" returned: 0 in 0.486s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:56:08 devstack cinder-volume[81771]: DEBUG cinder.manager [None req-32664d7e-3060-43b9-a92f-77e5e38fda13 tempest-GroupsTest-1625537742 None] Notifying Schedulers of capabilities ... {{(pid=81771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 17:56:08 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-32664d7e-3060-43b9-a92f-77e5e38fda13 tempest-GroupsTest-1625537742 None] Delete group completed successfully. Apr 22 17:56:09 devstack sudo[88046]: pam_unix(sudo:session): session closed for user root Apr 22 17:56:09 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-4e4c5ca1-5aee-4429-b9d8-e182ed450dde tempest-VolumesActionsTest-84916959 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e3664582-4810-4ace-9346-f53375c65ed6" returned: 0 in 0.691s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:56:09 devstack cinder-volume[81771]: DEBUG cinder.image.image_utils [None req-4e4c5ca1-5aee-4429-b9d8-e182ed450dde tempest-VolumesActionsTest-84916959 None] Image conversion details: src /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e3664582-4810-4ace-9346-f53375c65ed6, size 1024.00 MB, duration 5.05 sec, destination /opt/stack/data/cinder/conversion/e3664582-4810-4ace-9346-f53375c65ed6.temp_image.40916fad-b7e2-4211-b8a6-e7e05537fb28zxxmhzql.img {{(pid=81771) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 22 17:56:09 devstack cinder-volume[81771]: INFO cinder.image.image_utils [None req-4e4c5ca1-5aee-4429-b9d8-e182ed450dde tempest-VolumesActionsTest-84916959 None] Converted 1024.00 MB image at 202.68 MB/s Apr 22 17:56:09 devstack cinder-volume[81771]: DEBUG cinder.image.image_utils [None req-4e4c5ca1-5aee-4429-b9d8-e182ed450dde tempest-VolumesActionsTest-84916959 None] 40916fad-b7e2-4211-b8a6-e7e05537fb28 was raw, converting to qcow2 {{(pid=81771) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1176}} Apr 22 17:56:09 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6f8ba9a-9b57-46e6-83dd-ee45f2582968]: (4, 'raw') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:56:09 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-4e4c5ca1-5aee-4429-b9d8-e182ed450dde tempest-VolumesActionsTest-84916959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/e3664582-4810-4ace-9346-f53375c65ed6.temp_image.40916fad-b7e2-4211-b8a6-e7e05537fb28zxxmhzql.img {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:56:09 devstack sudo[88054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/e3664582-4810-4ace-9346-f53375c65ed6.temp_image.40916fad-b7e2-4211-b8a6-e7e05537fb28zxxmhzql.img Apr 22 17:56:09 devstack sudo[88054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:56:09 devstack sudo[88054]: pam_unix(sudo:session): session closed for user root Apr 22 17:56:09 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-4e4c5ca1-5aee-4429-b9d8-e182ed450dde tempest-VolumesActionsTest-84916959 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/e3664582-4810-4ace-9346-f53375c65ed6.temp_image.40916fad-b7e2-4211-b8a6-e7e05537fb28zxxmhzql.img" returned: 0 in 0.526s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:56:09 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-4e4c5ca1-5aee-4429-b9d8-e182ed450dde tempest-VolumesActionsTest-84916959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/e3664582-4810-4ace-9346-f53375c65ed6.temp_image.40916fad-b7e2-4211-b8a6-e7e05537fb28zxxmhzql.img {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:56:09 devstack sudo[88058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/e3664582-4810-4ace-9346-f53375c65ed6.temp_image.40916fad-b7e2-4211-b8a6-e7e05537fb28zxxmhzql.img Apr 22 17:56:09 devstack sudo[88058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:56:10 devstack sudo[88058]: pam_unix(sudo:session): session closed for user root Apr 22 17:56:10 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-4e4c5ca1-5aee-4429-b9d8-e182ed450dde tempest-VolumesActionsTest-84916959 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/e3664582-4810-4ace-9346-f53375c65ed6.temp_image.40916fad-b7e2-4211-b8a6-e7e05537fb28zxxmhzql.img" returned: 1 in 0.631s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:56:10 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-4e4c5ca1-5aee-4429-b9d8-e182ed450dde tempest-VolumesActionsTest-84916959 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/e3664582-4810-4ace-9346-f53375c65ed6.temp_image.40916fad-b7e2-4211-b8a6-e7e05537fb28zxxmhzql.img' failed. Not Retrying. {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 22 17:56:10 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-4e4c5ca1-5aee-4429-b9d8-e182ed450dde tempest-VolumesActionsTest-84916959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/e3664582-4810-4ace-9346-f53375c65ed6.temp_image.40916fad-b7e2-4211-b8a6-e7e05537fb28zxxmhzql.img /opt/stack/data/cinder/conversion/vol_upload_fl5mhts5 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:56:10 devstack sudo[88063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/e3664582-4810-4ace-9346-f53375c65ed6.temp_image.40916fad-b7e2-4211-b8a6-e7e05537fb28zxxmhzql.img /opt/stack/data/cinder/conversion/vol_upload_fl5mhts5 Apr 22 17:56:10 devstack sudo[88063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:56:10 devstack sudo[88063]: pam_unix(sudo:session): session closed for user root Apr 22 17:56:10 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-4e4c5ca1-5aee-4429-b9d8-e182ed450dde tempest-VolumesActionsTest-84916959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/e3664582-4810-4ace-9346-f53375c65ed6.temp_image.40916fad-b7e2-4211-b8a6-e7e05537fb28zxxmhzql.img /opt/stack/data/cinder/conversion/vol_upload_fl5mhts5" returned: 0 in 0.531s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:56:10 devstack cinder-volume[81771]: DEBUG cinder.image.image_utils [None req-4e4c5ca1-5aee-4429-b9d8-e182ed450dde tempest-VolumesActionsTest-84916959 None] Image conversion details: src /opt/stack/data/cinder/conversion/e3664582-4810-4ace-9346-f53375c65ed6.temp_image.40916fad-b7e2-4211-b8a6-e7e05537fb28zxxmhzql.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_fl5mhts5 {{(pid=81771) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 22 17:56:10 devstack cinder-volume[81771]: INFO cinder.image.image_utils [None req-4e4c5ca1-5aee-4429-b9d8-e182ed450dde tempest-VolumesActionsTest-84916959 None] Converted 1024.00 MB image at 1024.00 MB/s Apr 22 17:56:10 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa8d3c91-b824-4939-aab8-44f4c342fa61]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:56:10 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-4e4c5ca1-5aee-4429-b9d8-e182ed450dde tempest-VolumesActionsTest-84916959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_fl5mhts5 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:56:10 devstack sudo[88069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_fl5mhts5 Apr 22 17:56:10 devstack sudo[88069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:56:11 devstack sudo[88069]: pam_unix(sudo:session): session closed for user root Apr 22 17:56:11 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-4e4c5ca1-5aee-4429-b9d8-e182ed450dde tempest-VolumesActionsTest-84916959 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_fl5mhts5" returned: 0 in 0.527s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:56:12 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-4e4c5ca1-5aee-4429-b9d8-e182ed450dde tempest-VolumesActionsTest-84916959 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 10.746s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:56:12 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-4e4c5ca1-5aee-4429-b9d8-e182ed450dde tempest-VolumesActionsTest-84916959 None] Uploaded volume to glance image-id: 40916fad-b7e2-4211-b8a6-e7e05537fb28. {{(pid=81771) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 22 17:56:12 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-4aa2dbc6-2dba-4098-b7f9-9ca533372341 tempest-VolumesDeleteCascade-308204417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 10.516s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:56:12 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-4aa2dbc6-2dba-4098-b7f9-9ca533372341 tempest-VolumesDeleteCascade-308204417 None] Creating offline snapshot 9dccd7ff-900c-4bed-8db6-dad542f52205 of volume b103161a-7291-4a16-b9ad-872efcc665a9 {{(pid=81771) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 22 17:56:12 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-4e4c5ca1-5aee-4429-b9d8-e182ed450dde tempest-VolumesActionsTest-84916959 None] Copy volume to image completed successfully. Apr 22 17:56:12 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[0992f273-4d81-44ab-b313-cb708c7bf7e8]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:56:12 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-4aa2dbc6-2dba-4098-b7f9-9ca533372341 tempest-VolumesDeleteCascade-308204417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b103161a-7291-4a16-b9ad-872efcc665a9 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:56:12 devstack sudo[88074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b103161a-7291-4a16-b9ad-872efcc665a9 Apr 22 17:56:12 devstack sudo[88074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:56:13 devstack sudo[88074]: pam_unix(sudo:session): session closed for user root Apr 22 17:56:13 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-4aa2dbc6-2dba-4098-b7f9-9ca533372341 tempest-VolumesDeleteCascade-308204417 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b103161a-7291-4a16-b9ad-872efcc665a9" returned: 0 in 0.640s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:56:13 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-4aa2dbc6-2dba-4098-b7f9-9ca533372341 tempest-VolumesDeleteCascade-308204417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b103161a-7291-4a16-b9ad-872efcc665a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b103161a-7291-4a16-b9ad-872efcc665a9.9dccd7ff-900c-4bed-8db6-dad542f52205 1G {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:56:13 devstack sudo[88079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b103161a-7291-4a16-b9ad-872efcc665a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b103161a-7291-4a16-b9ad-872efcc665a9.9dccd7ff-900c-4bed-8db6-dad542f52205 1G Apr 22 17:56:13 devstack sudo[88079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:56:13 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-f30a442a-fa2d-49f7-b1cf-d86ad762de53 tempest-VolumesActionsTest-84916959 None] Acquiring lock "cinder-e3664582-4810-4ace-9346-f53375c65ed6-delete_volume" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:56:13 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-f30a442a-fa2d-49f7-b1cf-d86ad762de53 tempest-VolumesActionsTest-84916959 None] Lock "cinder-e3664582-4810-4ace-9346-f53375c65ed6-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:56:13 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-f30a442a-fa2d-49f7-b1cf-d86ad762de53 tempest-VolumesActionsTest-84916959 None] Acquiring lock "cinder-quobyte-e3664582-4810-4ace-9346-f53375c65ed6" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:56:13 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-f30a442a-fa2d-49f7-b1cf-d86ad762de53 tempest-VolumesActionsTest-84916959 None] Lock "cinder-quobyte-e3664582-4810-4ace-9346-f53375c65ed6" acquired by "delete_volume" :: waited 0.020s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:56:13 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[efe713a3-36c7-4929-af74-5e9ee5536e35]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:56:13 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-f30a442a-fa2d-49f7-b1cf-d86ad762de53 tempest-VolumesActionsTest-84916959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e3664582-4810-4ace-9346-f53375c65ed6 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:56:13 devstack sudo[88081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e3664582-4810-4ace-9346-f53375c65ed6 Apr 22 17:56:13 devstack sudo[88081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:56:14 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-612f0472-c167-4e51-b742-53233567d709 tempest-GroupsV320Test-848140594 None] Group tempest-GroupsV320Test-Group-518065375: creating Apr 22 17:56:14 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-612f0472-c167-4e51-b742-53233567d709 tempest-GroupsV320Test-848140594 None] Group tempest-GroupsV320Test-Group-518065375: created successfully Apr 22 17:56:14 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-612f0472-c167-4e51-b742-53233567d709 tempest-GroupsV320Test-848140594 None] Create group completed successfully. Apr 22 17:56:14 devstack sudo[88079]: pam_unix(sudo:session): session closed for user root Apr 22 17:56:14 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-4aa2dbc6-2dba-4098-b7f9-9ca533372341 tempest-VolumesDeleteCascade-308204417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b103161a-7291-4a16-b9ad-872efcc665a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b103161a-7291-4a16-b9ad-872efcc665a9.9dccd7ff-900c-4bed-8db6-dad542f52205 1G" returned: 0 in 0.720s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:56:14 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-4aa2dbc6-2dba-4098-b7f9-9ca533372341 tempest-VolumesDeleteCascade-308204417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b103161a-7291-4a16-b9ad-872efcc665a9 -F qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b103161a-7291-4a16-b9ad-872efcc665a9.9dccd7ff-900c-4bed-8db6-dad542f52205 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:56:14 devstack sudo[88089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b103161a-7291-4a16-b9ad-872efcc665a9 -F qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b103161a-7291-4a16-b9ad-872efcc665a9.9dccd7ff-900c-4bed-8db6-dad542f52205 Apr 22 17:56:14 devstack sudo[88089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:56:14 devstack sudo[88081]: pam_unix(sudo:session): session closed for user root Apr 22 17:56:14 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-f30a442a-fa2d-49f7-b1cf-d86ad762de53 tempest-VolumesActionsTest-84916959 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e3664582-4810-4ace-9346-f53375c65ed6" returned: 0 in 0.601s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:56:14 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-f30a442a-fa2d-49f7-b1cf-d86ad762de53 tempest-VolumesActionsTest-84916959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e3664582-4810-4ace-9346-f53375c65ed6 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:56:14 devstack sudo[88091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e3664582-4810-4ace-9346-f53375c65ed6 Apr 22 17:56:14 devstack sudo[88091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:56:14 devstack sudo[88091]: pam_unix(sudo:session): session closed for user root Apr 22 17:56:14 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-f30a442a-fa2d-49f7-b1cf-d86ad762de53 tempest-VolumesActionsTest-84916959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e3664582-4810-4ace-9346-f53375c65ed6" returned: 0 in 0.465s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:56:14 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-f30a442a-fa2d-49f7-b1cf-d86ad762de53 tempest-VolumesActionsTest-84916959 None] Lock "cinder-quobyte-e3664582-4810-4ace-9346-f53375c65ed6" released by "delete_volume" :: held 1.102s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:56:14 devstack sudo[88089]: pam_unix(sudo:session): session closed for user root Apr 22 17:56:14 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-4aa2dbc6-2dba-4098-b7f9-9ca533372341 tempest-VolumesDeleteCascade-308204417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b103161a-7291-4a16-b9ad-872efcc665a9 -F qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b103161a-7291-4a16-b9ad-872efcc665a9.9dccd7ff-900c-4bed-8db6-dad542f52205" returned: 0 in 0.516s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:56:14 devstack cinder-volume[81771]: WARNING cinder.volume.drivers.remotefs [None req-4aa2dbc6-2dba-4098-b7f9-9ca533372341 tempest-VolumesDeleteCascade-308204417 None] /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b103161a-7291-4a16-b9ad-872efcc665a9.9dccd7ff-900c-4bed-8db6-dad542f52205 is being set with open permissions: ugo+rw Apr 22 17:56:14 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-4aa2dbc6-2dba-4098-b7f9-9ca533372341 tempest-VolumesDeleteCascade-308204417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b103161a-7291-4a16-b9ad-872efcc665a9.9dccd7ff-900c-4bed-8db6-dad542f52205 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:56:14 devstack sudo[88097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b103161a-7291-4a16-b9ad-872efcc665a9.9dccd7ff-900c-4bed-8db6-dad542f52205 Apr 22 17:56:14 devstack sudo[88097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:56:14 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-f30a442a-fa2d-49f7-b1cf-d86ad762de53 tempest-VolumesActionsTest-84916959 None] Created reservations ['d88a6acc-b6a8-4ba5-883a-18b0fe0722ba', 'bc5c44d0-597d-4568-9843-0793b8332d95', '37b8563b-23e8-4b3d-b528-70d397f5ce61', '13a1cbae-b177-41f5-b873-a49cdfd90264'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 17:56:14 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-f30a442a-fa2d-49f7-b1cf-d86ad762de53 tempest-VolumesActionsTest-84916959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:56:14 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-f30a442a-fa2d-49f7-b1cf-d86ad762de53 tempest-VolumesActionsTest-84916959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:56:14 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-f30a442a-fa2d-49f7-b1cf-d86ad762de53 tempest-VolumesActionsTest-84916959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:56:14 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-f30a442a-fa2d-49f7-b1cf-d86ad762de53 tempest-VolumesActionsTest-84916959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:56:14 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-f30a442a-fa2d-49f7-b1cf-d86ad762de53 tempest-VolumesActionsTest-84916959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:56:14 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-f30a442a-fa2d-49f7-b1cf-d86ad762de53 tempest-VolumesActionsTest-84916959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:56:14 devstack sudo[88099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 Apr 22 17:56:14 devstack sudo[88099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:56:15 devstack sudo[88097]: pam_unix(sudo:session): session closed for user root Apr 22 17:56:15 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-4aa2dbc6-2dba-4098-b7f9-9ca533372341 tempest-VolumesDeleteCascade-308204417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b103161a-7291-4a16-b9ad-872efcc665a9.9dccd7ff-900c-4bed-8db6-dad542f52205" returned: 0 in 0.513s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:56:15 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-4aa2dbc6-2dba-4098-b7f9-9ca533372341 tempest-VolumesDeleteCascade-308204417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b103161a-7291-4a16-b9ad-872efcc665a9.info {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:56:15 devstack sudo[88103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b103161a-7291-4a16-b9ad-872efcc665a9.info Apr 22 17:56:15 devstack sudo[88103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:56:15 devstack sudo[88099]: pam_unix(sudo:session): session closed for user root Apr 22 17:56:15 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-f30a442a-fa2d-49f7-b1cf-d86ad762de53 tempest-VolumesActionsTest-84916959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33" returned: 0 in 0.514s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:56:15 devstack cinder-volume[81771]: DEBUG cinder.manager [None req-f30a442a-fa2d-49f7-b1cf-d86ad762de53 tempest-VolumesActionsTest-84916959 None] Notifying Schedulers of capabilities ... {{(pid=81771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 17:56:15 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-f30a442a-fa2d-49f7-b1cf-d86ad762de53 tempest-VolumesActionsTest-84916959 None] Deleted volume successfully. Apr 22 17:56:15 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-f30a442a-fa2d-49f7-b1cf-d86ad762de53 tempest-VolumesActionsTest-84916959 None] Lock "cinder-e3664582-4810-4ace-9346-f53375c65ed6-delete_volume" released by "delete_volume" :: held 1.834s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:56:15 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-e9cc513c-d238-48d1-b8b6-6dd3f9177a3c tempest-GroupsV320Test-848140594 None] Created reservations ['b315b47e-dbdc-4642-8a01-f74094857d2b'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 17:56:15 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-e9cc513c-d238-48d1-b8b6-6dd3f9177a3c tempest-GroupsV320Test-848140594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:56:15 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-e9cc513c-d238-48d1-b8b6-6dd3f9177a3c tempest-GroupsV320Test-848140594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:56:15 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-e9cc513c-d238-48d1-b8b6-6dd3f9177a3c tempest-GroupsV320Test-848140594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:56:15 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-e9cc513c-d238-48d1-b8b6-6dd3f9177a3c tempest-GroupsV320Test-848140594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:56:15 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-e9cc513c-d238-48d1-b8b6-6dd3f9177a3c tempest-GroupsV320Test-848140594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:56:15 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-e9cc513c-d238-48d1-b8b6-6dd3f9177a3c tempest-GroupsV320Test-848140594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:56:15 devstack sudo[88105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 Apr 22 17:56:15 devstack sudo[88105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:56:15 devstack sudo[88103]: pam_unix(sudo:session): session closed for user root Apr 22 17:56:15 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-4aa2dbc6-2dba-4098-b7f9-9ca533372341 tempest-VolumesDeleteCascade-308204417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b103161a-7291-4a16-b9ad-872efcc665a9.info" returned: 0 in 0.517s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:56:15 devstack cinder-volume[81771]: WARNING cinder.volume.drivers.remotefs [None req-4aa2dbc6-2dba-4098-b7f9-9ca533372341 tempest-VolumesDeleteCascade-308204417 None] /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b103161a-7291-4a16-b9ad-872efcc665a9.info is being set with open permissions: ugo+rw Apr 22 17:56:15 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-4aa2dbc6-2dba-4098-b7f9-9ca533372341 tempest-VolumesDeleteCascade-308204417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b103161a-7291-4a16-b9ad-872efcc665a9.info {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:56:15 devstack sudo[88108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b103161a-7291-4a16-b9ad-872efcc665a9.info Apr 22 17:56:15 devstack sudo[88108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:56:16 devstack sudo[88105]: pam_unix(sudo:session): session closed for user root Apr 22 17:56:16 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-e9cc513c-d238-48d1-b8b6-6dd3f9177a3c tempest-GroupsV320Test-848140594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33" returned: 0 in 0.464s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:56:16 devstack cinder-volume[81771]: DEBUG cinder.manager [None req-e9cc513c-d238-48d1-b8b6-6dd3f9177a3c tempest-GroupsV320Test-848140594 None] Notifying Schedulers of capabilities ... {{(pid=81771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 17:56:16 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-e9cc513c-d238-48d1-b8b6-6dd3f9177a3c tempest-GroupsV320Test-848140594 None] Delete group completed successfully. Apr 22 17:56:16 devstack sudo[88108]: pam_unix(sudo:session): session closed for user root Apr 22 17:56:16 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-4aa2dbc6-2dba-4098-b7f9-9ca533372341 tempest-VolumesDeleteCascade-308204417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b103161a-7291-4a16-b9ad-872efcc665a9.info" returned: 0 in 0.471s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:56:16 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-4aa2dbc6-2dba-4098-b7f9-9ca533372341 tempest-VolumesDeleteCascade-308204417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.483s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:56:16 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-157b8eb7-98e3-419b-928c-31a2da0cce21 tempest-CreateVolumesFromSnapshotTest-401145158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 12.818s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:56:16 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-4aa2dbc6-2dba-4098-b7f9-9ca533372341 tempest-VolumesDeleteCascade-308204417 None] Create snapshot completed successfully Apr 22 17:56:16 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-157b8eb7-98e3-419b-928c-31a2da0cce21 tempest-CreateVolumesFromSnapshotTest-401145158 None] Creating offline snapshot bafe583a-6dc5-4f86-8565-c516ccc50cee of volume 99b5cd7d-5139-4613-8517-312f9075d3e2 {{(pid=81771) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 22 17:56:16 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f7d8a8e-de2b-4955-9b70-9ca167809c34]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:56:16 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-157b8eb7-98e3-419b-928c-31a2da0cce21 tempest-CreateVolumesFromSnapshotTest-401145158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-99b5cd7d-5139-4613-8517-312f9075d3e2 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:56:16 devstack sudo[88112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-99b5cd7d-5139-4613-8517-312f9075d3e2 Apr 22 17:56:16 devstack sudo[88112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:56:17 devstack sudo[88112]: pam_unix(sudo:session): session closed for user root Apr 22 17:56:17 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-157b8eb7-98e3-419b-928c-31a2da0cce21 tempest-CreateVolumesFromSnapshotTest-401145158 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-99b5cd7d-5139-4613-8517-312f9075d3e2" returned: 0 in 0.696s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:56:17 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-157b8eb7-98e3-419b-928c-31a2da0cce21 tempest-CreateVolumesFromSnapshotTest-401145158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-99b5cd7d-5139-4613-8517-312f9075d3e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-99b5cd7d-5139-4613-8517-312f9075d3e2.bafe583a-6dc5-4f86-8565-c516ccc50cee 1G {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:56:17 devstack sudo[88118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-99b5cd7d-5139-4613-8517-312f9075d3e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-99b5cd7d-5139-4613-8517-312f9075d3e2.bafe583a-6dc5-4f86-8565-c516ccc50cee 1G Apr 22 17:56:17 devstack sudo[88118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:56:17 devstack cinder-volume[81771]: DEBUG cinder.volume.flows.manager.create_volume [None req-b05b766e-eb26-4c42-b80d-55bf4d2422a4 tempest-VolumesDeleteCascade-308204417 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 17:56:17 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-b05b766e-eb26-4c42-b80d-55bf4d2422a4 tempest-VolumesDeleteCascade-308204417 None] Flow 'volume_create_manager' (4d1bf6b7-8ccf-458a-934b-deed1880fe80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:56:17 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-b05b766e-eb26-4c42-b80d-55bf4d2422a4 tempest-VolumesDeleteCascade-308204417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b47a34a3-38c6-435d-8d4d-87927515b9ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:56:17 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-b05b766e-eb26-4c42-b80d-55bf4d2422a4 tempest-VolumesDeleteCascade-308204417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b47a34a3-38c6-435d-8d4d-87927515b9ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:56:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-770050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2286ec10-4a28-42b7-b157-68935cbbda6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='154083d43f2f440aaa83a702c5251116',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:56:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9dccd7ff-900c-4bed-8db6-dad542f52205,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:56:18Z,use_quota=True,user_id='c8ae13f6f3664463b4fe3ae68f68126c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:56:17 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-b05b766e-eb26-4c42-b80d-55bf4d2422a4 tempest-VolumesDeleteCascade-308204417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54d44325-5ea0-41ab-87f2-ca3d8aef3058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:56:17 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-b05b766e-eb26-4c42-b80d-55bf4d2422a4 tempest-VolumesDeleteCascade-308204417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54d44325-5ea0-41ab-87f2-ca3d8aef3058) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:56:17 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-b05b766e-eb26-4c42-b80d-55bf4d2422a4 tempest-VolumesDeleteCascade-308204417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (499eb8ff-49a1-4efc-9037-14979644eedf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:56:17 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-b05b766e-eb26-4c42-b80d-55bf4d2422a4 tempest-VolumesDeleteCascade-308204417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (499eb8ff-49a1-4efc-9037-14979644eedf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2286ec10-4a28-42b7-b157-68935cbbda6d', 'volume_name': 'volume-2286ec10-4a28-42b7-b157-68935cbbda6d', 'volume_size': 1, 'snapshot_id': '9dccd7ff-900c-4bed-8db6-dad542f52205'}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:56:17 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-b05b766e-eb26-4c42-b80d-55bf4d2422a4 tempest-VolumesDeleteCascade-308204417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09361fa1-4fbf-4d9e-9e5c-545a950f13ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:56:17 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-b05b766e-eb26-4c42-b80d-55bf4d2422a4 tempest-VolumesDeleteCascade-308204417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09361fa1-4fbf-4d9e-9e5c-545a950f13ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:56:17 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-b05b766e-eb26-4c42-b80d-55bf4d2422a4 tempest-VolumesDeleteCascade-308204417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c8c565b-e6a2-4f75-8914-5a54baf0b23c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:56:17 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-b05b766e-eb26-4c42-b80d-55bf4d2422a4 tempest-VolumesDeleteCascade-308204417 None] Volume 2286ec10-4a28-42b7-b157-68935cbbda6d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2286ec10-4a28-42b7-b157-68935cbbda6d', 'volume_size': 1, 'snapshot_id': '9dccd7ff-900c-4bed-8db6-dad542f52205'} Apr 22 17:56:17 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-b05b766e-eb26-4c42-b80d-55bf4d2422a4 tempest-VolumesDeleteCascade-308204417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:56:17 devstack sudo[88118]: pam_unix(sudo:session): session closed for user root Apr 22 17:56:17 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-157b8eb7-98e3-419b-928c-31a2da0cce21 tempest-CreateVolumesFromSnapshotTest-401145158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-99b5cd7d-5139-4613-8517-312f9075d3e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-99b5cd7d-5139-4613-8517-312f9075d3e2.bafe583a-6dc5-4f86-8565-c516ccc50cee 1G" returned: 0 in 0.858s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:56:17 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-157b8eb7-98e3-419b-928c-31a2da0cce21 tempest-CreateVolumesFromSnapshotTest-401145158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99b5cd7d-5139-4613-8517-312f9075d3e2 -F qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-99b5cd7d-5139-4613-8517-312f9075d3e2.bafe583a-6dc5-4f86-8565-c516ccc50cee {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:56:17 devstack sudo[88124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99b5cd7d-5139-4613-8517-312f9075d3e2 -F qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-99b5cd7d-5139-4613-8517-312f9075d3e2.bafe583a-6dc5-4f86-8565-c516ccc50cee Apr 22 17:56:17 devstack sudo[88124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:56:18 devstack sudo[88124]: pam_unix(sudo:session): session closed for user root Apr 22 17:56:18 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-157b8eb7-98e3-419b-928c-31a2da0cce21 tempest-CreateVolumesFromSnapshotTest-401145158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99b5cd7d-5139-4613-8517-312f9075d3e2 -F qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-99b5cd7d-5139-4613-8517-312f9075d3e2.bafe583a-6dc5-4f86-8565-c516ccc50cee" returned: 0 in 0.660s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:56:18 devstack cinder-volume[81771]: WARNING cinder.volume.drivers.remotefs [None req-157b8eb7-98e3-419b-928c-31a2da0cce21 tempest-CreateVolumesFromSnapshotTest-401145158 None] /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-99b5cd7d-5139-4613-8517-312f9075d3e2.bafe583a-6dc5-4f86-8565-c516ccc50cee is being set with open permissions: ugo+rw Apr 22 17:56:18 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-157b8eb7-98e3-419b-928c-31a2da0cce21 tempest-CreateVolumesFromSnapshotTest-401145158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-99b5cd7d-5139-4613-8517-312f9075d3e2.bafe583a-6dc5-4f86-8565-c516ccc50cee {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:56:18 devstack sudo[88129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-99b5cd7d-5139-4613-8517-312f9075d3e2.bafe583a-6dc5-4f86-8565-c516ccc50cee Apr 22 17:56:18 devstack sudo[88129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:56:19 devstack sudo[88129]: pam_unix(sudo:session): session closed for user root Apr 22 17:56:19 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-157b8eb7-98e3-419b-928c-31a2da0cce21 tempest-CreateVolumesFromSnapshotTest-401145158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-99b5cd7d-5139-4613-8517-312f9075d3e2.bafe583a-6dc5-4f86-8565-c516ccc50cee" returned: 0 in 0.594s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:56:19 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-157b8eb7-98e3-419b-928c-31a2da0cce21 tempest-CreateVolumesFromSnapshotTest-401145158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-99b5cd7d-5139-4613-8517-312f9075d3e2.info {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:56:19 devstack sudo[88132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-99b5cd7d-5139-4613-8517-312f9075d3e2.info Apr 22 17:56:19 devstack sudo[88132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:56:19 devstack sudo[88132]: pam_unix(sudo:session): session closed for user root Apr 22 17:56:19 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-157b8eb7-98e3-419b-928c-31a2da0cce21 tempest-CreateVolumesFromSnapshotTest-401145158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-99b5cd7d-5139-4613-8517-312f9075d3e2.info" returned: 0 in 0.524s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:56:19 devstack cinder-volume[81771]: WARNING cinder.volume.drivers.remotefs [None req-157b8eb7-98e3-419b-928c-31a2da0cce21 tempest-CreateVolumesFromSnapshotTest-401145158 None] /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-99b5cd7d-5139-4613-8517-312f9075d3e2.info is being set with open permissions: ugo+rw Apr 22 17:56:19 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-157b8eb7-98e3-419b-928c-31a2da0cce21 tempest-CreateVolumesFromSnapshotTest-401145158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-99b5cd7d-5139-4613-8517-312f9075d3e2.info {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:56:19 devstack sudo[88136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-99b5cd7d-5139-4613-8517-312f9075d3e2.info Apr 22 17:56:19 devstack sudo[88136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:56:20 devstack sudo[88136]: pam_unix(sudo:session): session closed for user root Apr 22 17:56:20 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-157b8eb7-98e3-419b-928c-31a2da0cce21 tempest-CreateVolumesFromSnapshotTest-401145158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-99b5cd7d-5139-4613-8517-312f9075d3e2.info" returned: 0 in 0.563s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:56:20 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-157b8eb7-98e3-419b-928c-31a2da0cce21 tempest-CreateVolumesFromSnapshotTest-401145158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.014s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:56:20 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-b05b766e-eb26-4c42-b80d-55bf4d2422a4 tempest-VolumesDeleteCascade-308204417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.587s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:56:20 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-b05b766e-eb26-4c42-b80d-55bf4d2422a4 tempest-VolumesDeleteCascade-308204417 None] Acquiring lock "cinder-quobyte-9dccd7ff-900c-4bed-8db6-dad542f52205-2286ec10-4a28-42b7-b157-68935cbbda6d" by "_create_volume_from_snapshot" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:56:20 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-b05b766e-eb26-4c42-b80d-55bf4d2422a4 tempest-VolumesDeleteCascade-308204417 None] Lock "cinder-quobyte-9dccd7ff-900c-4bed-8db6-dad542f52205-2286ec10-4a28-42b7-b157-68935cbbda6d" acquired by "_create_volume_from_snapshot" :: waited 0.055s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:56:20 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-b05b766e-eb26-4c42-b80d-55bf4d2422a4 tempest-VolumesDeleteCascade-308204417 None] Creating volume 2286ec10-4a28-42b7-b157-68935cbbda6d from snapshot 9dccd7ff-900c-4bed-8db6-dad542f52205 {{(pid=81771) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 22 17:56:20 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-b05b766e-eb26-4c42-b80d-55bf4d2422a4 tempest-VolumesDeleteCascade-308204417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:56:20 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-b05b766e-eb26-4c42-b80d-55bf4d2422a4 tempest-VolumesDeleteCascade-308204417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:56:20 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-b05b766e-eb26-4c42-b80d-55bf4d2422a4 tempest-VolumesDeleteCascade-308204417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:56:20 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-b05b766e-eb26-4c42-b80d-55bf4d2422a4 tempest-VolumesDeleteCascade-308204417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:56:20 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-b05b766e-eb26-4c42-b80d-55bf4d2422a4 tempest-VolumesDeleteCascade-308204417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:56:20 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-b05b766e-eb26-4c42-b80d-55bf4d2422a4 tempest-VolumesDeleteCascade-308204417 None] Selected osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 as target Quobyte volume. {{(pid=81771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 17:56:20 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-b05b766e-eb26-4c42-b80d-55bf4d2422a4 tempest-VolumesDeleteCascade-308204417 None] Acquiring lock "cinder-quobyte-2286ec10-4a28-42b7-b157-68935cbbda6d" by "_copy_volume_from_snapshot" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:56:20 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-157b8eb7-98e3-419b-928c-31a2da0cce21 tempest-CreateVolumesFromSnapshotTest-401145158 None] Create snapshot completed successfully Apr 22 17:56:20 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-b05b766e-eb26-4c42-b80d-55bf4d2422a4 tempest-VolumesDeleteCascade-308204417 None] Lock "cinder-quobyte-2286ec10-4a28-42b7-b157-68935cbbda6d" acquired by "_copy_volume_from_snapshot" :: waited 0.049s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:56:20 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-b05b766e-eb26-4c42-b80d-55bf4d2422a4 tempest-VolumesDeleteCascade-308204417 None] snapshot: 9dccd7ff-900c-4bed-8db6-dad542f52205, volume: 2286ec10-4a28-42b7-b157-68935cbbda6d, {{(pid=81771) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 22 17:56:20 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-b05b766e-eb26-4c42-b80d-55bf4d2422a4 tempest-VolumesDeleteCascade-308204417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:56:20 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-b05b766e-eb26-4c42-b80d-55bf4d2422a4 tempest-VolumesDeleteCascade-308204417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:56:20 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-b05b766e-eb26-4c42-b80d-55bf4d2422a4 tempest-VolumesDeleteCascade-308204417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:56:20 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-b05b766e-eb26-4c42-b80d-55bf4d2422a4 tempest-VolumesDeleteCascade-308204417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:56:20 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-b05b766e-eb26-4c42-b80d-55bf4d2422a4 tempest-VolumesDeleteCascade-308204417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:56:20 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[03864d32-95a5-4459-b8d1-f92c047d2934]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:56:20 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-b05b766e-eb26-4c42-b80d-55bf4d2422a4 tempest-VolumesDeleteCascade-308204417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b103161a-7291-4a16-b9ad-872efcc665a9.9dccd7ff-900c-4bed-8db6-dad542f52205 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:56:20 devstack sudo[88139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b103161a-7291-4a16-b9ad-872efcc665a9.9dccd7ff-900c-4bed-8db6-dad542f52205 Apr 22 17:56:20 devstack sudo[88139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:56:21 devstack sudo[88139]: pam_unix(sudo:session): session closed for user root Apr 22 17:56:21 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-b05b766e-eb26-4c42-b80d-55bf4d2422a4 tempest-VolumesDeleteCascade-308204417 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b103161a-7291-4a16-b9ad-872efcc665a9.9dccd7ff-900c-4bed-8db6-dad542f52205" returned: 0 in 0.583s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:56:21 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-b05b766e-eb26-4c42-b80d-55bf4d2422a4 tempest-VolumesDeleteCascade-308204417 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b103161a-7291-4a16-b9ad-872efcc665a9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81771) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 22 17:56:21 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-b05b766e-eb26-4c42-b80d-55bf4d2422a4 tempest-VolumesDeleteCascade-308204417 None] will copy from snapshot at /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b103161a-7291-4a16-b9ad-872efcc665a9 {{(pid=81771) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 22 17:56:21 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-b05b766e-eb26-4c42-b80d-55bf4d2422a4 tempest-VolumesDeleteCascade-308204417 None] Creating direct copy from snapshot {{(pid=81771) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 22 17:56:21 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b446846-a100-4711-9acb-fca6424834f9]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:56:21 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-b05b766e-eb26-4c42-b80d-55bf4d2422a4 tempest-VolumesDeleteCascade-308204417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b103161a-7291-4a16-b9ad-872efcc665a9 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:56:21 devstack sudo[88144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b103161a-7291-4a16-b9ad-872efcc665a9 Apr 22 17:56:21 devstack sudo[88144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:56:21 devstack cinder-volume[81771]: DEBUG cinder.volume.flows.manager.create_volume [None req-17afa701-31ca-43e1-9d46-5bfa0bab458d tempest-CreateVolumesFromSnapshotTest-401145158 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 17:56:21 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-17afa701-31ca-43e1-9d46-5bfa0bab458d tempest-CreateVolumesFromSnapshotTest-401145158 None] Flow 'volume_create_manager' (120e0886-9aaa-4f70-afce-dd26c0f4cc0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:56:21 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-17afa701-31ca-43e1-9d46-5bfa0bab458d tempest-CreateVolumesFromSnapshotTest-401145158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e8c0a08-0e19-4c05-8563-d93d4fa62ca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:56:21 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-17afa701-31ca-43e1-9d46-5bfa0bab458d tempest-CreateVolumesFromSnapshotTest-401145158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e8c0a08-0e19-4c05-8563-d93d4fa62ca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:56:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-365166876',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67a23ab0-e603-4ee2-83be-5fcc299cb2fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3957959b6ebc404198d60e5c86311307',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:56:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:56:22Z,use_quota=True,user_id='76b25e93fa074cc3b5217e0e35652ef2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:56:21 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-17afa701-31ca-43e1-9d46-5bfa0bab458d tempest-CreateVolumesFromSnapshotTest-401145158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a91778b5-046f-4875-9040-a9a017675f1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:56:21 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-17afa701-31ca-43e1-9d46-5bfa0bab458d tempest-CreateVolumesFromSnapshotTest-401145158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a91778b5-046f-4875-9040-a9a017675f1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:56:21 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-17afa701-31ca-43e1-9d46-5bfa0bab458d tempest-CreateVolumesFromSnapshotTest-401145158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6404aa38-bd90-420a-9eae-e4b4f4ea84c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:56:21 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-17afa701-31ca-43e1-9d46-5bfa0bab458d tempest-CreateVolumesFromSnapshotTest-401145158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6404aa38-bd90-420a-9eae-e4b4f4ea84c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67a23ab0-e603-4ee2-83be-5fcc299cb2fa', 'volume_name': 'volume-67a23ab0-e603-4ee2-83be-5fcc299cb2fa', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:56:21 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-17afa701-31ca-43e1-9d46-5bfa0bab458d tempest-CreateVolumesFromSnapshotTest-401145158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad42733a-6e51-44ee-ae36-bae29e474014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:56:21 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-17afa701-31ca-43e1-9d46-5bfa0bab458d tempest-CreateVolumesFromSnapshotTest-401145158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad42733a-6e51-44ee-ae36-bae29e474014) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:56:21 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-17afa701-31ca-43e1-9d46-5bfa0bab458d tempest-CreateVolumesFromSnapshotTest-401145158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b6c557e-26d5-4ebe-9822-7c5d22883e47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:56:21 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-17afa701-31ca-43e1-9d46-5bfa0bab458d tempest-CreateVolumesFromSnapshotTest-401145158 None] Volume 67a23ab0-e603-4ee2-83be-5fcc299cb2fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67a23ab0-e603-4ee2-83be-5fcc299cb2fa', 'volume_size': 1} Apr 22 17:56:21 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-17afa701-31ca-43e1-9d46-5bfa0bab458d tempest-CreateVolumesFromSnapshotTest-401145158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:56:21 devstack sudo[88144]: pam_unix(sudo:session): session closed for user root Apr 22 17:56:21 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-b05b766e-eb26-4c42-b80d-55bf4d2422a4 tempest-VolumesDeleteCascade-308204417 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b103161a-7291-4a16-b9ad-872efcc665a9" returned: 0 in 0.659s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:56:21 devstack cinder-volume[81771]: DEBUG cinder.utils [None req-b05b766e-eb26-4c42-b80d-55bf4d2422a4 tempest-VolumesDeleteCascade-308204417 None] Path /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-2286ec10-4a28-42b7-b157-68935cbbda6d not found in is_blk_device check {{(pid=81771) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 22 17:56:21 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-b05b766e-eb26-4c42-b80d-55bf4d2422a4 tempest-VolumesDeleteCascade-308204417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b103161a-7291-4a16-b9ad-872efcc665a9 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-2286ec10-4a28-42b7-b157-68935cbbda6d {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:56:21 devstack sudo[88149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b103161a-7291-4a16-b9ad-872efcc665a9 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-2286ec10-4a28-42b7-b157-68935cbbda6d Apr 22 17:56:21 devstack sudo[88149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:56:22 devstack cinder-volume[81771]: DEBUG cinder.volume.flows.manager.create_volume [None req-37ab4671-5262-4617-b2de-cd398365eaa3 tempest-CreateVolumesFromSnapshotTest-401145158 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 17:56:22 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-37ab4671-5262-4617-b2de-cd398365eaa3 tempest-CreateVolumesFromSnapshotTest-401145158 None] Flow 'volume_create_manager' (e1aa79e9-77a9-445b-87ee-e1a3c7e36a74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:56:22 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-37ab4671-5262-4617-b2de-cd398365eaa3 tempest-CreateVolumesFromSnapshotTest-401145158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2a2107a-7ca2-4b3f-b61c-ed24d8d1aedf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:56:22 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-37ab4671-5262-4617-b2de-cd398365eaa3 tempest-CreateVolumesFromSnapshotTest-401145158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2a2107a-7ca2-4b3f-b61c-ed24d8d1aedf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:56:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-644314958',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65cb4d8e-f152-4681-a3fe-a642cc756837,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3957959b6ebc404198d60e5c86311307',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:56:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:56:22Z,use_quota=True,user_id='76b25e93fa074cc3b5217e0e35652ef2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:56:22 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-37ab4671-5262-4617-b2de-cd398365eaa3 tempest-CreateVolumesFromSnapshotTest-401145158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40324bae-1ee4-4329-8de1-3ce1c4c1ff82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:56:22 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-37ab4671-5262-4617-b2de-cd398365eaa3 tempest-CreateVolumesFromSnapshotTest-401145158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40324bae-1ee4-4329-8de1-3ce1c4c1ff82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:56:22 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-37ab4671-5262-4617-b2de-cd398365eaa3 tempest-CreateVolumesFromSnapshotTest-401145158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af5b9a52-bb9c-4ee2-b0a8-c6aa0d6096b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:56:22 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-37ab4671-5262-4617-b2de-cd398365eaa3 tempest-CreateVolumesFromSnapshotTest-401145158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af5b9a52-bb9c-4ee2-b0a8-c6aa0d6096b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65cb4d8e-f152-4681-a3fe-a642cc756837', 'volume_name': 'volume-65cb4d8e-f152-4681-a3fe-a642cc756837', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:56:22 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-37ab4671-5262-4617-b2de-cd398365eaa3 tempest-CreateVolumesFromSnapshotTest-401145158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d188a723-55df-4a25-a913-a9baf22ceb8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:56:22 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-37ab4671-5262-4617-b2de-cd398365eaa3 tempest-CreateVolumesFromSnapshotTest-401145158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d188a723-55df-4a25-a913-a9baf22ceb8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:56:22 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-37ab4671-5262-4617-b2de-cd398365eaa3 tempest-CreateVolumesFromSnapshotTest-401145158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20726f45-9c6e-460f-9068-f49bff897372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:56:22 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-37ab4671-5262-4617-b2de-cd398365eaa3 tempest-CreateVolumesFromSnapshotTest-401145158 None] Volume 65cb4d8e-f152-4681-a3fe-a642cc756837: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65cb4d8e-f152-4681-a3fe-a642cc756837', 'volume_size': 1} Apr 22 17:56:22 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-37ab4671-5262-4617-b2de-cd398365eaa3 tempest-CreateVolumesFromSnapshotTest-401145158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:56:22 devstack cinder-volume[81771]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbee2d8e-7219-42f4-9013-23c428184259 tempest-VolumesCloneTest-1670162930 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 17:56:22 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-fbee2d8e-7219-42f4-9013-23c428184259 tempest-VolumesCloneTest-1670162930 None] Flow 'volume_create_manager' (30772c64-b641-43b9-ab9d-88011fb7916d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:56:22 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-fbee2d8e-7219-42f4-9013-23c428184259 tempest-VolumesCloneTest-1670162930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cea01b9-3e6f-44e5-9d91-fd8152f2c1e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:56:22 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-fbee2d8e-7219-42f4-9013-23c428184259 tempest-VolumesCloneTest-1670162930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cea01b9-3e6f-44e5-9d91-fd8152f2c1e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:56:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-651929784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fb04710-31f8-445b-8cd6-d88e1e2d6006,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d86997e78d334169948803eab0062676',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:56:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:56:22Z,use_quota=True,user_id='a0225d52c72c43ee8be93a058b9f60fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:56:22 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-fbee2d8e-7219-42f4-9013-23c428184259 tempest-VolumesCloneTest-1670162930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3b969b4-0d8a-4d6e-981f-216f30adfaee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:56:22 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-fbee2d8e-7219-42f4-9013-23c428184259 tempest-VolumesCloneTest-1670162930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3b969b4-0d8a-4d6e-981f-216f30adfaee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:56:22 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-fbee2d8e-7219-42f4-9013-23c428184259 tempest-VolumesCloneTest-1670162930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87a7cb5f-1df6-4bbf-b2b1-72303c771a4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:56:22 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-fbee2d8e-7219-42f4-9013-23c428184259 tempest-VolumesCloneTest-1670162930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87a7cb5f-1df6-4bbf-b2b1-72303c771a4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7fb04710-31f8-445b-8cd6-d88e1e2d6006', 'volume_name': 'volume-7fb04710-31f8-445b-8cd6-d88e1e2d6006', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:56:22 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-fbee2d8e-7219-42f4-9013-23c428184259 tempest-VolumesCloneTest-1670162930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d1abf2b-92df-4eda-a421-21bd26d9c0f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:56:22 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-fbee2d8e-7219-42f4-9013-23c428184259 tempest-VolumesCloneTest-1670162930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d1abf2b-92df-4eda-a421-21bd26d9c0f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:56:22 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-fbee2d8e-7219-42f4-9013-23c428184259 tempest-VolumesCloneTest-1670162930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a86faa2-823b-4f1c-99fe-c4749795e57a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:56:22 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-fbee2d8e-7219-42f4-9013-23c428184259 tempest-VolumesCloneTest-1670162930 None] Volume 7fb04710-31f8-445b-8cd6-d88e1e2d6006: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7fb04710-31f8-445b-8cd6-d88e1e2d6006', 'volume_size': 1} Apr 22 17:56:22 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-fbee2d8e-7219-42f4-9013-23c428184259 tempest-VolumesCloneTest-1670162930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:56:22 devstack cinder-volume[81771]: DEBUG cinder.volume.flows.manager.create_volume [None req-6cc942d1-6942-4ecb-8509-50989a5c86a5 tempest-CreateVolumesFromSnapshotTest-401145158 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 17:56:22 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-6cc942d1-6942-4ecb-8509-50989a5c86a5 tempest-CreateVolumesFromSnapshotTest-401145158 None] Flow 'volume_create_manager' (9587d831-e260-4fba-9ba7-858a857a613d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:56:22 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-6cc942d1-6942-4ecb-8509-50989a5c86a5 tempest-CreateVolumesFromSnapshotTest-401145158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdb82882-607e-43f7-bae9-38eb7ba3466f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:56:22 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-6cc942d1-6942-4ecb-8509-50989a5c86a5 tempest-CreateVolumesFromSnapshotTest-401145158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdb82882-607e-43f7-bae9-38eb7ba3466f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:56:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-593997057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a2cd82e-8478-458b-985b-1386338d35a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3957959b6ebc404198d60e5c86311307',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:56:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:56:23Z,use_quota=True,user_id='76b25e93fa074cc3b5217e0e35652ef2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:56:22 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-6cc942d1-6942-4ecb-8509-50989a5c86a5 tempest-CreateVolumesFromSnapshotTest-401145158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10dae901-cf1e-4af4-90d5-f98caa0ed571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:56:22 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-6cc942d1-6942-4ecb-8509-50989a5c86a5 tempest-CreateVolumesFromSnapshotTest-401145158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10dae901-cf1e-4af4-90d5-f98caa0ed571) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:56:22 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-6cc942d1-6942-4ecb-8509-50989a5c86a5 tempest-CreateVolumesFromSnapshotTest-401145158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26fcac3a-a22e-40fd-a8b4-2a9e4752f89d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:56:22 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-6cc942d1-6942-4ecb-8509-50989a5c86a5 tempest-CreateVolumesFromSnapshotTest-401145158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26fcac3a-a22e-40fd-a8b4-2a9e4752f89d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a2cd82e-8478-458b-985b-1386338d35a6', 'volume_name': 'volume-8a2cd82e-8478-458b-985b-1386338d35a6', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:56:22 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-6cc942d1-6942-4ecb-8509-50989a5c86a5 tempest-CreateVolumesFromSnapshotTest-401145158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dddeac20-8984-4826-a441-41d73f8f8a51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:56:22 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-6cc942d1-6942-4ecb-8509-50989a5c86a5 tempest-CreateVolumesFromSnapshotTest-401145158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dddeac20-8984-4826-a441-41d73f8f8a51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:56:22 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-6cc942d1-6942-4ecb-8509-50989a5c86a5 tempest-CreateVolumesFromSnapshotTest-401145158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (161ee19b-2c20-4872-88ad-4e09b37b2d52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:56:22 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-6cc942d1-6942-4ecb-8509-50989a5c86a5 tempest-CreateVolumesFromSnapshotTest-401145158 None] Volume 8a2cd82e-8478-458b-985b-1386338d35a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a2cd82e-8478-458b-985b-1386338d35a6', 'volume_size': 1} Apr 22 17:56:22 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-6cc942d1-6942-4ecb-8509-50989a5c86a5 tempest-CreateVolumesFromSnapshotTest-401145158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:56:23 devstack cinder-volume[81771]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b298c49-a9f0-4059-9df8-15a5ab6a1da7 tempest-CreateVolumesFromSnapshotTest-401145158 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 17:56:23 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-4b298c49-a9f0-4059-9df8-15a5ab6a1da7 tempest-CreateVolumesFromSnapshotTest-401145158 None] Flow 'volume_create_manager' (2962342a-a7f2-4575-b8db-99a677199284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:56:23 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-4b298c49-a9f0-4059-9df8-15a5ab6a1da7 tempest-CreateVolumesFromSnapshotTest-401145158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (feff9c56-bfd5-4104-aabf-d50ca26ed0ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:56:23 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-4b298c49-a9f0-4059-9df8-15a5ab6a1da7 tempest-CreateVolumesFromSnapshotTest-401145158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (feff9c56-bfd5-4104-aabf-d50ca26ed0ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:56:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1398416145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c505040f-0a45-4c62-9dfe-92144d289746,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3957959b6ebc404198d60e5c86311307',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:56:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:56:23Z,use_quota=True,user_id='76b25e93fa074cc3b5217e0e35652ef2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:56:23 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-4b298c49-a9f0-4059-9df8-15a5ab6a1da7 tempest-CreateVolumesFromSnapshotTest-401145158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d28a543-b3c3-4231-bfdc-2a60e7c72c67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:56:23 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-4b298c49-a9f0-4059-9df8-15a5ab6a1da7 tempest-CreateVolumesFromSnapshotTest-401145158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d28a543-b3c3-4231-bfdc-2a60e7c72c67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:56:23 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-4b298c49-a9f0-4059-9df8-15a5ab6a1da7 tempest-CreateVolumesFromSnapshotTest-401145158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3804713-6994-4762-8e79-b6d63bd85eb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:56:23 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-4b298c49-a9f0-4059-9df8-15a5ab6a1da7 tempest-CreateVolumesFromSnapshotTest-401145158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3804713-6994-4762-8e79-b6d63bd85eb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c505040f-0a45-4c62-9dfe-92144d289746', 'volume_name': 'volume-c505040f-0a45-4c62-9dfe-92144d289746', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:56:23 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-4b298c49-a9f0-4059-9df8-15a5ab6a1da7 tempest-CreateVolumesFromSnapshotTest-401145158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89c290a8-de75-47f3-9af3-e0eb8a249892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:56:23 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-4b298c49-a9f0-4059-9df8-15a5ab6a1da7 tempest-CreateVolumesFromSnapshotTest-401145158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89c290a8-de75-47f3-9af3-e0eb8a249892) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:56:23 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-4b298c49-a9f0-4059-9df8-15a5ab6a1da7 tempest-CreateVolumesFromSnapshotTest-401145158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96f5537e-2980-446e-83f1-923114d13fe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:56:23 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-4b298c49-a9f0-4059-9df8-15a5ab6a1da7 tempest-CreateVolumesFromSnapshotTest-401145158 None] Volume c505040f-0a45-4c62-9dfe-92144d289746: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c505040f-0a45-4c62-9dfe-92144d289746', 'volume_size': 1} Apr 22 17:56:23 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-4b298c49-a9f0-4059-9df8-15a5ab6a1da7 tempest-CreateVolumesFromSnapshotTest-401145158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:56:24 devstack cinder-volume[81771]: DEBUG cinder.volume.flows.manager.create_volume [None req-4be32372-dd88-4838-8257-22968da9f0ef tempest-CreateVolumesFromSnapshotTest-401145158 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 17:56:24 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-4be32372-dd88-4838-8257-22968da9f0ef tempest-CreateVolumesFromSnapshotTest-401145158 None] Flow 'volume_create_manager' (cffa9526-761c-4c2a-95b7-c6ab4738b085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:56:24 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-4be32372-dd88-4838-8257-22968da9f0ef tempest-CreateVolumesFromSnapshotTest-401145158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0c7a38b-5a5b-41ca-bab0-a6a1cceb9be2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:56:24 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-4be32372-dd88-4838-8257-22968da9f0ef tempest-CreateVolumesFromSnapshotTest-401145158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0c7a38b-5a5b-41ca-bab0-a6a1cceb9be2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:56:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1153702005',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31277914-4dec-4e0f-a0b8-92917f608ada,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3957959b6ebc404198d60e5c86311307',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:56:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:56:24Z,use_quota=True,user_id='76b25e93fa074cc3b5217e0e35652ef2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:56:24 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-4be32372-dd88-4838-8257-22968da9f0ef tempest-CreateVolumesFromSnapshotTest-401145158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07d70f12-51d3-4d8c-93b4-a4177adbe057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:56:24 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-4be32372-dd88-4838-8257-22968da9f0ef tempest-CreateVolumesFromSnapshotTest-401145158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07d70f12-51d3-4d8c-93b4-a4177adbe057) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:56:24 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-4be32372-dd88-4838-8257-22968da9f0ef tempest-CreateVolumesFromSnapshotTest-401145158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8df9155-9b8e-45f1-8823-d55827c98a3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:56:24 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-4be32372-dd88-4838-8257-22968da9f0ef tempest-CreateVolumesFromSnapshotTest-401145158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8df9155-9b8e-45f1-8823-d55827c98a3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31277914-4dec-4e0f-a0b8-92917f608ada', 'volume_name': 'volume-31277914-4dec-4e0f-a0b8-92917f608ada', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:56:24 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-4be32372-dd88-4838-8257-22968da9f0ef tempest-CreateVolumesFromSnapshotTest-401145158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88e3f33d-e65d-44a4-ac8d-814f1c987a65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:56:24 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-4be32372-dd88-4838-8257-22968da9f0ef tempest-CreateVolumesFromSnapshotTest-401145158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88e3f33d-e65d-44a4-ac8d-814f1c987a65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:56:24 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-4be32372-dd88-4838-8257-22968da9f0ef tempest-CreateVolumesFromSnapshotTest-401145158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c33dc74-fe45-4951-982f-2a8235226a7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:56:24 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-4be32372-dd88-4838-8257-22968da9f0ef tempest-CreateVolumesFromSnapshotTest-401145158 None] Volume 31277914-4dec-4e0f-a0b8-92917f608ada: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31277914-4dec-4e0f-a0b8-92917f608ada', 'volume_size': 1} Apr 22 17:56:24 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-4be32372-dd88-4838-8257-22968da9f0ef tempest-CreateVolumesFromSnapshotTest-401145158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:56:27 devstack sudo[88149]: pam_unix(sudo:session): session closed for user root Apr 22 17:56:27 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-b05b766e-eb26-4c42-b80d-55bf4d2422a4 tempest-VolumesDeleteCascade-308204417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b103161a-7291-4a16-b9ad-872efcc665a9 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-2286ec10-4a28-42b7-b157-68935cbbda6d" returned: 0 in 6.173s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:56:28 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[d25bad46-a0fa-4f19-ad18-1c0550295200]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:56:28 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-b05b766e-eb26-4c42-b80d-55bf4d2422a4 tempest-VolumesDeleteCascade-308204417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b103161a-7291-4a16-b9ad-872efcc665a9 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:56:28 devstack sudo[88165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b103161a-7291-4a16-b9ad-872efcc665a9 Apr 22 17:56:28 devstack sudo[88165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:56:28 devstack sudo[88165]: pam_unix(sudo:session): session closed for user root Apr 22 17:56:28 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-b05b766e-eb26-4c42-b80d-55bf4d2422a4 tempest-VolumesDeleteCascade-308204417 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b103161a-7291-4a16-b9ad-872efcc665a9" returned: 0 in 0.750s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:56:28 devstack cinder-volume[81771]: DEBUG cinder.image.image_utils [None req-b05b766e-eb26-4c42-b80d-55bf4d2422a4 tempest-VolumesDeleteCascade-308204417 None] Image conversion details: src /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b103161a-7291-4a16-b9ad-872efcc665a9, size 1024.00 MB, duration 6.17 sec, destination /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-2286ec10-4a28-42b7-b157-68935cbbda6d {{(pid=81771) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 22 17:56:28 devstack cinder-volume[81771]: INFO cinder.image.image_utils [None req-b05b766e-eb26-4c42-b80d-55bf4d2422a4 tempest-VolumesDeleteCascade-308204417 None] Converted 1024.00 MB image at 165.86 MB/s Apr 22 17:56:28 devstack cinder-volume[81771]: WARNING cinder.volume.drivers.remotefs [None req-b05b766e-eb26-4c42-b80d-55bf4d2422a4 tempest-VolumesDeleteCascade-308204417 None] /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-2286ec10-4a28-42b7-b157-68935cbbda6d is being set with open permissions: ugo+rw Apr 22 17:56:28 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-b05b766e-eb26-4c42-b80d-55bf4d2422a4 tempest-VolumesDeleteCascade-308204417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-2286ec10-4a28-42b7-b157-68935cbbda6d {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:56:28 devstack sudo[88170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-2286ec10-4a28-42b7-b157-68935cbbda6d Apr 22 17:56:28 devstack sudo[88170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:56:29 devstack sudo[88170]: pam_unix(sudo:session): session closed for user root Apr 22 17:56:29 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-b05b766e-eb26-4c42-b80d-55bf4d2422a4 tempest-VolumesDeleteCascade-308204417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-2286ec10-4a28-42b7-b157-68935cbbda6d" returned: 0 in 0.491s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:56:29 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-b05b766e-eb26-4c42-b80d-55bf4d2422a4 tempest-VolumesDeleteCascade-308204417 None] Lock "cinder-quobyte-2286ec10-4a28-42b7-b157-68935cbbda6d" released by "_copy_volume_from_snapshot" :: held 8.790s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:56:29 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-b05b766e-eb26-4c42-b80d-55bf4d2422a4 tempest-VolumesDeleteCascade-308204417 None] Lock "cinder-quobyte-9dccd7ff-900c-4bed-8db6-dad542f52205-2286ec10-4a28-42b7-b157-68935cbbda6d" released by "_create_volume_from_snapshot" :: held 8.858s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:56:29 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-b05b766e-eb26-4c42-b80d-55bf4d2422a4 tempest-VolumesDeleteCascade-308204417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.915s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:56:29 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-17afa701-31ca-43e1-9d46-5bfa0bab458d tempest-CreateVolumesFromSnapshotTest-401145158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.585s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:56:29 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-17afa701-31ca-43e1-9d46-5bfa0bab458d tempest-CreateVolumesFromSnapshotTest-401145158 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:56:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-365166876',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67a23ab0-e603-4ee2-83be-5fcc299cb2fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3957959b6ebc404198d60e5c86311307',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:56:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:56:22Z,use_quota=True,user_id='76b25e93fa074cc3b5217e0e35652ef2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)}" {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 17:56:29 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-17afa701-31ca-43e1-9d46-5bfa0bab458d tempest-CreateVolumesFromSnapshotTest-401145158 None] Creating volume 67a23ab0-e603-4ee2-83be-5fcc299cb2fa {{(pid=81771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 17:56:29 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-17afa701-31ca-43e1-9d46-5bfa0bab458d tempest-CreateVolumesFromSnapshotTest-401145158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:56:29 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-17afa701-31ca-43e1-9d46-5bfa0bab458d tempest-CreateVolumesFromSnapshotTest-401145158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:56:29 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-17afa701-31ca-43e1-9d46-5bfa0bab458d tempest-CreateVolumesFromSnapshotTest-401145158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:56:29 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-17afa701-31ca-43e1-9d46-5bfa0bab458d tempest-CreateVolumesFromSnapshotTest-401145158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:56:29 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-17afa701-31ca-43e1-9d46-5bfa0bab458d tempest-CreateVolumesFromSnapshotTest-401145158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:56:29 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-17afa701-31ca-43e1-9d46-5bfa0bab458d tempest-CreateVolumesFromSnapshotTest-401145158 None] Selected osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 as target Quobyte volume. {{(pid=81771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 17:56:29 devstack cinder-volume[81771]: INFO cinder.volume.drivers.remotefs [None req-17afa701-31ca-43e1-9d46-5bfa0bab458d tempest-CreateVolumesFromSnapshotTest-401145158 None] casted to osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 Apr 22 17:56:29 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-17afa701-31ca-43e1-9d46-5bfa0bab458d tempest-CreateVolumesFromSnapshotTest-401145158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-67a23ab0-e603-4ee2-83be-5fcc299cb2fa 1073741824 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:56:29 devstack sudo[88173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-67a23ab0-e603-4ee2-83be-5fcc299cb2fa 1073741824 Apr 22 17:56:29 devstack sudo[88173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:56:29 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-b05b766e-eb26-4c42-b80d-55bf4d2422a4 tempest-VolumesDeleteCascade-308204417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c8c565b-e6a2-4f75-8914-5a54baf0b23c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2286ec10-4a28-42b7-b157-68935cbbda6d', 'volume_size': 1, 'snapshot_id': '9dccd7ff-900c-4bed-8db6-dad542f52205'}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:56:29 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-b05b766e-eb26-4c42-b80d-55bf4d2422a4 tempest-VolumesDeleteCascade-308204417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (759ed232-b8d0-4e05-8453-b12738a6d396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:56:29 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-b05b766e-eb26-4c42-b80d-55bf4d2422a4 tempest-VolumesDeleteCascade-308204417 None] Volume volume-2286ec10-4a28-42b7-b157-68935cbbda6d (2286ec10-4a28-42b7-b157-68935cbbda6d): created successfully Apr 22 17:56:29 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-b05b766e-eb26-4c42-b80d-55bf4d2422a4 tempest-VolumesDeleteCascade-308204417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (759ed232-b8d0-4e05-8453-b12738a6d396) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:56:29 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-b05b766e-eb26-4c42-b80d-55bf4d2422a4 tempest-VolumesDeleteCascade-308204417 None] Flow 'volume_create_manager' (4d1bf6b7-8ccf-458a-934b-deed1880fe80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:56:29 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-b05b766e-eb26-4c42-b80d-55bf4d2422a4 tempest-VolumesDeleteCascade-308204417 None] Created volume successfully. Apr 22 17:56:29 devstack cinder-volume[81771]: DEBUG oslo_service.periodic_task [None req-1a7bdab5-8190-4e00-a2e2-843e5894ab49 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81771) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 22 17:56:29 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-1a7bdab5-8190-4e00-a2e2-843e5894ab49 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:56:29 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-1a7bdab5-8190-4e00-a2e2-843e5894ab49 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:56:29 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-1a7bdab5-8190-4e00-a2e2-843e5894ab49 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:56:29 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-1a7bdab5-8190-4e00-a2e2-843e5894ab49 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:56:29 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-1a7bdab5-8190-4e00-a2e2-843e5894ab49 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:56:29 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-1a7bdab5-8190-4e00-a2e2-843e5894ab49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:56:29 devstack sudo[88184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 Apr 22 17:56:29 devstack sudo[88184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:56:30 devstack sudo[88173]: pam_unix(sudo:session): session closed for user root Apr 22 17:56:30 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-17afa701-31ca-43e1-9d46-5bfa0bab458d tempest-CreateVolumesFromSnapshotTest-401145158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-67a23ab0-e603-4ee2-83be-5fcc299cb2fa 1073741824" returned: 0 in 0.747s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:56:30 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-17afa701-31ca-43e1-9d46-5bfa0bab458d tempest-CreateVolumesFromSnapshotTest-401145158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-67a23ab0-e603-4ee2-83be-5fcc299cb2fa {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:56:30 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-e4cf1dc7-3a47-4c93-ac5e-839f0aaccdd6 tempest-VolumesDeleteCascade-308204417 None] Acquiring lock "cinder-b103161a-7291-4a16-b9ad-872efcc665a9-delete_volume" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:56:30 devstack sudo[88186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-67a23ab0-e603-4ee2-83be-5fcc299cb2fa Apr 22 17:56:30 devstack sudo[88186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:56:30 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-e4cf1dc7-3a47-4c93-ac5e-839f0aaccdd6 tempest-VolumesDeleteCascade-308204417 None] Lock "cinder-b103161a-7291-4a16-b9ad-872efcc665a9-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:56:30 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-e4cf1dc7-3a47-4c93-ac5e-839f0aaccdd6 tempest-VolumesDeleteCascade-308204417 None] Performing cascade delete. {{(pid=81771) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 22 17:56:30 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-e4cf1dc7-3a47-4c93-ac5e-839f0aaccdd6 tempest-VolumesDeleteCascade-308204417 None] Acquiring lock "cinder-9dccd7ff-900c-4bed-8db6-dad542f52205-delete_snapshot" by "delete_snapshot" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:56:30 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-e4cf1dc7-3a47-4c93-ac5e-839f0aaccdd6 tempest-VolumesDeleteCascade-308204417 None] Lock "cinder-9dccd7ff-900c-4bed-8db6-dad542f52205-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:56:30 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-e4cf1dc7-3a47-4c93-ac5e-839f0aaccdd6 tempest-VolumesDeleteCascade-308204417 None] Acquiring lock "cinder-quobyte-b103161a-7291-4a16-b9ad-872efcc665a9" by "delete_snapshot" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:56:30 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-e4cf1dc7-3a47-4c93-ac5e-839f0aaccdd6 tempest-VolumesDeleteCascade-308204417 None] Lock "cinder-quobyte-b103161a-7291-4a16-b9ad-872efcc665a9" acquired by "delete_snapshot" :: waited 0.018s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:56:30 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-e4cf1dc7-3a47-4c93-ac5e-839f0aaccdd6 tempest-VolumesDeleteCascade-308204417 None] Acquiring lock "cinder-quobyte-9dccd7ff-900c-4bed-8db6-dad542f52205" by "_delete_snapshot" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:56:30 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-e4cf1dc7-3a47-4c93-ac5e-839f0aaccdd6 tempest-VolumesDeleteCascade-308204417 None] Lock "cinder-quobyte-9dccd7ff-900c-4bed-8db6-dad542f52205" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:56:30 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-e4cf1dc7-3a47-4c93-ac5e-839f0aaccdd6 tempest-VolumesDeleteCascade-308204417 None] Deleting offline snapshot 9dccd7ff-900c-4bed-8db6-dad542f52205 of volume b103161a-7291-4a16-b9ad-872efcc665a9 {{(pid=81771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 22 17:56:30 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-e4cf1dc7-3a47-4c93-ac5e-839f0aaccdd6 tempest-VolumesDeleteCascade-308204417 None] snapshot_file for this snap is: volume-b103161a-7291-4a16-b9ad-872efcc665a9.9dccd7ff-900c-4bed-8db6-dad542f52205 {{(pid=81771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 22 17:56:30 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[39fd5b6c-0e38-4d7c-861a-4f9ad813bdcf]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:56:30 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-e4cf1dc7-3a47-4c93-ac5e-839f0aaccdd6 tempest-VolumesDeleteCascade-308204417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b103161a-7291-4a16-b9ad-872efcc665a9.9dccd7ff-900c-4bed-8db6-dad542f52205 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:56:30 devstack sudo[88188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b103161a-7291-4a16-b9ad-872efcc665a9.9dccd7ff-900c-4bed-8db6-dad542f52205 Apr 22 17:56:30 devstack sudo[88188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:56:30 devstack sudo[88184]: pam_unix(sudo:session): session closed for user root Apr 22 17:56:30 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-1a7bdab5-8190-4e00-a2e2-843e5894ab49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33" returned: 0 in 0.642s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:56:30 devstack cinder-volume[81771]: DEBUG cinder.manager [None req-1a7bdab5-8190-4e00-a2e2-843e5894ab49 None None] Notifying Schedulers of capabilities ... {{(pid=81771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 17:56:30 devstack sudo[88186]: pam_unix(sudo:session): session closed for user root Apr 22 17:56:30 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-17afa701-31ca-43e1-9d46-5bfa0bab458d tempest-CreateVolumesFromSnapshotTest-401145158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-67a23ab0-e603-4ee2-83be-5fcc299cb2fa" returned: 0 in 0.628s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:56:30 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-17afa701-31ca-43e1-9d46-5bfa0bab458d tempest-CreateVolumesFromSnapshotTest-401145158 None] <== create_volume: return (1434ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'} {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 17:56:30 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-17afa701-31ca-43e1-9d46-5bfa0bab458d tempest-CreateVolumesFromSnapshotTest-401145158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.440s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:56:30 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-37ab4671-5262-4617-b2de-cd398365eaa3 tempest-CreateVolumesFromSnapshotTest-401145158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.549s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:56:30 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-37ab4671-5262-4617-b2de-cd398365eaa3 tempest-CreateVolumesFromSnapshotTest-401145158 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:56:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-644314958',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65cb4d8e-f152-4681-a3fe-a642cc756837,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3957959b6ebc404198d60e5c86311307',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:56:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:56:22Z,use_quota=True,user_id='76b25e93fa074cc3b5217e0e35652ef2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)}" {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 17:56:30 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-37ab4671-5262-4617-b2de-cd398365eaa3 tempest-CreateVolumesFromSnapshotTest-401145158 None] Creating volume 65cb4d8e-f152-4681-a3fe-a642cc756837 {{(pid=81771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 17:56:30 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-37ab4671-5262-4617-b2de-cd398365eaa3 tempest-CreateVolumesFromSnapshotTest-401145158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:56:30 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-37ab4671-5262-4617-b2de-cd398365eaa3 tempest-CreateVolumesFromSnapshotTest-401145158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:56:30 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-37ab4671-5262-4617-b2de-cd398365eaa3 tempest-CreateVolumesFromSnapshotTest-401145158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:56:30 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-37ab4671-5262-4617-b2de-cd398365eaa3 tempest-CreateVolumesFromSnapshotTest-401145158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:56:30 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-37ab4671-5262-4617-b2de-cd398365eaa3 tempest-CreateVolumesFromSnapshotTest-401145158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:56:30 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-37ab4671-5262-4617-b2de-cd398365eaa3 tempest-CreateVolumesFromSnapshotTest-401145158 None] Selected osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 as target Quobyte volume. {{(pid=81771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 17:56:30 devstack cinder-volume[81771]: INFO cinder.volume.drivers.remotefs [None req-37ab4671-5262-4617-b2de-cd398365eaa3 tempest-CreateVolumesFromSnapshotTest-401145158 None] casted to osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 Apr 22 17:56:30 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-37ab4671-5262-4617-b2de-cd398365eaa3 tempest-CreateVolumesFromSnapshotTest-401145158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-65cb4d8e-f152-4681-a3fe-a642cc756837 1073741824 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:56:30 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-17afa701-31ca-43e1-9d46-5bfa0bab458d tempest-CreateVolumesFromSnapshotTest-401145158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b6c557e-26d5-4ebe-9822-7c5d22883e47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67a23ab0-e603-4ee2-83be-5fcc299cb2fa', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:56:30 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-17afa701-31ca-43e1-9d46-5bfa0bab458d tempest-CreateVolumesFromSnapshotTest-401145158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (339f4fa9-2ac1-4db2-afa9-76a7fd6b67d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:56:30 devstack sudo[88192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-65cb4d8e-f152-4681-a3fe-a642cc756837 1073741824 Apr 22 17:56:30 devstack sudo[88192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:56:30 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-17afa701-31ca-43e1-9d46-5bfa0bab458d tempest-CreateVolumesFromSnapshotTest-401145158 None] Volume volume-67a23ab0-e603-4ee2-83be-5fcc299cb2fa (67a23ab0-e603-4ee2-83be-5fcc299cb2fa): created successfully Apr 22 17:56:30 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-17afa701-31ca-43e1-9d46-5bfa0bab458d tempest-CreateVolumesFromSnapshotTest-401145158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (339f4fa9-2ac1-4db2-afa9-76a7fd6b67d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:56:30 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-17afa701-31ca-43e1-9d46-5bfa0bab458d tempest-CreateVolumesFromSnapshotTest-401145158 None] Flow 'volume_create_manager' (120e0886-9aaa-4f70-afce-dd26c0f4cc0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:56:30 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-17afa701-31ca-43e1-9d46-5bfa0bab458d tempest-CreateVolumesFromSnapshotTest-401145158 None] Created volume successfully. Apr 22 17:56:30 devstack sudo[88188]: pam_unix(sudo:session): session closed for user root Apr 22 17:56:30 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-e4cf1dc7-3a47-4c93-ac5e-839f0aaccdd6 tempest-VolumesDeleteCascade-308204417 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b103161a-7291-4a16-b9ad-872efcc665a9.9dccd7ff-900c-4bed-8db6-dad542f52205" returned: 0 in 0.660s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:56:30 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-e4cf1dc7-3a47-4c93-ac5e-839f0aaccdd6 tempest-VolumesDeleteCascade-308204417 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b103161a-7291-4a16-b9ad-872efcc665a9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81771) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 22 17:56:30 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ee908f2-beee-4989-9ecf-d34b30219472]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:56:30 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-e4cf1dc7-3a47-4c93-ac5e-839f0aaccdd6 tempest-VolumesDeleteCascade-308204417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b103161a-7291-4a16-b9ad-872efcc665a9 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:56:31 devstack sudo[88197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b103161a-7291-4a16-b9ad-872efcc665a9 Apr 22 17:56:31 devstack sudo[88197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:56:31 devstack sudo[88192]: pam_unix(sudo:session): session closed for user root Apr 22 17:56:31 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-37ab4671-5262-4617-b2de-cd398365eaa3 tempest-CreateVolumesFromSnapshotTest-401145158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-65cb4d8e-f152-4681-a3fe-a642cc756837 1073741824" returned: 0 in 0.851s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:56:31 devstack sudo[88197]: pam_unix(sudo:session): session closed for user root Apr 22 17:56:31 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-e4cf1dc7-3a47-4c93-ac5e-839f0aaccdd6 tempest-VolumesDeleteCascade-308204417 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b103161a-7291-4a16-b9ad-872efcc665a9" returned: 0 in 0.612s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:56:31 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-e4cf1dc7-3a47-4c93-ac5e-839f0aaccdd6 tempest-VolumesDeleteCascade-308204417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b103161a-7291-4a16-b9ad-872efcc665a9.9dccd7ff-900c-4bed-8db6-dad542f52205 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:56:31 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-37ab4671-5262-4617-b2de-cd398365eaa3 tempest-CreateVolumesFromSnapshotTest-401145158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-65cb4d8e-f152-4681-a3fe-a642cc756837 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:56:31 devstack sudo[88205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b103161a-7291-4a16-b9ad-872efcc665a9.9dccd7ff-900c-4bed-8db6-dad542f52205 Apr 22 17:56:31 devstack sudo[88205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:56:31 devstack sudo[88207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-65cb4d8e-f152-4681-a3fe-a642cc756837 Apr 22 17:56:31 devstack sudo[88207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:56:32 devstack sudo[88207]: pam_unix(sudo:session): session closed for user root Apr 22 17:56:32 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-37ab4671-5262-4617-b2de-cd398365eaa3 tempest-CreateVolumesFromSnapshotTest-401145158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-65cb4d8e-f152-4681-a3fe-a642cc756837" returned: 0 in 0.571s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:56:32 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-37ab4671-5262-4617-b2de-cd398365eaa3 tempest-CreateVolumesFromSnapshotTest-401145158 None] <== create_volume: return (1480ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'} {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 17:56:32 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-37ab4671-5262-4617-b2de-cd398365eaa3 tempest-CreateVolumesFromSnapshotTest-401145158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.485s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:56:32 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-fbee2d8e-7219-42f4-9013-23c428184259 tempest-VolumesCloneTest-1670162930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.716s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:56:32 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-fbee2d8e-7219-42f4-9013-23c428184259 tempest-VolumesCloneTest-1670162930 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:56:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-651929784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fb04710-31f8-445b-8cd6-d88e1e2d6006,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d86997e78d334169948803eab0062676',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:56:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:56:22Z,use_quota=True,user_id='a0225d52c72c43ee8be93a058b9f60fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)}" {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 17:56:32 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-fbee2d8e-7219-42f4-9013-23c428184259 tempest-VolumesCloneTest-1670162930 None] Creating volume 7fb04710-31f8-445b-8cd6-d88e1e2d6006 {{(pid=81771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 17:56:32 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-fbee2d8e-7219-42f4-9013-23c428184259 tempest-VolumesCloneTest-1670162930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:56:32 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-fbee2d8e-7219-42f4-9013-23c428184259 tempest-VolumesCloneTest-1670162930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:56:32 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-fbee2d8e-7219-42f4-9013-23c428184259 tempest-VolumesCloneTest-1670162930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:56:32 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-fbee2d8e-7219-42f4-9013-23c428184259 tempest-VolumesCloneTest-1670162930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:56:32 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-fbee2d8e-7219-42f4-9013-23c428184259 tempest-VolumesCloneTest-1670162930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:56:32 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-fbee2d8e-7219-42f4-9013-23c428184259 tempest-VolumesCloneTest-1670162930 None] Selected osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 as target Quobyte volume. {{(pid=81771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 17:56:32 devstack cinder-volume[81771]: INFO cinder.volume.drivers.remotefs [None req-fbee2d8e-7219-42f4-9013-23c428184259 tempest-VolumesCloneTest-1670162930 None] casted to osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 Apr 22 17:56:32 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-fbee2d8e-7219-42f4-9013-23c428184259 tempest-VolumesCloneTest-1670162930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7fb04710-31f8-445b-8cd6-d88e1e2d6006 1073741824 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:56:32 devstack sudo[88205]: pam_unix(sudo:session): session closed for user root Apr 22 17:56:32 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-e4cf1dc7-3a47-4c93-ac5e-839f0aaccdd6 tempest-VolumesDeleteCascade-308204417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b103161a-7291-4a16-b9ad-872efcc665a9.9dccd7ff-900c-4bed-8db6-dad542f52205" returned: 0 in 0.625s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:56:32 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-e4cf1dc7-3a47-4c93-ac5e-839f0aaccdd6 tempest-VolumesDeleteCascade-308204417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b103161a-7291-4a16-b9ad-872efcc665a9.9dccd7ff-900c-4bed-8db6-dad542f52205 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:56:32 devstack sudo[88213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7fb04710-31f8-445b-8cd6-d88e1e2d6006 1073741824 Apr 22 17:56:32 devstack sudo[88213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:56:32 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-37ab4671-5262-4617-b2de-cd398365eaa3 tempest-CreateVolumesFromSnapshotTest-401145158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20726f45-9c6e-460f-9068-f49bff897372) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65cb4d8e-f152-4681-a3fe-a642cc756837', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:56:32 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-37ab4671-5262-4617-b2de-cd398365eaa3 tempest-CreateVolumesFromSnapshotTest-401145158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aac0a95b-c098-4f59-a096-aa24931f9d53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:56:32 devstack sudo[88214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b103161a-7291-4a16-b9ad-872efcc665a9.9dccd7ff-900c-4bed-8db6-dad542f52205 Apr 22 17:56:32 devstack sudo[88214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:56:32 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-37ab4671-5262-4617-b2de-cd398365eaa3 tempest-CreateVolumesFromSnapshotTest-401145158 None] Volume volume-65cb4d8e-f152-4681-a3fe-a642cc756837 (65cb4d8e-f152-4681-a3fe-a642cc756837): created successfully Apr 22 17:56:32 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-37ab4671-5262-4617-b2de-cd398365eaa3 tempest-CreateVolumesFromSnapshotTest-401145158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aac0a95b-c098-4f59-a096-aa24931f9d53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:56:32 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-37ab4671-5262-4617-b2de-cd398365eaa3 tempest-CreateVolumesFromSnapshotTest-401145158 None] Flow 'volume_create_manager' (e1aa79e9-77a9-445b-87ee-e1a3c7e36a74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:56:32 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-37ab4671-5262-4617-b2de-cd398365eaa3 tempest-CreateVolumesFromSnapshotTest-401145158 None] Created volume successfully. Apr 22 17:56:32 devstack sudo[88214]: pam_unix(sudo:session): session closed for user root Apr 22 17:56:32 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-e4cf1dc7-3a47-4c93-ac5e-839f0aaccdd6 tempest-VolumesDeleteCascade-308204417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b103161a-7291-4a16-b9ad-872efcc665a9.9dccd7ff-900c-4bed-8db6-dad542f52205" returned: 0 in 0.586s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:56:32 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-e4cf1dc7-3a47-4c93-ac5e-839f0aaccdd6 tempest-VolumesDeleteCascade-308204417 None] Lock "cinder-quobyte-9dccd7ff-900c-4bed-8db6-dad542f52205" released by "_delete_snapshot" :: held 2.601s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:56:32 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-e4cf1dc7-3a47-4c93-ac5e-839f0aaccdd6 tempest-VolumesDeleteCascade-308204417 None] Lock "cinder-quobyte-b103161a-7291-4a16-b9ad-872efcc665a9" released by "delete_snapshot" :: held 2.629s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:56:32 devstack sudo[88213]: pam_unix(sudo:session): session closed for user root Apr 22 17:56:32 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-fbee2d8e-7219-42f4-9013-23c428184259 tempest-VolumesCloneTest-1670162930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7fb04710-31f8-445b-8cd6-d88e1e2d6006 1073741824" returned: 0 in 0.677s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:56:32 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-fbee2d8e-7219-42f4-9013-23c428184259 tempest-VolumesCloneTest-1670162930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7fb04710-31f8-445b-8cd6-d88e1e2d6006 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:56:32 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-e4cf1dc7-3a47-4c93-ac5e-839f0aaccdd6 tempest-VolumesDeleteCascade-308204417 None] Created reservations ['5d74de81-fae4-4144-bfb4-b6b1583a0562', 'a49106ee-f004-4831-aaf1-243843c3bafd', 'c6861d29-a579-45cb-860e-29af1ac4598d', '018773d4-41ed-4ce7-9ad6-8376d4bd94b0'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 17:56:32 devstack sudo[88221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7fb04710-31f8-445b-8cd6-d88e1e2d6006 Apr 22 17:56:32 devstack sudo[88221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:56:33 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-e4cf1dc7-3a47-4c93-ac5e-839f0aaccdd6 tempest-VolumesDeleteCascade-308204417 None] Delete snapshot completed successfully. Apr 22 17:56:33 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-e4cf1dc7-3a47-4c93-ac5e-839f0aaccdd6 tempest-VolumesDeleteCascade-308204417 None] Lock "cinder-9dccd7ff-900c-4bed-8db6-dad542f52205-delete_snapshot" released by "delete_snapshot" :: held 2.825s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:56:33 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-e4cf1dc7-3a47-4c93-ac5e-839f0aaccdd6 tempest-VolumesDeleteCascade-308204417 None] Snapshots deleted, issuing volume delete {{(pid=81771) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 22 17:56:33 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-e4cf1dc7-3a47-4c93-ac5e-839f0aaccdd6 tempest-VolumesDeleteCascade-308204417 None] Acquiring lock "cinder-quobyte-b103161a-7291-4a16-b9ad-872efcc665a9" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:56:33 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-e4cf1dc7-3a47-4c93-ac5e-839f0aaccdd6 tempest-VolumesDeleteCascade-308204417 None] Lock "cinder-quobyte-b103161a-7291-4a16-b9ad-872efcc665a9" acquired by "delete_volume" :: waited 0.015s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:56:33 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0f5ecb4-28d9-40da-9f5a-d79adf1e1293]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:56:33 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-e4cf1dc7-3a47-4c93-ac5e-839f0aaccdd6 tempest-VolumesDeleteCascade-308204417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b103161a-7291-4a16-b9ad-872efcc665a9 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:56:33 devstack sudo[88223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b103161a-7291-4a16-b9ad-872efcc665a9 Apr 22 17:56:33 devstack sudo[88223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:56:33 devstack sudo[88221]: pam_unix(sudo:session): session closed for user root Apr 22 17:56:33 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-fbee2d8e-7219-42f4-9013-23c428184259 tempest-VolumesCloneTest-1670162930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7fb04710-31f8-445b-8cd6-d88e1e2d6006" returned: 0 in 0.587s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:56:33 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-fbee2d8e-7219-42f4-9013-23c428184259 tempest-VolumesCloneTest-1670162930 None] <== create_volume: return (1314ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'} {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 17:56:33 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-fbee2d8e-7219-42f4-9013-23c428184259 tempest-VolumesCloneTest-1670162930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.317s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:56:33 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-6cc942d1-6942-4ecb-8509-50989a5c86a5 tempest-CreateVolumesFromSnapshotTest-401145158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.587s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:56:33 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-6cc942d1-6942-4ecb-8509-50989a5c86a5 tempest-CreateVolumesFromSnapshotTest-401145158 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:56:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-593997057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a2cd82e-8478-458b-985b-1386338d35a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3957959b6ebc404198d60e5c86311307',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:56:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:56:23Z,use_quota=True,user_id='76b25e93fa074cc3b5217e0e35652ef2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)}" {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 17:56:33 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-6cc942d1-6942-4ecb-8509-50989a5c86a5 tempest-CreateVolumesFromSnapshotTest-401145158 None] Creating volume 8a2cd82e-8478-458b-985b-1386338d35a6 {{(pid=81771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 17:56:33 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-6cc942d1-6942-4ecb-8509-50989a5c86a5 tempest-CreateVolumesFromSnapshotTest-401145158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:56:33 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-6cc942d1-6942-4ecb-8509-50989a5c86a5 tempest-CreateVolumesFromSnapshotTest-401145158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:56:33 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-6cc942d1-6942-4ecb-8509-50989a5c86a5 tempest-CreateVolumesFromSnapshotTest-401145158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:56:33 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-6cc942d1-6942-4ecb-8509-50989a5c86a5 tempest-CreateVolumesFromSnapshotTest-401145158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:56:33 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-6cc942d1-6942-4ecb-8509-50989a5c86a5 tempest-CreateVolumesFromSnapshotTest-401145158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:56:33 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-6cc942d1-6942-4ecb-8509-50989a5c86a5 tempest-CreateVolumesFromSnapshotTest-401145158 None] Selected osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 as target Quobyte volume. {{(pid=81771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 17:56:33 devstack cinder-volume[81771]: INFO cinder.volume.drivers.remotefs [None req-6cc942d1-6942-4ecb-8509-50989a5c86a5 tempest-CreateVolumesFromSnapshotTest-401145158 None] casted to osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 Apr 22 17:56:33 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-6cc942d1-6942-4ecb-8509-50989a5c86a5 tempest-CreateVolumesFromSnapshotTest-401145158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-8a2cd82e-8478-458b-985b-1386338d35a6 1073741824 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:56:33 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-fbee2d8e-7219-42f4-9013-23c428184259 tempest-VolumesCloneTest-1670162930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a86faa2-823b-4f1c-99fe-c4749795e57a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7fb04710-31f8-445b-8cd6-d88e1e2d6006', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:56:33 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-fbee2d8e-7219-42f4-9013-23c428184259 tempest-VolumesCloneTest-1670162930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4609b99d-4ff1-43e4-8d34-3b33ee2b9ffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:56:33 devstack sudo[88226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-8a2cd82e-8478-458b-985b-1386338d35a6 1073741824 Apr 22 17:56:33 devstack sudo[88226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:56:33 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-fbee2d8e-7219-42f4-9013-23c428184259 tempest-VolumesCloneTest-1670162930 None] Volume volume-7fb04710-31f8-445b-8cd6-d88e1e2d6006 (7fb04710-31f8-445b-8cd6-d88e1e2d6006): created successfully Apr 22 17:56:33 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-fbee2d8e-7219-42f4-9013-23c428184259 tempest-VolumesCloneTest-1670162930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4609b99d-4ff1-43e4-8d34-3b33ee2b9ffa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:56:33 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-fbee2d8e-7219-42f4-9013-23c428184259 tempest-VolumesCloneTest-1670162930 None] Flow 'volume_create_manager' (30772c64-b641-43b9-ab9d-88011fb7916d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:56:33 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-fbee2d8e-7219-42f4-9013-23c428184259 tempest-VolumesCloneTest-1670162930 None] Created volume successfully. Apr 22 17:56:33 devstack sudo[88223]: pam_unix(sudo:session): session closed for user root Apr 22 17:56:33 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-e4cf1dc7-3a47-4c93-ac5e-839f0aaccdd6 tempest-VolumesDeleteCascade-308204417 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b103161a-7291-4a16-b9ad-872efcc665a9" returned: 0 in 0.689s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:56:33 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-e4cf1dc7-3a47-4c93-ac5e-839f0aaccdd6 tempest-VolumesDeleteCascade-308204417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b103161a-7291-4a16-b9ad-872efcc665a9 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:56:33 devstack sudo[88231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b103161a-7291-4a16-b9ad-872efcc665a9 Apr 22 17:56:33 devstack sudo[88231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:56:34 devstack sudo[88226]: pam_unix(sudo:session): session closed for user root Apr 22 17:56:34 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-6cc942d1-6942-4ecb-8509-50989a5c86a5 tempest-CreateVolumesFromSnapshotTest-401145158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-8a2cd82e-8478-458b-985b-1386338d35a6 1073741824" returned: 0 in 0.720s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:56:34 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-6cc942d1-6942-4ecb-8509-50989a5c86a5 tempest-CreateVolumesFromSnapshotTest-401145158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-8a2cd82e-8478-458b-985b-1386338d35a6 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:56:34 devstack sudo[88231]: pam_unix(sudo:session): session closed for user root Apr 22 17:56:34 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-e4cf1dc7-3a47-4c93-ac5e-839f0aaccdd6 tempest-VolumesDeleteCascade-308204417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b103161a-7291-4a16-b9ad-872efcc665a9" returned: 0 in 0.528s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:56:34 devstack sudo[88237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-8a2cd82e-8478-458b-985b-1386338d35a6 Apr 22 17:56:34 devstack sudo[88237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:56:34 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-e4cf1dc7-3a47-4c93-ac5e-839f0aaccdd6 tempest-VolumesDeleteCascade-308204417 None] Lock "cinder-quobyte-b103161a-7291-4a16-b9ad-872efcc665a9" released by "delete_volume" :: held 1.291s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:56:34 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-e4cf1dc7-3a47-4c93-ac5e-839f0aaccdd6 tempest-VolumesDeleteCascade-308204417 None] Created reservations ['10894d49-8158-40e2-a977-fd4f112b3c7a', 'afe4f392-d673-48a7-b2a9-9e8c5a4bacb8', '31d9060c-d624-4bf9-beda-0f53b2b24bc6', '7b2d9582-2dad-4d74-bd57-2b8c2c99cea6'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 17:56:34 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-e4cf1dc7-3a47-4c93-ac5e-839f0aaccdd6 tempest-VolumesDeleteCascade-308204417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:56:34 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-e4cf1dc7-3a47-4c93-ac5e-839f0aaccdd6 tempest-VolumesDeleteCascade-308204417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:56:34 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-e4cf1dc7-3a47-4c93-ac5e-839f0aaccdd6 tempest-VolumesDeleteCascade-308204417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:56:34 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-e4cf1dc7-3a47-4c93-ac5e-839f0aaccdd6 tempest-VolumesDeleteCascade-308204417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:56:34 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-e4cf1dc7-3a47-4c93-ac5e-839f0aaccdd6 tempest-VolumesDeleteCascade-308204417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:56:34 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-e4cf1dc7-3a47-4c93-ac5e-839f0aaccdd6 tempest-VolumesDeleteCascade-308204417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:56:34 devstack sudo[88239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 Apr 22 17:56:34 devstack sudo[88239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:56:34 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-70f03148-ef99-4849-81b1-40fc968477d4 tempest-VolumesDeleteCascade-308204417 None] Acquiring lock "cinder-2286ec10-4a28-42b7-b157-68935cbbda6d-delete_volume" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:56:34 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-70f03148-ef99-4849-81b1-40fc968477d4 tempest-VolumesDeleteCascade-308204417 None] Lock "cinder-2286ec10-4a28-42b7-b157-68935cbbda6d-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:56:34 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-70f03148-ef99-4849-81b1-40fc968477d4 tempest-VolumesDeleteCascade-308204417 None] Acquiring lock "cinder-quobyte-2286ec10-4a28-42b7-b157-68935cbbda6d" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:56:34 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-70f03148-ef99-4849-81b1-40fc968477d4 tempest-VolumesDeleteCascade-308204417 None] Lock "cinder-quobyte-2286ec10-4a28-42b7-b157-68935cbbda6d" acquired by "delete_volume" :: waited 0.032s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:56:34 devstack sudo[88237]: pam_unix(sudo:session): session closed for user root Apr 22 17:56:34 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-6cc942d1-6942-4ecb-8509-50989a5c86a5 tempest-CreateVolumesFromSnapshotTest-401145158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-8a2cd82e-8478-458b-985b-1386338d35a6" returned: 0 in 0.543s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:56:34 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-6cc942d1-6942-4ecb-8509-50989a5c86a5 tempest-CreateVolumesFromSnapshotTest-401145158 None] <== create_volume: return (1305ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'} {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 17:56:34 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-6cc942d1-6942-4ecb-8509-50989a5c86a5 tempest-CreateVolumesFromSnapshotTest-401145158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.309s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:56:34 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e5c55b5-45b0-4465-b5cd-d098b60f79f0]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:56:34 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-4b298c49-a9f0-4059-9df8-15a5ab6a1da7 tempest-CreateVolumesFromSnapshotTest-401145158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.190s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:56:34 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-4b298c49-a9f0-4059-9df8-15a5ab6a1da7 tempest-CreateVolumesFromSnapshotTest-401145158 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:56:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1398416145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c505040f-0a45-4c62-9dfe-92144d289746,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3957959b6ebc404198d60e5c86311307',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:56:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:56:23Z,use_quota=True,user_id='76b25e93fa074cc3b5217e0e35652ef2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)}" {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 17:56:34 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-4b298c49-a9f0-4059-9df8-15a5ab6a1da7 tempest-CreateVolumesFromSnapshotTest-401145158 None] Creating volume c505040f-0a45-4c62-9dfe-92144d289746 {{(pid=81771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 17:56:34 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-4b298c49-a9f0-4059-9df8-15a5ab6a1da7 tempest-CreateVolumesFromSnapshotTest-401145158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:56:34 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-4b298c49-a9f0-4059-9df8-15a5ab6a1da7 tempest-CreateVolumesFromSnapshotTest-401145158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:56:34 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-4b298c49-a9f0-4059-9df8-15a5ab6a1da7 tempest-CreateVolumesFromSnapshotTest-401145158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:56:34 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-4b298c49-a9f0-4059-9df8-15a5ab6a1da7 tempest-CreateVolumesFromSnapshotTest-401145158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:56:34 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-4b298c49-a9f0-4059-9df8-15a5ab6a1da7 tempest-CreateVolumesFromSnapshotTest-401145158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:56:34 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-4b298c49-a9f0-4059-9df8-15a5ab6a1da7 tempest-CreateVolumesFromSnapshotTest-401145158 None] Selected osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 as target Quobyte volume. {{(pid=81771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 17:56:34 devstack cinder-volume[81771]: INFO cinder.volume.drivers.remotefs [None req-4b298c49-a9f0-4059-9df8-15a5ab6a1da7 tempest-CreateVolumesFromSnapshotTest-401145158 None] casted to osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 Apr 22 17:56:34 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-4b298c49-a9f0-4059-9df8-15a5ab6a1da7 tempest-CreateVolumesFromSnapshotTest-401145158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-c505040f-0a45-4c62-9dfe-92144d289746 1073741824 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:56:34 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-70f03148-ef99-4849-81b1-40fc968477d4 tempest-VolumesDeleteCascade-308204417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-2286ec10-4a28-42b7-b157-68935cbbda6d {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:56:34 devstack sudo[88242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-c505040f-0a45-4c62-9dfe-92144d289746 1073741824 Apr 22 17:56:34 devstack sudo[88242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:56:34 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-6cc942d1-6942-4ecb-8509-50989a5c86a5 tempest-CreateVolumesFromSnapshotTest-401145158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (161ee19b-2c20-4872-88ad-4e09b37b2d52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a2cd82e-8478-458b-985b-1386338d35a6', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:56:34 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-6cc942d1-6942-4ecb-8509-50989a5c86a5 tempest-CreateVolumesFromSnapshotTest-401145158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95f08d98-6269-47c8-bf21-0d021e8e2b61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:56:35 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-6cc942d1-6942-4ecb-8509-50989a5c86a5 tempest-CreateVolumesFromSnapshotTest-401145158 None] Volume volume-8a2cd82e-8478-458b-985b-1386338d35a6 (8a2cd82e-8478-458b-985b-1386338d35a6): created successfully Apr 22 17:56:35 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-6cc942d1-6942-4ecb-8509-50989a5c86a5 tempest-CreateVolumesFromSnapshotTest-401145158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95f08d98-6269-47c8-bf21-0d021e8e2b61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:56:35 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-6cc942d1-6942-4ecb-8509-50989a5c86a5 tempest-CreateVolumesFromSnapshotTest-401145158 None] Flow 'volume_create_manager' (9587d831-e260-4fba-9ba7-858a857a613d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:56:35 devstack sudo[88244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-2286ec10-4a28-42b7-b157-68935cbbda6d Apr 22 17:56:35 devstack sudo[88244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:56:35 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-6cc942d1-6942-4ecb-8509-50989a5c86a5 tempest-CreateVolumesFromSnapshotTest-401145158 None] Created volume successfully. Apr 22 17:56:35 devstack cinder-volume[81771]: DEBUG cinder.volume.flows.manager.create_volume [None req-d58eedc7-d07d-4d4d-a8f7-f1a2fb8042b1 tempest-VolumesCloneTest-1670162930 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 17:56:35 devstack sudo[88239]: pam_unix(sudo:session): session closed for user root Apr 22 17:56:35 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-d58eedc7-d07d-4d4d-a8f7-f1a2fb8042b1 tempest-VolumesCloneTest-1670162930 None] Flow 'volume_create_manager' (8e971ec8-f141-4aa6-9f83-7ea459429eea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:56:35 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-d58eedc7-d07d-4d4d-a8f7-f1a2fb8042b1 tempest-VolumesCloneTest-1670162930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af5c0211-5037-41f2-b4f2-643de0bc1eea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:56:35 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-e4cf1dc7-3a47-4c93-ac5e-839f0aaccdd6 tempest-VolumesDeleteCascade-308204417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33" returned: 0 in 0.806s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:56:35 devstack cinder-volume[81771]: DEBUG cinder.manager [None req-e4cf1dc7-3a47-4c93-ac5e-839f0aaccdd6 tempest-VolumesDeleteCascade-308204417 None] Notifying Schedulers of capabilities ... {{(pid=81771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 17:56:35 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-e4cf1dc7-3a47-4c93-ac5e-839f0aaccdd6 tempest-VolumesDeleteCascade-308204417 None] Deleted volume successfully. Apr 22 17:56:35 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-d58eedc7-d07d-4d4d-a8f7-f1a2fb8042b1 tempest-VolumesCloneTest-1670162930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af5c0211-5037-41f2-b4f2-643de0bc1eea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:56:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-2083586723',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87ec7399-d7af-411b-ad57-ea92f14c1916,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d86997e78d334169948803eab0062676',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:56:35Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=7fb04710-31f8-445b-8cd6-d88e1e2d6006,status='creating',terminated_at=None,updated_at=2026-04-22T15:56:35Z,use_quota=True,user_id='a0225d52c72c43ee8be93a058b9f60fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:56:35 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-d58eedc7-d07d-4d4d-a8f7-f1a2fb8042b1 tempest-VolumesCloneTest-1670162930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfa7e2e9-db21-4ef2-a989-2bf09f40df98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:56:35 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-d58eedc7-d07d-4d4d-a8f7-f1a2fb8042b1 tempest-VolumesCloneTest-1670162930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfa7e2e9-db21-4ef2-a989-2bf09f40df98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:56:35 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-d58eedc7-d07d-4d4d-a8f7-f1a2fb8042b1 tempest-VolumesCloneTest-1670162930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bf457dd-1027-49e7-80c9-ca6ea60b9ec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:56:35 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-d58eedc7-d07d-4d4d-a8f7-f1a2fb8042b1 tempest-VolumesCloneTest-1670162930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bf457dd-1027-49e7-80c9-ca6ea60b9ec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '87ec7399-d7af-411b-ad57-ea92f14c1916', 'volume_name': 'volume-87ec7399-d7af-411b-ad57-ea92f14c1916', 'volume_size': 2, 'source_volid': '7fb04710-31f8-445b-8cd6-d88e1e2d6006', 'source_volstatus': 'available'}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:56:35 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-d58eedc7-d07d-4d4d-a8f7-f1a2fb8042b1 tempest-VolumesCloneTest-1670162930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ad71a0c-4f94-4023-957d-b3a5a4762447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:56:35 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-d58eedc7-d07d-4d4d-a8f7-f1a2fb8042b1 tempest-VolumesCloneTest-1670162930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ad71a0c-4f94-4023-957d-b3a5a4762447) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:56:35 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-d58eedc7-d07d-4d4d-a8f7-f1a2fb8042b1 tempest-VolumesCloneTest-1670162930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30c018ca-dcdc-4387-9757-72760c926fd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:56:35 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-d58eedc7-d07d-4d4d-a8f7-f1a2fb8042b1 tempest-VolumesCloneTest-1670162930 None] Volume 87ec7399-d7af-411b-ad57-ea92f14c1916: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-87ec7399-d7af-411b-ad57-ea92f14c1916', 'volume_size': 2, 'source_volid': '7fb04710-31f8-445b-8cd6-d88e1e2d6006', 'source_volstatus': 'available'} Apr 22 17:56:35 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-e4cf1dc7-3a47-4c93-ac5e-839f0aaccdd6 tempest-VolumesDeleteCascade-308204417 None] Lock "cinder-b103161a-7291-4a16-b9ad-872efcc665a9-delete_volume" released by "delete_volume" :: held 5.271s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:56:35 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-d58eedc7-d07d-4d4d-a8f7-f1a2fb8042b1 tempest-VolumesCloneTest-1670162930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:56:35 devstack sudo[88244]: pam_unix(sudo:session): session closed for user root Apr 22 17:56:35 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-70f03148-ef99-4849-81b1-40fc968477d4 tempest-VolumesDeleteCascade-308204417 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-2286ec10-4a28-42b7-b157-68935cbbda6d" returned: 0 in 0.682s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:56:35 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-70f03148-ef99-4849-81b1-40fc968477d4 tempest-VolumesDeleteCascade-308204417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-2286ec10-4a28-42b7-b157-68935cbbda6d {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:56:35 devstack sudo[88253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-2286ec10-4a28-42b7-b157-68935cbbda6d Apr 22 17:56:35 devstack sudo[88253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:56:35 devstack sudo[88242]: pam_unix(sudo:session): session closed for user root Apr 22 17:56:35 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-4b298c49-a9f0-4059-9df8-15a5ab6a1da7 tempest-CreateVolumesFromSnapshotTest-401145158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-c505040f-0a45-4c62-9dfe-92144d289746 1073741824" returned: 0 in 0.954s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:56:35 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-4b298c49-a9f0-4059-9df8-15a5ab6a1da7 tempest-CreateVolumesFromSnapshotTest-401145158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-c505040f-0a45-4c62-9dfe-92144d289746 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:56:35 devstack sudo[88255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-c505040f-0a45-4c62-9dfe-92144d289746 Apr 22 17:56:35 devstack sudo[88255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:56:36 devstack sudo[88253]: pam_unix(sudo:session): session closed for user root Apr 22 17:56:36 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-70f03148-ef99-4849-81b1-40fc968477d4 tempest-VolumesDeleteCascade-308204417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-2286ec10-4a28-42b7-b157-68935cbbda6d" returned: 0 in 0.516s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:56:36 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-70f03148-ef99-4849-81b1-40fc968477d4 tempest-VolumesDeleteCascade-308204417 None] Lock "cinder-quobyte-2286ec10-4a28-42b7-b157-68935cbbda6d" released by "delete_volume" :: held 1.347s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:56:36 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-70f03148-ef99-4849-81b1-40fc968477d4 tempest-VolumesDeleteCascade-308204417 None] Created reservations ['ae4ddf52-590f-4cd3-980c-f0211b0eb4f5', '732c610e-4130-4c19-887b-bd5596d0420d', '5b0f0dd7-8098-441c-8e4e-68c7f5386627', '7178b11c-f14b-4d24-bb6a-97842337b0e9'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 17:56:36 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-70f03148-ef99-4849-81b1-40fc968477d4 tempest-VolumesDeleteCascade-308204417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:56:36 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-70f03148-ef99-4849-81b1-40fc968477d4 tempest-VolumesDeleteCascade-308204417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:56:36 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-70f03148-ef99-4849-81b1-40fc968477d4 tempest-VolumesDeleteCascade-308204417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:56:36 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-70f03148-ef99-4849-81b1-40fc968477d4 tempest-VolumesDeleteCascade-308204417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:56:36 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-70f03148-ef99-4849-81b1-40fc968477d4 tempest-VolumesDeleteCascade-308204417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:56:36 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-70f03148-ef99-4849-81b1-40fc968477d4 tempest-VolumesDeleteCascade-308204417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:56:36 devstack sudo[88258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 Apr 22 17:56:36 devstack sudo[88258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:56:36 devstack sudo[88255]: pam_unix(sudo:session): session closed for user root Apr 22 17:56:36 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-4b298c49-a9f0-4059-9df8-15a5ab6a1da7 tempest-CreateVolumesFromSnapshotTest-401145158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-c505040f-0a45-4c62-9dfe-92144d289746" returned: 0 in 0.575s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:56:36 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-4b298c49-a9f0-4059-9df8-15a5ab6a1da7 tempest-CreateVolumesFromSnapshotTest-401145158 None] <== create_volume: return (1584ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'} {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 17:56:36 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-4b298c49-a9f0-4059-9df8-15a5ab6a1da7 tempest-CreateVolumesFromSnapshotTest-401145158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.590s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:56:36 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-4be32372-dd88-4838-8257-22968da9f0ef tempest-CreateVolumesFromSnapshotTest-401145158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.105s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:56:36 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-4be32372-dd88-4838-8257-22968da9f0ef tempest-CreateVolumesFromSnapshotTest-401145158 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:56:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1153702005',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31277914-4dec-4e0f-a0b8-92917f608ada,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3957959b6ebc404198d60e5c86311307',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:56:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:56:24Z,use_quota=True,user_id='76b25e93fa074cc3b5217e0e35652ef2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)}" {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 17:56:36 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-4be32372-dd88-4838-8257-22968da9f0ef tempest-CreateVolumesFromSnapshotTest-401145158 None] Creating volume 31277914-4dec-4e0f-a0b8-92917f608ada {{(pid=81771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 17:56:36 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-4be32372-dd88-4838-8257-22968da9f0ef tempest-CreateVolumesFromSnapshotTest-401145158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:56:36 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-4be32372-dd88-4838-8257-22968da9f0ef tempest-CreateVolumesFromSnapshotTest-401145158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:56:36 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-4be32372-dd88-4838-8257-22968da9f0ef tempest-CreateVolumesFromSnapshotTest-401145158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:56:36 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-4be32372-dd88-4838-8257-22968da9f0ef tempest-CreateVolumesFromSnapshotTest-401145158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:56:36 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-4be32372-dd88-4838-8257-22968da9f0ef tempest-CreateVolumesFromSnapshotTest-401145158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:56:36 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-4be32372-dd88-4838-8257-22968da9f0ef tempest-CreateVolumesFromSnapshotTest-401145158 None] Selected osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 as target Quobyte volume. {{(pid=81771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 17:56:36 devstack cinder-volume[81771]: INFO cinder.volume.drivers.remotefs [None req-4be32372-dd88-4838-8257-22968da9f0ef tempest-CreateVolumesFromSnapshotTest-401145158 None] casted to osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 Apr 22 17:56:36 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-4be32372-dd88-4838-8257-22968da9f0ef tempest-CreateVolumesFromSnapshotTest-401145158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-31277914-4dec-4e0f-a0b8-92917f608ada 1073741824 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:56:36 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-4b298c49-a9f0-4059-9df8-15a5ab6a1da7 tempest-CreateVolumesFromSnapshotTest-401145158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96f5537e-2980-446e-83f1-923114d13fe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c505040f-0a45-4c62-9dfe-92144d289746', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:56:36 devstack sudo[88261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-31277914-4dec-4e0f-a0b8-92917f608ada 1073741824 Apr 22 17:56:36 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-4b298c49-a9f0-4059-9df8-15a5ab6a1da7 tempest-CreateVolumesFromSnapshotTest-401145158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7690a66b-2cf3-443c-ba12-fc70eec18436) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:56:36 devstack sudo[88261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:56:36 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-4b298c49-a9f0-4059-9df8-15a5ab6a1da7 tempest-CreateVolumesFromSnapshotTest-401145158 None] Volume volume-c505040f-0a45-4c62-9dfe-92144d289746 (c505040f-0a45-4c62-9dfe-92144d289746): created successfully Apr 22 17:56:36 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-4b298c49-a9f0-4059-9df8-15a5ab6a1da7 tempest-CreateVolumesFromSnapshotTest-401145158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7690a66b-2cf3-443c-ba12-fc70eec18436) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:56:36 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-4b298c49-a9f0-4059-9df8-15a5ab6a1da7 tempest-CreateVolumesFromSnapshotTest-401145158 None] Flow 'volume_create_manager' (2962342a-a7f2-4575-b8db-99a677199284) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:56:36 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-4b298c49-a9f0-4059-9df8-15a5ab6a1da7 tempest-CreateVolumesFromSnapshotTest-401145158 None] Created volume successfully. Apr 22 17:56:36 devstack sudo[88258]: pam_unix(sudo:session): session closed for user root Apr 22 17:56:36 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-70f03148-ef99-4849-81b1-40fc968477d4 tempest-VolumesDeleteCascade-308204417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33" returned: 0 in 0.495s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:56:36 devstack cinder-volume[81771]: DEBUG cinder.manager [None req-70f03148-ef99-4849-81b1-40fc968477d4 tempest-VolumesDeleteCascade-308204417 None] Notifying Schedulers of capabilities ... {{(pid=81771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 17:56:36 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-70f03148-ef99-4849-81b1-40fc968477d4 tempest-VolumesDeleteCascade-308204417 None] Deleted volume successfully. Apr 22 17:56:36 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-70f03148-ef99-4849-81b1-40fc968477d4 tempest-VolumesDeleteCascade-308204417 None] Lock "cinder-2286ec10-4a28-42b7-b157-68935cbbda6d-delete_volume" released by "delete_volume" :: held 2.111s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:56:37 devstack sudo[88261]: pam_unix(sudo:session): session closed for user root Apr 22 17:56:37 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-4be32372-dd88-4838-8257-22968da9f0ef tempest-CreateVolumesFromSnapshotTest-401145158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-31277914-4dec-4e0f-a0b8-92917f608ada 1073741824" returned: 0 in 0.838s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:56:37 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-4be32372-dd88-4838-8257-22968da9f0ef tempest-CreateVolumesFromSnapshotTest-401145158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-31277914-4dec-4e0f-a0b8-92917f608ada {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:56:37 devstack sudo[88268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-31277914-4dec-4e0f-a0b8-92917f608ada Apr 22 17:56:37 devstack sudo[88268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:56:37 devstack sudo[88268]: pam_unix(sudo:session): session closed for user root Apr 22 17:56:37 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-4be32372-dd88-4838-8257-22968da9f0ef tempest-CreateVolumesFromSnapshotTest-401145158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-31277914-4dec-4e0f-a0b8-92917f608ada" returned: 0 in 0.612s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:56:37 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-4be32372-dd88-4838-8257-22968da9f0ef tempest-CreateVolumesFromSnapshotTest-401145158 None] <== create_volume: return (1492ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'} {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 17:56:37 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-4be32372-dd88-4838-8257-22968da9f0ef tempest-CreateVolumesFromSnapshotTest-401145158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.495s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:56:37 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-d58eedc7-d07d-4d4d-a8f7-f1a2fb8042b1 tempest-VolumesCloneTest-1670162930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 2.536s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:56:37 devstack cinder-volume[81771]: INFO cinder.volume.drivers.remotefs [None req-d58eedc7-d07d-4d4d-a8f7-f1a2fb8042b1 tempest-VolumesCloneTest-1670162930 None] Cloning volume 7fb04710-31f8-445b-8cd6-d88e1e2d6006 to volume 87ec7399-d7af-411b-ad57-ea92f14c1916 Apr 22 17:56:37 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-4be32372-dd88-4838-8257-22968da9f0ef tempest-CreateVolumesFromSnapshotTest-401145158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c33dc74-fe45-4951-982f-2a8235226a7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31277914-4dec-4e0f-a0b8-92917f608ada', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:56:37 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-4be32372-dd88-4838-8257-22968da9f0ef tempest-CreateVolumesFromSnapshotTest-401145158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ee794d5-1e52-4c74-b03b-52b45aca5085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:56:38 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-4be32372-dd88-4838-8257-22968da9f0ef tempest-CreateVolumesFromSnapshotTest-401145158 None] Volume volume-31277914-4dec-4e0f-a0b8-92917f608ada (31277914-4dec-4e0f-a0b8-92917f608ada): created successfully Apr 22 17:56:38 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-4be32372-dd88-4838-8257-22968da9f0ef tempest-CreateVolumesFromSnapshotTest-401145158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ee794d5-1e52-4c74-b03b-52b45aca5085) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:56:38 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-4be32372-dd88-4838-8257-22968da9f0ef tempest-CreateVolumesFromSnapshotTest-401145158 None] Flow 'volume_create_manager' (cffa9526-761c-4c2a-95b7-c6ab4738b085) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:56:38 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-d58eedc7-d07d-4d4d-a8f7-f1a2fb8042b1 tempest-VolumesCloneTest-1670162930 None] Creating offline snapshot a4785083-f351-4505-a730-6b80bf030dec of volume 7fb04710-31f8-445b-8cd6-d88e1e2d6006 {{(pid=81771) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 22 17:56:38 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-4be32372-dd88-4838-8257-22968da9f0ef tempest-CreateVolumesFromSnapshotTest-401145158 None] Created volume successfully. Apr 22 17:56:38 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa236ed4-d5ba-4166-98f4-6a0fb4011511]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:56:38 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-d58eedc7-d07d-4d4d-a8f7-f1a2fb8042b1 tempest-VolumesCloneTest-1670162930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7fb04710-31f8-445b-8cd6-d88e1e2d6006 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:56:38 devstack sudo[88271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7fb04710-31f8-445b-8cd6-d88e1e2d6006 Apr 22 17:56:38 devstack sudo[88271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:56:38 devstack sudo[88271]: pam_unix(sudo:session): session closed for user root Apr 22 17:56:38 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-d58eedc7-d07d-4d4d-a8f7-f1a2fb8042b1 tempest-VolumesCloneTest-1670162930 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7fb04710-31f8-445b-8cd6-d88e1e2d6006" returned: 0 in 0.662s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:56:38 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-d58eedc7-d07d-4d4d-a8f7-f1a2fb8042b1 tempest-VolumesCloneTest-1670162930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7fb04710-31f8-445b-8cd6-d88e1e2d6006,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7fb04710-31f8-445b-8cd6-d88e1e2d6006.a4785083-f351-4505-a730-6b80bf030dec 1G {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:56:38 devstack sudo[88276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7fb04710-31f8-445b-8cd6-d88e1e2d6006,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7fb04710-31f8-445b-8cd6-d88e1e2d6006.a4785083-f351-4505-a730-6b80bf030dec 1G Apr 22 17:56:38 devstack sudo[88276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:56:38 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-99c908b5-296f-4695-b4fc-77a1084bfe18 tempest-CreateVolumesFromSnapshotTest-401145158 None] Acquiring lock "cinder-31277914-4dec-4e0f-a0b8-92917f608ada-delete_volume" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:56:38 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-99c908b5-296f-4695-b4fc-77a1084bfe18 tempest-CreateVolumesFromSnapshotTest-401145158 None] Lock "cinder-31277914-4dec-4e0f-a0b8-92917f608ada-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:56:38 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-99c908b5-296f-4695-b4fc-77a1084bfe18 tempest-CreateVolumesFromSnapshotTest-401145158 None] Acquiring lock "cinder-quobyte-31277914-4dec-4e0f-a0b8-92917f608ada" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:56:38 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-99c908b5-296f-4695-b4fc-77a1084bfe18 tempest-CreateVolumesFromSnapshotTest-401145158 None] Lock "cinder-quobyte-31277914-4dec-4e0f-a0b8-92917f608ada" acquired by "delete_volume" :: waited 0.034s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:56:38 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[751a1f9e-754d-4ef9-b862-205e0da8278d]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:56:38 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-99c908b5-296f-4695-b4fc-77a1084bfe18 tempest-CreateVolumesFromSnapshotTest-401145158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-31277914-4dec-4e0f-a0b8-92917f608ada {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:56:39 devstack sudo[88278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-31277914-4dec-4e0f-a0b8-92917f608ada Apr 22 17:56:39 devstack sudo[88278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:56:39 devstack sudo[88276]: pam_unix(sudo:session): session closed for user root Apr 22 17:56:39 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-d58eedc7-d07d-4d4d-a8f7-f1a2fb8042b1 tempest-VolumesCloneTest-1670162930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7fb04710-31f8-445b-8cd6-d88e1e2d6006,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7fb04710-31f8-445b-8cd6-d88e1e2d6006.a4785083-f351-4505-a730-6b80bf030dec 1G" returned: 0 in 0.895s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:56:39 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-d58eedc7-d07d-4d4d-a8f7-f1a2fb8042b1 tempest-VolumesCloneTest-1670162930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7fb04710-31f8-445b-8cd6-d88e1e2d6006 -F qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7fb04710-31f8-445b-8cd6-d88e1e2d6006.a4785083-f351-4505-a730-6b80bf030dec {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:56:39 devstack sudo[88286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7fb04710-31f8-445b-8cd6-d88e1e2d6006 -F qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7fb04710-31f8-445b-8cd6-d88e1e2d6006.a4785083-f351-4505-a730-6b80bf030dec Apr 22 17:56:39 devstack sudo[88286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:56:39 devstack sudo[88278]: pam_unix(sudo:session): session closed for user root Apr 22 17:56:39 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-99c908b5-296f-4695-b4fc-77a1084bfe18 tempest-CreateVolumesFromSnapshotTest-401145158 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-31277914-4dec-4e0f-a0b8-92917f608ada" returned: 0 in 0.795s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:56:39 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-99c908b5-296f-4695-b4fc-77a1084bfe18 tempest-CreateVolumesFromSnapshotTest-401145158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-31277914-4dec-4e0f-a0b8-92917f608ada {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:56:39 devstack sudo[88288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-31277914-4dec-4e0f-a0b8-92917f608ada Apr 22 17:56:39 devstack sudo[88288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:56:40 devstack sudo[88286]: pam_unix(sudo:session): session closed for user root Apr 22 17:56:40 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-d58eedc7-d07d-4d4d-a8f7-f1a2fb8042b1 tempest-VolumesCloneTest-1670162930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7fb04710-31f8-445b-8cd6-d88e1e2d6006 -F qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7fb04710-31f8-445b-8cd6-d88e1e2d6006.a4785083-f351-4505-a730-6b80bf030dec" returned: 0 in 0.628s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:56:40 devstack cinder-volume[81771]: WARNING cinder.volume.drivers.remotefs [None req-d58eedc7-d07d-4d4d-a8f7-f1a2fb8042b1 tempest-VolumesCloneTest-1670162930 None] /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7fb04710-31f8-445b-8cd6-d88e1e2d6006.a4785083-f351-4505-a730-6b80bf030dec is being set with open permissions: ugo+rw Apr 22 17:56:40 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-d58eedc7-d07d-4d4d-a8f7-f1a2fb8042b1 tempest-VolumesCloneTest-1670162930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7fb04710-31f8-445b-8cd6-d88e1e2d6006.a4785083-f351-4505-a730-6b80bf030dec {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:56:40 devstack sudo[88293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7fb04710-31f8-445b-8cd6-d88e1e2d6006.a4785083-f351-4505-a730-6b80bf030dec Apr 22 17:56:40 devstack sudo[88293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:56:40 devstack sudo[88288]: pam_unix(sudo:session): session closed for user root Apr 22 17:56:40 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-99c908b5-296f-4695-b4fc-77a1084bfe18 tempest-CreateVolumesFromSnapshotTest-401145158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-31277914-4dec-4e0f-a0b8-92917f608ada" returned: 0 in 0.694s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:56:40 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-99c908b5-296f-4695-b4fc-77a1084bfe18 tempest-CreateVolumesFromSnapshotTest-401145158 None] Lock "cinder-quobyte-31277914-4dec-4e0f-a0b8-92917f608ada" released by "delete_volume" :: held 1.597s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:56:40 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-99c908b5-296f-4695-b4fc-77a1084bfe18 tempest-CreateVolumesFromSnapshotTest-401145158 None] Created reservations ['9f453a62-6b5a-42d3-a231-5f294aac05d1', '9f8a5443-b000-49c0-abe1-945e09128114', '1108985e-9842-4af2-b502-4cd2ff7dcb42', 'cb4bbea8-147b-443b-a994-3c53c7326244'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 17:56:40 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-99c908b5-296f-4695-b4fc-77a1084bfe18 tempest-CreateVolumesFromSnapshotTest-401145158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:56:40 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-99c908b5-296f-4695-b4fc-77a1084bfe18 tempest-CreateVolumesFromSnapshotTest-401145158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:56:40 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-99c908b5-296f-4695-b4fc-77a1084bfe18 tempest-CreateVolumesFromSnapshotTest-401145158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:56:40 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-99c908b5-296f-4695-b4fc-77a1084bfe18 tempest-CreateVolumesFromSnapshotTest-401145158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:56:40 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-99c908b5-296f-4695-b4fc-77a1084bfe18 tempest-CreateVolumesFromSnapshotTest-401145158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:56:40 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-99c908b5-296f-4695-b4fc-77a1084bfe18 tempest-CreateVolumesFromSnapshotTest-401145158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:56:40 devstack sudo[88296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 Apr 22 17:56:40 devstack sudo[88296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:56:40 devstack sudo[88293]: pam_unix(sudo:session): session closed for user root Apr 22 17:56:40 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-d58eedc7-d07d-4d4d-a8f7-f1a2fb8042b1 tempest-VolumesCloneTest-1670162930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7fb04710-31f8-445b-8cd6-d88e1e2d6006.a4785083-f351-4505-a730-6b80bf030dec" returned: 0 in 0.547s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:56:40 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-d58eedc7-d07d-4d4d-a8f7-f1a2fb8042b1 tempest-VolumesCloneTest-1670162930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7fb04710-31f8-445b-8cd6-d88e1e2d6006.info {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:56:40 devstack sudo[88299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7fb04710-31f8-445b-8cd6-d88e1e2d6006.info Apr 22 17:56:40 devstack sudo[88299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:56:41 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-6206bc6b-85fa-4ef4-9691-cb975805b2ee tempest-CreateVolumesFromSnapshotTest-401145158 None] Acquiring lock "cinder-c505040f-0a45-4c62-9dfe-92144d289746-delete_volume" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:56:41 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-6206bc6b-85fa-4ef4-9691-cb975805b2ee tempest-CreateVolumesFromSnapshotTest-401145158 None] Lock "cinder-c505040f-0a45-4c62-9dfe-92144d289746-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:56:41 devstack sudo[88296]: pam_unix(sudo:session): session closed for user root Apr 22 17:56:41 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-99c908b5-296f-4695-b4fc-77a1084bfe18 tempest-CreateVolumesFromSnapshotTest-401145158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33" returned: 0 in 0.530s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:56:41 devstack cinder-volume[81771]: DEBUG cinder.manager [None req-99c908b5-296f-4695-b4fc-77a1084bfe18 tempest-CreateVolumesFromSnapshotTest-401145158 None] Notifying Schedulers of capabilities ... {{(pid=81771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 17:56:41 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-99c908b5-296f-4695-b4fc-77a1084bfe18 tempest-CreateVolumesFromSnapshotTest-401145158 None] Deleted volume successfully. Apr 22 17:56:41 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-6206bc6b-85fa-4ef4-9691-cb975805b2ee tempest-CreateVolumesFromSnapshotTest-401145158 None] Acquiring lock "cinder-quobyte-c505040f-0a45-4c62-9dfe-92144d289746" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:56:41 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-99c908b5-296f-4695-b4fc-77a1084bfe18 tempest-CreateVolumesFromSnapshotTest-401145158 None] Lock "cinder-31277914-4dec-4e0f-a0b8-92917f608ada-delete_volume" released by "delete_volume" :: held 2.388s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:56:41 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-6206bc6b-85fa-4ef4-9691-cb975805b2ee tempest-CreateVolumesFromSnapshotTest-401145158 None] Lock "cinder-quobyte-c505040f-0a45-4c62-9dfe-92144d289746" acquired by "delete_volume" :: waited 0.020s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:56:41 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[e327c700-5945-4303-ac97-8e77ee8375f6]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:56:41 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-6206bc6b-85fa-4ef4-9691-cb975805b2ee tempest-CreateVolumesFromSnapshotTest-401145158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-c505040f-0a45-4c62-9dfe-92144d289746 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:56:41 devstack cinder-volume[81771]: DEBUG cinder.volume.flows.manager.create_volume [None req-dcb376fd-85b8-453f-98a8-1eed816d341b tempest-VolumeQuotasNegativeTestJSON-2080922197 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 17:56:41 devstack sudo[88302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-c505040f-0a45-4c62-9dfe-92144d289746 Apr 22 17:56:41 devstack sudo[88302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:56:41 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-dcb376fd-85b8-453f-98a8-1eed816d341b tempest-VolumeQuotasNegativeTestJSON-2080922197 None] Flow 'volume_create_manager' (fd1f271f-b5be-4139-989c-6a25f3778dc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:56:41 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-dcb376fd-85b8-453f-98a8-1eed816d341b tempest-VolumeQuotasNegativeTestJSON-2080922197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ecf103e-131d-43fe-bf68-e577c8067da1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:56:41 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-dcb376fd-85b8-453f-98a8-1eed816d341b tempest-VolumeQuotasNegativeTestJSON-2080922197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ecf103e-131d-43fe-bf68-e577c8067da1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:56:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-2112565148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2b49dc9-6218-41a2-9a3e-583db24a20a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3af9cd1625974e09b1dd8a0314cf016a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:56:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:56:41Z,use_quota=True,user_id='a0db120928844e37b0effa1ef185ed22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:56:41 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-dcb376fd-85b8-453f-98a8-1eed816d341b tempest-VolumeQuotasNegativeTestJSON-2080922197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c06f1ed-7a51-4957-9ad0-31afee264f01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:56:41 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-dcb376fd-85b8-453f-98a8-1eed816d341b tempest-VolumeQuotasNegativeTestJSON-2080922197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c06f1ed-7a51-4957-9ad0-31afee264f01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:56:41 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-dcb376fd-85b8-453f-98a8-1eed816d341b tempest-VolumeQuotasNegativeTestJSON-2080922197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9ee88e2-eb4c-4971-8362-f6079608b813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:56:41 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-dcb376fd-85b8-453f-98a8-1eed816d341b tempest-VolumeQuotasNegativeTestJSON-2080922197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9ee88e2-eb4c-4971-8362-f6079608b813) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2b49dc9-6218-41a2-9a3e-583db24a20a7', 'volume_name': 'volume-d2b49dc9-6218-41a2-9a3e-583db24a20a7', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:56:41 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-dcb376fd-85b8-453f-98a8-1eed816d341b tempest-VolumeQuotasNegativeTestJSON-2080922197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5eaefa8-ba20-4783-a21d-e0bfa32ce7e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:56:41 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-dcb376fd-85b8-453f-98a8-1eed816d341b tempest-VolumeQuotasNegativeTestJSON-2080922197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5eaefa8-ba20-4783-a21d-e0bfa32ce7e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:56:41 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-dcb376fd-85b8-453f-98a8-1eed816d341b tempest-VolumeQuotasNegativeTestJSON-2080922197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d4f18f5-f002-4a4e-904b-ac2c30eecbde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:56:41 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-dcb376fd-85b8-453f-98a8-1eed816d341b tempest-VolumeQuotasNegativeTestJSON-2080922197 None] Volume d2b49dc9-6218-41a2-9a3e-583db24a20a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2b49dc9-6218-41a2-9a3e-583db24a20a7', 'volume_size': 1} Apr 22 17:56:41 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-dcb376fd-85b8-453f-98a8-1eed816d341b tempest-VolumeQuotasNegativeTestJSON-2080922197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:56:41 devstack sudo[88299]: pam_unix(sudo:session): session closed for user root Apr 22 17:56:41 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-d58eedc7-d07d-4d4d-a8f7-f1a2fb8042b1 tempest-VolumesCloneTest-1670162930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7fb04710-31f8-445b-8cd6-d88e1e2d6006.info" returned: 0 in 0.690s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:56:41 devstack cinder-volume[81771]: WARNING cinder.volume.drivers.remotefs [None req-d58eedc7-d07d-4d4d-a8f7-f1a2fb8042b1 tempest-VolumesCloneTest-1670162930 None] /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7fb04710-31f8-445b-8cd6-d88e1e2d6006.info is being set with open permissions: ugo+rw Apr 22 17:56:41 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-d58eedc7-d07d-4d4d-a8f7-f1a2fb8042b1 tempest-VolumesCloneTest-1670162930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7fb04710-31f8-445b-8cd6-d88e1e2d6006.info {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:56:41 devstack sudo[88305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7fb04710-31f8-445b-8cd6-d88e1e2d6006.info Apr 22 17:56:41 devstack sudo[88305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:56:41 devstack cinder-volume[81771]: DEBUG cinder.volume.flows.manager.create_volume [None req-1624aaa1-f05c-4458-9ab6-5e19f89328f5 tempest-VolumesTransfersV357Test-1195682345 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 17:56:41 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-1624aaa1-f05c-4458-9ab6-5e19f89328f5 tempest-VolumesTransfersV357Test-1195682345 None] Flow 'volume_create_manager' (6956e56c-6397-4790-bd25-f8c85ac5ad8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:56:41 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-1624aaa1-f05c-4458-9ab6-5e19f89328f5 tempest-VolumesTransfersV357Test-1195682345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca3e152a-c165-48b6-9556-3906a5dfb132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:56:41 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-1624aaa1-f05c-4458-9ab6-5e19f89328f5 tempest-VolumesTransfersV357Test-1195682345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca3e152a-c165-48b6-9556-3906a5dfb132) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:56:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1261349857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bfeac25-cc96-4471-954e-b24aeadbc7b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29193b0c0990493b83f3fc1016d5ecd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:56:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:56:42Z,use_quota=True,user_id='edff406fc1c94aff80730fc2014a2d15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:56:41 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-1624aaa1-f05c-4458-9ab6-5e19f89328f5 tempest-VolumesTransfersV357Test-1195682345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a12c70ae-510a-4c17-b8bc-8cf272c70e3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:56:41 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-1624aaa1-f05c-4458-9ab6-5e19f89328f5 tempest-VolumesTransfersV357Test-1195682345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a12c70ae-510a-4c17-b8bc-8cf272c70e3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:56:41 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-1624aaa1-f05c-4458-9ab6-5e19f89328f5 tempest-VolumesTransfersV357Test-1195682345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1fcafe6-a660-4d6b-ab10-fa213dcb8168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:56:41 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-1624aaa1-f05c-4458-9ab6-5e19f89328f5 tempest-VolumesTransfersV357Test-1195682345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1fcafe6-a660-4d6b-ab10-fa213dcb8168) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3bfeac25-cc96-4471-954e-b24aeadbc7b7', 'volume_name': 'volume-3bfeac25-cc96-4471-954e-b24aeadbc7b7', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:56:41 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-1624aaa1-f05c-4458-9ab6-5e19f89328f5 tempest-VolumesTransfersV357Test-1195682345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7b178fe-c0b6-4192-86c8-0c31bc8deceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:56:41 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-1624aaa1-f05c-4458-9ab6-5e19f89328f5 tempest-VolumesTransfersV357Test-1195682345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7b178fe-c0b6-4192-86c8-0c31bc8deceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:56:41 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-1624aaa1-f05c-4458-9ab6-5e19f89328f5 tempest-VolumesTransfersV357Test-1195682345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c37d56bf-34a8-443a-90d9-d433bdc8ffcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:56:41 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-1624aaa1-f05c-4458-9ab6-5e19f89328f5 tempest-VolumesTransfersV357Test-1195682345 None] Volume 3bfeac25-cc96-4471-954e-b24aeadbc7b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3bfeac25-cc96-4471-954e-b24aeadbc7b7', 'volume_size': 1} Apr 22 17:56:41 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-1624aaa1-f05c-4458-9ab6-5e19f89328f5 tempest-VolumesTransfersV357Test-1195682345 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:56:41 devstack sudo[88302]: pam_unix(sudo:session): session closed for user root Apr 22 17:56:41 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-6206bc6b-85fa-4ef4-9691-cb975805b2ee tempest-CreateVolumesFromSnapshotTest-401145158 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-c505040f-0a45-4c62-9dfe-92144d289746" returned: 0 in 0.697s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:56:41 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-6206bc6b-85fa-4ef4-9691-cb975805b2ee tempest-CreateVolumesFromSnapshotTest-401145158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-c505040f-0a45-4c62-9dfe-92144d289746 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:56:41 devstack sudo[88310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-c505040f-0a45-4c62-9dfe-92144d289746 Apr 22 17:56:41 devstack sudo[88310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:56:41 devstack sudo[88305]: pam_unix(sudo:session): session closed for user root Apr 22 17:56:41 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-d58eedc7-d07d-4d4d-a8f7-f1a2fb8042b1 tempest-VolumesCloneTest-1670162930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7fb04710-31f8-445b-8cd6-d88e1e2d6006.info" returned: 0 in 0.485s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:56:41 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-d58eedc7-d07d-4d4d-a8f7-f1a2fb8042b1 tempest-VolumesCloneTest-1670162930 None] Acquiring lock "cinder-quobyte-87ec7399-d7af-411b-ad57-ea92f14c1916" by "_copy_volume_from_snapshot" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:56:42 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-d58eedc7-d07d-4d4d-a8f7-f1a2fb8042b1 tempest-VolumesCloneTest-1670162930 None] Lock "cinder-quobyte-87ec7399-d7af-411b-ad57-ea92f14c1916" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:56:42 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-d58eedc7-d07d-4d4d-a8f7-f1a2fb8042b1 tempest-VolumesCloneTest-1670162930 None] snapshot: a4785083-f351-4505-a730-6b80bf030dec, volume: 87ec7399-d7af-411b-ad57-ea92f14c1916, {{(pid=81771) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 22 17:56:42 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-d58eedc7-d07d-4d4d-a8f7-f1a2fb8042b1 tempest-VolumesCloneTest-1670162930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:56:42 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-d58eedc7-d07d-4d4d-a8f7-f1a2fb8042b1 tempest-VolumesCloneTest-1670162930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:56:42 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-d58eedc7-d07d-4d4d-a8f7-f1a2fb8042b1 tempest-VolumesCloneTest-1670162930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:56:42 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-d58eedc7-d07d-4d4d-a8f7-f1a2fb8042b1 tempest-VolumesCloneTest-1670162930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:56:42 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-d58eedc7-d07d-4d4d-a8f7-f1a2fb8042b1 tempest-VolumesCloneTest-1670162930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:56:42 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bd361bc-beca-4143-b3d0-5e74b51eec94]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:56:42 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-d58eedc7-d07d-4d4d-a8f7-f1a2fb8042b1 tempest-VolumesCloneTest-1670162930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7fb04710-31f8-445b-8cd6-d88e1e2d6006.a4785083-f351-4505-a730-6b80bf030dec {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:56:42 devstack sudo[88313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7fb04710-31f8-445b-8cd6-d88e1e2d6006.a4785083-f351-4505-a730-6b80bf030dec Apr 22 17:56:42 devstack sudo[88313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:56:42 devstack sudo[88310]: pam_unix(sudo:session): session closed for user root Apr 22 17:56:42 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-6206bc6b-85fa-4ef4-9691-cb975805b2ee tempest-CreateVolumesFromSnapshotTest-401145158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-c505040f-0a45-4c62-9dfe-92144d289746" returned: 0 in 0.482s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:56:42 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-6206bc6b-85fa-4ef4-9691-cb975805b2ee tempest-CreateVolumesFromSnapshotTest-401145158 None] Lock "cinder-quobyte-c505040f-0a45-4c62-9dfe-92144d289746" released by "delete_volume" :: held 1.218s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:56:42 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-6206bc6b-85fa-4ef4-9691-cb975805b2ee tempest-CreateVolumesFromSnapshotTest-401145158 None] Created reservations ['1550d20e-3ca3-464a-9f37-2a64b98cb7eb', '44967ee8-fd98-4dea-9ecf-33e08a02b7bc', '5fad2998-3d84-40a3-ae28-912a0f9f889d', '29144809-d293-4a85-a45e-34e8a6a14f19'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 17:56:42 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-6206bc6b-85fa-4ef4-9691-cb975805b2ee tempest-CreateVolumesFromSnapshotTest-401145158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:56:42 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-6206bc6b-85fa-4ef4-9691-cb975805b2ee tempest-CreateVolumesFromSnapshotTest-401145158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:56:42 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-6206bc6b-85fa-4ef4-9691-cb975805b2ee tempest-CreateVolumesFromSnapshotTest-401145158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:56:42 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-6206bc6b-85fa-4ef4-9691-cb975805b2ee tempest-CreateVolumesFromSnapshotTest-401145158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:56:42 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-6206bc6b-85fa-4ef4-9691-cb975805b2ee tempest-CreateVolumesFromSnapshotTest-401145158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:56:42 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-6206bc6b-85fa-4ef4-9691-cb975805b2ee tempest-CreateVolumesFromSnapshotTest-401145158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:56:42 devstack sudo[88318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 Apr 22 17:56:42 devstack sudo[88318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:56:42 devstack sudo[88313]: pam_unix(sudo:session): session closed for user root Apr 22 17:56:42 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-d58eedc7-d07d-4d4d-a8f7-f1a2fb8042b1 tempest-VolumesCloneTest-1670162930 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7fb04710-31f8-445b-8cd6-d88e1e2d6006.a4785083-f351-4505-a730-6b80bf030dec" returned: 0 in 0.567s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:56:42 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-d58eedc7-d07d-4d4d-a8f7-f1a2fb8042b1 tempest-VolumesCloneTest-1670162930 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7fb04710-31f8-445b-8cd6-d88e1e2d6006(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81771) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 22 17:56:42 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-d58eedc7-d07d-4d4d-a8f7-f1a2fb8042b1 tempest-VolumesCloneTest-1670162930 None] will copy from snapshot at /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7fb04710-31f8-445b-8cd6-d88e1e2d6006 {{(pid=81771) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 22 17:56:42 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-d58eedc7-d07d-4d4d-a8f7-f1a2fb8042b1 tempest-VolumesCloneTest-1670162930 None] Creating direct copy from snapshot {{(pid=81771) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 22 17:56:42 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[955d0d65-5ba6-4a56-b9f7-57b15422566d]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:56:42 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-d58eedc7-d07d-4d4d-a8f7-f1a2fb8042b1 tempest-VolumesCloneTest-1670162930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7fb04710-31f8-445b-8cd6-d88e1e2d6006 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:56:42 devstack sudo[88321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7fb04710-31f8-445b-8cd6-d88e1e2d6006 Apr 22 17:56:42 devstack sudo[88321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:56:42 devstack sudo[88318]: pam_unix(sudo:session): session closed for user root Apr 22 17:56:42 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-6206bc6b-85fa-4ef4-9691-cb975805b2ee tempest-CreateVolumesFromSnapshotTest-401145158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33" returned: 0 in 0.450s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:56:42 devstack cinder-volume[81771]: DEBUG cinder.manager [None req-6206bc6b-85fa-4ef4-9691-cb975805b2ee tempest-CreateVolumesFromSnapshotTest-401145158 None] Notifying Schedulers of capabilities ... {{(pid=81771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 17:56:42 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-6206bc6b-85fa-4ef4-9691-cb975805b2ee tempest-CreateVolumesFromSnapshotTest-401145158 None] Deleted volume successfully. Apr 22 17:56:42 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-6206bc6b-85fa-4ef4-9691-cb975805b2ee tempest-CreateVolumesFromSnapshotTest-401145158 None] Lock "cinder-c505040f-0a45-4c62-9dfe-92144d289746-delete_volume" released by "delete_volume" :: held 1.902s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:56:43 devstack sudo[88321]: pam_unix(sudo:session): session closed for user root Apr 22 17:56:43 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-d58eedc7-d07d-4d4d-a8f7-f1a2fb8042b1 tempest-VolumesCloneTest-1670162930 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7fb04710-31f8-445b-8cd6-d88e1e2d6006" returned: 0 in 0.552s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:56:43 devstack cinder-volume[81771]: DEBUG cinder.utils [None req-d58eedc7-d07d-4d4d-a8f7-f1a2fb8042b1 tempest-VolumesCloneTest-1670162930 None] Path /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-87ec7399-d7af-411b-ad57-ea92f14c1916 not found in is_blk_device check {{(pid=81771) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 22 17:56:43 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-d58eedc7-d07d-4d4d-a8f7-f1a2fb8042b1 tempest-VolumesCloneTest-1670162930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7fb04710-31f8-445b-8cd6-d88e1e2d6006 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-87ec7399-d7af-411b-ad57-ea92f14c1916 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:56:43 devstack sudo[88327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7fb04710-31f8-445b-8cd6-d88e1e2d6006 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-87ec7399-d7af-411b-ad57-ea92f14c1916 Apr 22 17:56:43 devstack sudo[88327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:56:43 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-6ad0743d-1c38-4768-a8be-3503795e3ab4 tempest-CreateVolumesFromSnapshotTest-401145158 None] Acquiring lock "cinder-8a2cd82e-8478-458b-985b-1386338d35a6-delete_volume" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:56:43 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-6ad0743d-1c38-4768-a8be-3503795e3ab4 tempest-CreateVolumesFromSnapshotTest-401145158 None] Lock "cinder-8a2cd82e-8478-458b-985b-1386338d35a6-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:56:43 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-6ad0743d-1c38-4768-a8be-3503795e3ab4 tempest-CreateVolumesFromSnapshotTest-401145158 None] Acquiring lock "cinder-quobyte-8a2cd82e-8478-458b-985b-1386338d35a6" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:56:43 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-6ad0743d-1c38-4768-a8be-3503795e3ab4 tempest-CreateVolumesFromSnapshotTest-401145158 None] Lock "cinder-quobyte-8a2cd82e-8478-458b-985b-1386338d35a6" acquired by "delete_volume" :: waited 0.018s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:56:43 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ecaa187-634d-41ba-9120-5332ba9b7e52]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:56:43 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-6ad0743d-1c38-4768-a8be-3503795e3ab4 tempest-CreateVolumesFromSnapshotTest-401145158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-8a2cd82e-8478-458b-985b-1386338d35a6 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:56:43 devstack sudo[88331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-8a2cd82e-8478-458b-985b-1386338d35a6 Apr 22 17:56:43 devstack sudo[88331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:56:44 devstack sudo[88331]: pam_unix(sudo:session): session closed for user root Apr 22 17:56:44 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-6ad0743d-1c38-4768-a8be-3503795e3ab4 tempest-CreateVolumesFromSnapshotTest-401145158 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-8a2cd82e-8478-458b-985b-1386338d35a6" returned: 0 in 0.971s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:56:44 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-6ad0743d-1c38-4768-a8be-3503795e3ab4 tempest-CreateVolumesFromSnapshotTest-401145158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-8a2cd82e-8478-458b-985b-1386338d35a6 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:56:44 devstack sudo[88347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-8a2cd82e-8478-458b-985b-1386338d35a6 Apr 22 17:56:44 devstack sudo[88347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:56:45 devstack sudo[88347]: pam_unix(sudo:session): session closed for user root Apr 22 17:56:45 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-6ad0743d-1c38-4768-a8be-3503795e3ab4 tempest-CreateVolumesFromSnapshotTest-401145158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-8a2cd82e-8478-458b-985b-1386338d35a6" returned: 0 in 0.986s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:56:45 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-6ad0743d-1c38-4768-a8be-3503795e3ab4 tempest-CreateVolumesFromSnapshotTest-401145158 None] Lock "cinder-quobyte-8a2cd82e-8478-458b-985b-1386338d35a6" released by "delete_volume" :: held 2.004s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:56:45 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-6ad0743d-1c38-4768-a8be-3503795e3ab4 tempest-CreateVolumesFromSnapshotTest-401145158 None] Created reservations ['3b65c0fa-5fc9-49ef-a632-b312b009b92c', 'a3a0b783-507f-40aa-8e41-688d42f99a8a', '2e645ab0-d341-44fd-bdd7-a043774f4845', 'af22f503-2aff-4669-9a20-ca8834043634'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 17:56:45 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-6ad0743d-1c38-4768-a8be-3503795e3ab4 tempest-CreateVolumesFromSnapshotTest-401145158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:56:45 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-6ad0743d-1c38-4768-a8be-3503795e3ab4 tempest-CreateVolumesFromSnapshotTest-401145158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:56:45 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-6ad0743d-1c38-4768-a8be-3503795e3ab4 tempest-CreateVolumesFromSnapshotTest-401145158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:56:45 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-6ad0743d-1c38-4768-a8be-3503795e3ab4 tempest-CreateVolumesFromSnapshotTest-401145158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:56:45 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-6ad0743d-1c38-4768-a8be-3503795e3ab4 tempest-CreateVolumesFromSnapshotTest-401145158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:56:45 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-6ad0743d-1c38-4768-a8be-3503795e3ab4 tempest-CreateVolumesFromSnapshotTest-401145158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:56:45 devstack sudo[88351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 Apr 22 17:56:45 devstack sudo[88351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:56:45 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-92c85a75-2772-4f22-844b-62b1669e8f06 tempest-CreateVolumesFromSnapshotTest-401145158 None] Acquiring lock "cinder-65cb4d8e-f152-4681-a3fe-a642cc756837-delete_volume" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:56:45 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-92c85a75-2772-4f22-844b-62b1669e8f06 tempest-CreateVolumesFromSnapshotTest-401145158 None] Lock "cinder-65cb4d8e-f152-4681-a3fe-a642cc756837-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:56:45 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-92c85a75-2772-4f22-844b-62b1669e8f06 tempest-CreateVolumesFromSnapshotTest-401145158 None] Acquiring lock "cinder-quobyte-65cb4d8e-f152-4681-a3fe-a642cc756837" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:56:46 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-92c85a75-2772-4f22-844b-62b1669e8f06 tempest-CreateVolumesFromSnapshotTest-401145158 None] Lock "cinder-quobyte-65cb4d8e-f152-4681-a3fe-a642cc756837" acquired by "delete_volume" :: waited 0.045s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:56:46 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[576cbc6e-fd19-4fd0-9304-dd01f3c869dd]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:56:46 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-92c85a75-2772-4f22-844b-62b1669e8f06 tempest-CreateVolumesFromSnapshotTest-401145158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-65cb4d8e-f152-4681-a3fe-a642cc756837 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:56:46 devstack sudo[88353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-65cb4d8e-f152-4681-a3fe-a642cc756837 Apr 22 17:56:46 devstack sudo[88353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:56:46 devstack sudo[88351]: pam_unix(sudo:session): session closed for user root Apr 22 17:56:46 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-6ad0743d-1c38-4768-a8be-3503795e3ab4 tempest-CreateVolumesFromSnapshotTest-401145158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33" returned: 0 in 1.009s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:56:46 devstack cinder-volume[81771]: DEBUG cinder.manager [None req-6ad0743d-1c38-4768-a8be-3503795e3ab4 tempest-CreateVolumesFromSnapshotTest-401145158 None] Notifying Schedulers of capabilities ... {{(pid=81771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 17:56:46 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-6ad0743d-1c38-4768-a8be-3503795e3ab4 tempest-CreateVolumesFromSnapshotTest-401145158 None] Deleted volume successfully. Apr 22 17:56:46 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-6ad0743d-1c38-4768-a8be-3503795e3ab4 tempest-CreateVolumesFromSnapshotTest-401145158 None] Lock "cinder-8a2cd82e-8478-458b-985b-1386338d35a6-delete_volume" released by "delete_volume" :: held 3.348s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:56:47 devstack sudo[88353]: pam_unix(sudo:session): session closed for user root Apr 22 17:56:47 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-92c85a75-2772-4f22-844b-62b1669e8f06 tempest-CreateVolumesFromSnapshotTest-401145158 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-65cb4d8e-f152-4681-a3fe-a642cc756837" returned: 0 in 1.313s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:56:47 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-92c85a75-2772-4f22-844b-62b1669e8f06 tempest-CreateVolumesFromSnapshotTest-401145158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-65cb4d8e-f152-4681-a3fe-a642cc756837 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:56:47 devstack sudo[88360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-65cb4d8e-f152-4681-a3fe-a642cc756837 Apr 22 17:56:47 devstack sudo[88360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:56:48 devstack sudo[88360]: pam_unix(sudo:session): session closed for user root Apr 22 17:56:48 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-92c85a75-2772-4f22-844b-62b1669e8f06 tempest-CreateVolumesFromSnapshotTest-401145158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-65cb4d8e-f152-4681-a3fe-a642cc756837" returned: 0 in 1.126s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:56:48 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-92c85a75-2772-4f22-844b-62b1669e8f06 tempest-CreateVolumesFromSnapshotTest-401145158 None] Lock "cinder-quobyte-65cb4d8e-f152-4681-a3fe-a642cc756837" released by "delete_volume" :: held 2.572s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:56:48 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-92c85a75-2772-4f22-844b-62b1669e8f06 tempest-CreateVolumesFromSnapshotTest-401145158 None] Created reservations ['2920193b-5f07-44ae-a9f6-4b5644588559', '1f5e34cb-a078-420c-861c-3bdaf5ace935', '4a0bfef1-15fd-420f-9131-a267697ce386', '0c598a12-e2fa-4987-8719-674ecbb0f0e7'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 17:56:48 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-92c85a75-2772-4f22-844b-62b1669e8f06 tempest-CreateVolumesFromSnapshotTest-401145158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:56:48 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-92c85a75-2772-4f22-844b-62b1669e8f06 tempest-CreateVolumesFromSnapshotTest-401145158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:56:48 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-92c85a75-2772-4f22-844b-62b1669e8f06 tempest-CreateVolumesFromSnapshotTest-401145158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:56:48 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-92c85a75-2772-4f22-844b-62b1669e8f06 tempest-CreateVolumesFromSnapshotTest-401145158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:56:48 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-92c85a75-2772-4f22-844b-62b1669e8f06 tempest-CreateVolumesFromSnapshotTest-401145158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:56:48 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-92c85a75-2772-4f22-844b-62b1669e8f06 tempest-CreateVolumesFromSnapshotTest-401145158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:56:48 devstack sudo[88363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 Apr 22 17:56:48 devstack sudo[88363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:56:48 devstack sudo[88327]: pam_unix(sudo:session): session closed for user root Apr 22 17:56:48 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-d58eedc7-d07d-4d4d-a8f7-f1a2fb8042b1 tempest-VolumesCloneTest-1670162930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7fb04710-31f8-445b-8cd6-d88e1e2d6006 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-87ec7399-d7af-411b-ad57-ea92f14c1916" returned: 0 in 5.604s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:56:48 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ffa940c-e28d-4f66-a045-d41b0d5144ec]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:56:48 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-d58eedc7-d07d-4d4d-a8f7-f1a2fb8042b1 tempest-VolumesCloneTest-1670162930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7fb04710-31f8-445b-8cd6-d88e1e2d6006 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:56:48 devstack sudo[88365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7fb04710-31f8-445b-8cd6-d88e1e2d6006 Apr 22 17:56:48 devstack sudo[88365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:56:49 devstack sudo[88363]: pam_unix(sudo:session): session closed for user root Apr 22 17:56:49 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-92c85a75-2772-4f22-844b-62b1669e8f06 tempest-CreateVolumesFromSnapshotTest-401145158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33" returned: 0 in 0.460s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:56:49 devstack cinder-volume[81771]: DEBUG cinder.manager [None req-92c85a75-2772-4f22-844b-62b1669e8f06 tempest-CreateVolumesFromSnapshotTest-401145158 None] Notifying Schedulers of capabilities ... {{(pid=81771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 17:56:49 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-92c85a75-2772-4f22-844b-62b1669e8f06 tempest-CreateVolumesFromSnapshotTest-401145158 None] Deleted volume successfully. Apr 22 17:56:49 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-92c85a75-2772-4f22-844b-62b1669e8f06 tempest-CreateVolumesFromSnapshotTest-401145158 None] Lock "cinder-65cb4d8e-f152-4681-a3fe-a642cc756837-delete_volume" released by "delete_volume" :: held 3.337s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:56:49 devstack sudo[88365]: pam_unix(sudo:session): session closed for user root Apr 22 17:56:49 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-d58eedc7-d07d-4d4d-a8f7-f1a2fb8042b1 tempest-VolumesCloneTest-1670162930 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7fb04710-31f8-445b-8cd6-d88e1e2d6006" returned: 0 in 0.647s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:56:49 devstack cinder-volume[81771]: DEBUG cinder.image.image_utils [None req-d58eedc7-d07d-4d4d-a8f7-f1a2fb8042b1 tempest-VolumesCloneTest-1670162930 None] Image conversion details: src /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7fb04710-31f8-445b-8cd6-d88e1e2d6006, size 1024.00 MB, duration 5.61 sec, destination /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-87ec7399-d7af-411b-ad57-ea92f14c1916 {{(pid=81771) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 22 17:56:49 devstack cinder-volume[81771]: INFO cinder.image.image_utils [None req-d58eedc7-d07d-4d4d-a8f7-f1a2fb8042b1 tempest-VolumesCloneTest-1670162930 None] Converted 1024.00 MB image at 182.69 MB/s Apr 22 17:56:49 devstack cinder-volume[81771]: WARNING cinder.volume.drivers.remotefs [None req-d58eedc7-d07d-4d4d-a8f7-f1a2fb8042b1 tempest-VolumesCloneTest-1670162930 None] /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-87ec7399-d7af-411b-ad57-ea92f14c1916 is being set with open permissions: ugo+rw Apr 22 17:56:49 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-d58eedc7-d07d-4d4d-a8f7-f1a2fb8042b1 tempest-VolumesCloneTest-1670162930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-87ec7399-d7af-411b-ad57-ea92f14c1916 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:56:49 devstack sudo[88371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-87ec7399-d7af-411b-ad57-ea92f14c1916 Apr 22 17:56:49 devstack sudo[88371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:56:49 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-92e902c7-5c0e-4e0a-9aee-c2bec036220e tempest-CreateVolumesFromSnapshotTest-401145158 None] Acquiring lock "cinder-67a23ab0-e603-4ee2-83be-5fcc299cb2fa-delete_volume" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:56:49 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-92e902c7-5c0e-4e0a-9aee-c2bec036220e tempest-CreateVolumesFromSnapshotTest-401145158 None] Lock "cinder-67a23ab0-e603-4ee2-83be-5fcc299cb2fa-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:56:49 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-92e902c7-5c0e-4e0a-9aee-c2bec036220e tempest-CreateVolumesFromSnapshotTest-401145158 None] Acquiring lock "cinder-quobyte-67a23ab0-e603-4ee2-83be-5fcc299cb2fa" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:56:49 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-92e902c7-5c0e-4e0a-9aee-c2bec036220e tempest-CreateVolumesFromSnapshotTest-401145158 None] Lock "cinder-quobyte-67a23ab0-e603-4ee2-83be-5fcc299cb2fa" acquired by "delete_volume" :: waited 0.016s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:56:49 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[1af04fd1-0f69-4cf6-b0ca-a733d5603221]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:56:49 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-92e902c7-5c0e-4e0a-9aee-c2bec036220e tempest-CreateVolumesFromSnapshotTest-401145158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-67a23ab0-e603-4ee2-83be-5fcc299cb2fa {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:56:49 devstack sudo[88373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-67a23ab0-e603-4ee2-83be-5fcc299cb2fa Apr 22 17:56:49 devstack sudo[88373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:56:49 devstack sudo[88371]: pam_unix(sudo:session): session closed for user root Apr 22 17:56:49 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-d58eedc7-d07d-4d4d-a8f7-f1a2fb8042b1 tempest-VolumesCloneTest-1670162930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-87ec7399-d7af-411b-ad57-ea92f14c1916" returned: 0 in 0.473s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:56:49 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-d58eedc7-d07d-4d4d-a8f7-f1a2fb8042b1 tempest-VolumesCloneTest-1670162930 None] Lock "cinder-quobyte-87ec7399-d7af-411b-ad57-ea92f14c1916" released by "_copy_volume_from_snapshot" :: held 7.922s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:56:49 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-d58eedc7-d07d-4d4d-a8f7-f1a2fb8042b1 tempest-VolumesCloneTest-1670162930 None] Acquiring lock "cinder-quobyte-a4785083-f351-4505-a730-6b80bf030dec" by "_delete_snapshot" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:56:49 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-d58eedc7-d07d-4d4d-a8f7-f1a2fb8042b1 tempest-VolumesCloneTest-1670162930 None] Lock "cinder-quobyte-a4785083-f351-4505-a730-6b80bf030dec" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:56:49 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-d58eedc7-d07d-4d4d-a8f7-f1a2fb8042b1 tempest-VolumesCloneTest-1670162930 None] Deleting offline snapshot a4785083-f351-4505-a730-6b80bf030dec of volume 7fb04710-31f8-445b-8cd6-d88e1e2d6006 {{(pid=81771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 22 17:56:49 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-d58eedc7-d07d-4d4d-a8f7-f1a2fb8042b1 tempest-VolumesCloneTest-1670162930 None] snapshot_file for this snap is: volume-7fb04710-31f8-445b-8cd6-d88e1e2d6006.a4785083-f351-4505-a730-6b80bf030dec {{(pid=81771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 22 17:56:50 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[83a2f992-7bc4-4fdc-a014-05c5c29e4978]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:56:50 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-d58eedc7-d07d-4d4d-a8f7-f1a2fb8042b1 tempest-VolumesCloneTest-1670162930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7fb04710-31f8-445b-8cd6-d88e1e2d6006.a4785083-f351-4505-a730-6b80bf030dec {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:56:50 devstack sudo[88376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7fb04710-31f8-445b-8cd6-d88e1e2d6006.a4785083-f351-4505-a730-6b80bf030dec Apr 22 17:56:50 devstack sudo[88376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:56:50 devstack sudo[88373]: pam_unix(sudo:session): session closed for user root Apr 22 17:56:50 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-92e902c7-5c0e-4e0a-9aee-c2bec036220e tempest-CreateVolumesFromSnapshotTest-401145158 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-67a23ab0-e603-4ee2-83be-5fcc299cb2fa" returned: 0 in 0.595s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:56:50 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-92e902c7-5c0e-4e0a-9aee-c2bec036220e tempest-CreateVolumesFromSnapshotTest-401145158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-67a23ab0-e603-4ee2-83be-5fcc299cb2fa {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:56:50 devstack sudo[88381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-67a23ab0-e603-4ee2-83be-5fcc299cb2fa Apr 22 17:56:50 devstack sudo[88381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:56:50 devstack sudo[88376]: pam_unix(sudo:session): session closed for user root Apr 22 17:56:50 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-d58eedc7-d07d-4d4d-a8f7-f1a2fb8042b1 tempest-VolumesCloneTest-1670162930 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7fb04710-31f8-445b-8cd6-d88e1e2d6006.a4785083-f351-4505-a730-6b80bf030dec" returned: 0 in 0.529s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:56:50 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-d58eedc7-d07d-4d4d-a8f7-f1a2fb8042b1 tempest-VolumesCloneTest-1670162930 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7fb04710-31f8-445b-8cd6-d88e1e2d6006(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81771) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 22 17:56:50 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[1557e60e-6007-4e2d-b3fb-f444da4d32bf]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:56:50 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-d58eedc7-d07d-4d4d-a8f7-f1a2fb8042b1 tempest-VolumesCloneTest-1670162930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7fb04710-31f8-445b-8cd6-d88e1e2d6006 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:56:50 devstack sudo[88386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7fb04710-31f8-445b-8cd6-d88e1e2d6006 Apr 22 17:56:50 devstack sudo[88386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:56:50 devstack sudo[88381]: pam_unix(sudo:session): session closed for user root Apr 22 17:56:50 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-92e902c7-5c0e-4e0a-9aee-c2bec036220e tempest-CreateVolumesFromSnapshotTest-401145158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-67a23ab0-e603-4ee2-83be-5fcc299cb2fa" returned: 0 in 0.500s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:56:50 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-92e902c7-5c0e-4e0a-9aee-c2bec036220e tempest-CreateVolumesFromSnapshotTest-401145158 None] Lock "cinder-quobyte-67a23ab0-e603-4ee2-83be-5fcc299cb2fa" released by "delete_volume" :: held 1.134s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:56:50 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-92e902c7-5c0e-4e0a-9aee-c2bec036220e tempest-CreateVolumesFromSnapshotTest-401145158 None] Created reservations ['d933c9b7-a9c8-4467-94e1-87da6c8d87b0', '7580f49a-b4f8-4c73-a2ca-3d5188492eaa', '76dc060d-1b14-4f87-9f92-e734b2a342f0', 'd6c8357d-f202-40f0-8316-8e11c438bf0d'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 17:56:50 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-92e902c7-5c0e-4e0a-9aee-c2bec036220e tempest-CreateVolumesFromSnapshotTest-401145158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:56:50 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-92e902c7-5c0e-4e0a-9aee-c2bec036220e tempest-CreateVolumesFromSnapshotTest-401145158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:56:50 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-92e902c7-5c0e-4e0a-9aee-c2bec036220e tempest-CreateVolumesFromSnapshotTest-401145158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:56:50 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-92e902c7-5c0e-4e0a-9aee-c2bec036220e tempest-CreateVolumesFromSnapshotTest-401145158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:56:50 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-92e902c7-5c0e-4e0a-9aee-c2bec036220e tempest-CreateVolumesFromSnapshotTest-401145158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:56:50 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-92e902c7-5c0e-4e0a-9aee-c2bec036220e tempest-CreateVolumesFromSnapshotTest-401145158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:56:50 devstack sudo[88389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 Apr 22 17:56:50 devstack sudo[88389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:56:51 devstack sudo[88386]: pam_unix(sudo:session): session closed for user root Apr 22 17:56:51 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-d58eedc7-d07d-4d4d-a8f7-f1a2fb8042b1 tempest-VolumesCloneTest-1670162930 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7fb04710-31f8-445b-8cd6-d88e1e2d6006" returned: 0 in 0.539s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:56:51 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-d58eedc7-d07d-4d4d-a8f7-f1a2fb8042b1 tempest-VolumesCloneTest-1670162930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7fb04710-31f8-445b-8cd6-d88e1e2d6006.a4785083-f351-4505-a730-6b80bf030dec {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:56:51 devstack sudo[88394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7fb04710-31f8-445b-8cd6-d88e1e2d6006.a4785083-f351-4505-a730-6b80bf030dec Apr 22 17:56:51 devstack sudo[88394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:56:51 devstack sudo[88389]: pam_unix(sudo:session): session closed for user root Apr 22 17:56:51 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-92e902c7-5c0e-4e0a-9aee-c2bec036220e tempest-CreateVolumesFromSnapshotTest-401145158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33" returned: 0 in 0.476s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:56:51 devstack cinder-volume[81771]: DEBUG cinder.manager [None req-92e902c7-5c0e-4e0a-9aee-c2bec036220e tempest-CreateVolumesFromSnapshotTest-401145158 None] Notifying Schedulers of capabilities ... {{(pid=81771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 17:56:51 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-92e902c7-5c0e-4e0a-9aee-c2bec036220e tempest-CreateVolumesFromSnapshotTest-401145158 None] Deleted volume successfully. Apr 22 17:56:51 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-92e902c7-5c0e-4e0a-9aee-c2bec036220e tempest-CreateVolumesFromSnapshotTest-401145158 None] Lock "cinder-67a23ab0-e603-4ee2-83be-5fcc299cb2fa-delete_volume" released by "delete_volume" :: held 1.799s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:56:51 devstack sudo[88394]: pam_unix(sudo:session): session closed for user root Apr 22 17:56:51 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-d58eedc7-d07d-4d4d-a8f7-f1a2fb8042b1 tempest-VolumesCloneTest-1670162930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7fb04710-31f8-445b-8cd6-d88e1e2d6006.a4785083-f351-4505-a730-6b80bf030dec" returned: 0 in 0.589s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:56:51 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-d58eedc7-d07d-4d4d-a8f7-f1a2fb8042b1 tempest-VolumesCloneTest-1670162930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7fb04710-31f8-445b-8cd6-d88e1e2d6006.a4785083-f351-4505-a730-6b80bf030dec {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:56:51 devstack sudo[88400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7fb04710-31f8-445b-8cd6-d88e1e2d6006.a4785083-f351-4505-a730-6b80bf030dec Apr 22 17:56:51 devstack sudo[88400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:56:51 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-5424f5a9-fdbf-4164-8d16-80a0466142fc tempest-CreateVolumesFromSnapshotTest-401145158 None] Acquiring lock "cinder-bafe583a-6dc5-4f86-8565-c516ccc50cee-delete_snapshot" by "delete_snapshot" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:56:51 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-5424f5a9-fdbf-4164-8d16-80a0466142fc tempest-CreateVolumesFromSnapshotTest-401145158 None] Lock "cinder-bafe583a-6dc5-4f86-8565-c516ccc50cee-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:56:51 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-5424f5a9-fdbf-4164-8d16-80a0466142fc tempest-CreateVolumesFromSnapshotTest-401145158 None] Acquiring lock "cinder-quobyte-99b5cd7d-5139-4613-8517-312f9075d3e2" by "delete_snapshot" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:56:51 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-5424f5a9-fdbf-4164-8d16-80a0466142fc tempest-CreateVolumesFromSnapshotTest-401145158 None] Lock "cinder-quobyte-99b5cd7d-5139-4613-8517-312f9075d3e2" acquired by "delete_snapshot" :: waited 0.017s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:56:51 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-5424f5a9-fdbf-4164-8d16-80a0466142fc tempest-CreateVolumesFromSnapshotTest-401145158 None] Acquiring lock "cinder-quobyte-bafe583a-6dc5-4f86-8565-c516ccc50cee" by "_delete_snapshot" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:56:51 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-5424f5a9-fdbf-4164-8d16-80a0466142fc tempest-CreateVolumesFromSnapshotTest-401145158 None] Lock "cinder-quobyte-bafe583a-6dc5-4f86-8565-c516ccc50cee" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:56:51 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-5424f5a9-fdbf-4164-8d16-80a0466142fc tempest-CreateVolumesFromSnapshotTest-401145158 None] Deleting offline snapshot bafe583a-6dc5-4f86-8565-c516ccc50cee of volume 99b5cd7d-5139-4613-8517-312f9075d3e2 {{(pid=81771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 22 17:56:51 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-5424f5a9-fdbf-4164-8d16-80a0466142fc tempest-CreateVolumesFromSnapshotTest-401145158 None] snapshot_file for this snap is: volume-99b5cd7d-5139-4613-8517-312f9075d3e2.bafe583a-6dc5-4f86-8565-c516ccc50cee {{(pid=81771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 22 17:56:51 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa419baa-f998-4407-b9f9-74d52ac9dda9]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:56:51 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-5424f5a9-fdbf-4164-8d16-80a0466142fc tempest-CreateVolumesFromSnapshotTest-401145158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-99b5cd7d-5139-4613-8517-312f9075d3e2.bafe583a-6dc5-4f86-8565-c516ccc50cee {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:56:52 devstack sudo[88402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-99b5cd7d-5139-4613-8517-312f9075d3e2.bafe583a-6dc5-4f86-8565-c516ccc50cee Apr 22 17:56:52 devstack sudo[88402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:56:52 devstack sudo[88400]: pam_unix(sudo:session): session closed for user root Apr 22 17:56:52 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-d58eedc7-d07d-4d4d-a8f7-f1a2fb8042b1 tempest-VolumesCloneTest-1670162930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7fb04710-31f8-445b-8cd6-d88e1e2d6006.a4785083-f351-4505-a730-6b80bf030dec" returned: 0 in 0.506s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:56:52 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-d58eedc7-d07d-4d4d-a8f7-f1a2fb8042b1 tempest-VolumesCloneTest-1670162930 None] Lock "cinder-quobyte-a4785083-f351-4505-a730-6b80bf030dec" released by "_delete_snapshot" :: held 2.266s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:56:52 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-d58eedc7-d07d-4d4d-a8f7-f1a2fb8042b1 tempest-VolumesCloneTest-1670162930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.307s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:56:52 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-dcb376fd-85b8-453f-98a8-1eed816d341b tempest-VolumeQuotasNegativeTestJSON-2080922197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.873s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:56:52 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-dcb376fd-85b8-453f-98a8-1eed816d341b tempest-VolumeQuotasNegativeTestJSON-2080922197 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:56:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-2112565148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2b49dc9-6218-41a2-9a3e-583db24a20a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3af9cd1625974e09b1dd8a0314cf016a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:56:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:56:41Z,use_quota=True,user_id='a0db120928844e37b0effa1ef185ed22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)}" {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 17:56:52 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-dcb376fd-85b8-453f-98a8-1eed816d341b tempest-VolumeQuotasNegativeTestJSON-2080922197 None] Creating volume d2b49dc9-6218-41a2-9a3e-583db24a20a7 {{(pid=81771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 17:56:52 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-dcb376fd-85b8-453f-98a8-1eed816d341b tempest-VolumeQuotasNegativeTestJSON-2080922197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:56:52 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-dcb376fd-85b8-453f-98a8-1eed816d341b tempest-VolumeQuotasNegativeTestJSON-2080922197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:56:52 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-dcb376fd-85b8-453f-98a8-1eed816d341b tempest-VolumeQuotasNegativeTestJSON-2080922197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:56:52 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-dcb376fd-85b8-453f-98a8-1eed816d341b tempest-VolumeQuotasNegativeTestJSON-2080922197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:56:52 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-dcb376fd-85b8-453f-98a8-1eed816d341b tempest-VolumeQuotasNegativeTestJSON-2080922197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:56:52 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-dcb376fd-85b8-453f-98a8-1eed816d341b tempest-VolumeQuotasNegativeTestJSON-2080922197 None] Selected osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 as target Quobyte volume. {{(pid=81771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 17:56:52 devstack cinder-volume[81771]: INFO cinder.volume.drivers.remotefs [None req-dcb376fd-85b8-453f-98a8-1eed816d341b tempest-VolumeQuotasNegativeTestJSON-2080922197 None] casted to osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 Apr 22 17:56:52 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-dcb376fd-85b8-453f-98a8-1eed816d341b tempest-VolumeQuotasNegativeTestJSON-2080922197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-d2b49dc9-6218-41a2-9a3e-583db24a20a7 1073741824 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:56:52 devstack sudo[88405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-d2b49dc9-6218-41a2-9a3e-583db24a20a7 1073741824 Apr 22 17:56:52 devstack sudo[88405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:56:52 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-d58eedc7-d07d-4d4d-a8f7-f1a2fb8042b1 tempest-VolumesCloneTest-1670162930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30c018ca-dcdc-4387-9757-72760c926fd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87ec7399-d7af-411b-ad57-ea92f14c1916', 'volume_size': 2, 'source_volid': '7fb04710-31f8-445b-8cd6-d88e1e2d6006', 'source_volstatus': 'available'}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:56:52 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-d58eedc7-d07d-4d4d-a8f7-f1a2fb8042b1 tempest-VolumesCloneTest-1670162930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5692fe2-500b-48c0-bc81-5e2debf3afb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:56:52 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-d58eedc7-d07d-4d4d-a8f7-f1a2fb8042b1 tempest-VolumesCloneTest-1670162930 None] Volume volume-87ec7399-d7af-411b-ad57-ea92f14c1916 (87ec7399-d7af-411b-ad57-ea92f14c1916): created successfully Apr 22 17:56:52 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-d58eedc7-d07d-4d4d-a8f7-f1a2fb8042b1 tempest-VolumesCloneTest-1670162930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5692fe2-500b-48c0-bc81-5e2debf3afb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:56:52 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-d58eedc7-d07d-4d4d-a8f7-f1a2fb8042b1 tempest-VolumesCloneTest-1670162930 None] Flow 'volume_create_manager' (8e971ec8-f141-4aa6-9f83-7ea459429eea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:56:52 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-d58eedc7-d07d-4d4d-a8f7-f1a2fb8042b1 tempest-VolumesCloneTest-1670162930 None] Created volume successfully. Apr 22 17:56:52 devstack sudo[88402]: pam_unix(sudo:session): session closed for user root Apr 22 17:56:52 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-5424f5a9-fdbf-4164-8d16-80a0466142fc tempest-CreateVolumesFromSnapshotTest-401145158 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-99b5cd7d-5139-4613-8517-312f9075d3e2.bafe583a-6dc5-4f86-8565-c516ccc50cee" returned: 0 in 0.579s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:56:52 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-5424f5a9-fdbf-4164-8d16-80a0466142fc tempest-CreateVolumesFromSnapshotTest-401145158 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-99b5cd7d-5139-4613-8517-312f9075d3e2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81771) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 22 17:56:52 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[49b01125-dff3-41a0-95ae-fdfbb2de2cf6]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:56:52 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-5424f5a9-fdbf-4164-8d16-80a0466142fc tempest-CreateVolumesFromSnapshotTest-401145158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-99b5cd7d-5139-4613-8517-312f9075d3e2 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:56:52 devstack sudo[88410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-99b5cd7d-5139-4613-8517-312f9075d3e2 Apr 22 17:56:52 devstack sudo[88410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:56:52 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-8e14a735-8094-4774-91bc-6dcc94b06ca8 tempest-VolumesCloneTest-1670162930 None] Acquiring lock "cinder-87ec7399-d7af-411b-ad57-ea92f14c1916-delete_volume" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:56:52 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-8e14a735-8094-4774-91bc-6dcc94b06ca8 tempest-VolumesCloneTest-1670162930 None] Lock "cinder-87ec7399-d7af-411b-ad57-ea92f14c1916-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:56:52 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-8e14a735-8094-4774-91bc-6dcc94b06ca8 tempest-VolumesCloneTest-1670162930 None] Acquiring lock "cinder-quobyte-87ec7399-d7af-411b-ad57-ea92f14c1916" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:56:52 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-8e14a735-8094-4774-91bc-6dcc94b06ca8 tempest-VolumesCloneTest-1670162930 None] Lock "cinder-quobyte-87ec7399-d7af-411b-ad57-ea92f14c1916" acquired by "delete_volume" :: waited 0.027s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:56:52 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c5cfa48-3e20-4af9-a113-74c4c71d6f8c]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:56:52 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-8e14a735-8094-4774-91bc-6dcc94b06ca8 tempest-VolumesCloneTest-1670162930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-87ec7399-d7af-411b-ad57-ea92f14c1916 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:56:52 devstack sudo[88415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-87ec7399-d7af-411b-ad57-ea92f14c1916 Apr 22 17:56:52 devstack sudo[88415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:56:53 devstack sudo[88405]: pam_unix(sudo:session): session closed for user root Apr 22 17:56:53 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-dcb376fd-85b8-453f-98a8-1eed816d341b tempest-VolumeQuotasNegativeTestJSON-2080922197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-d2b49dc9-6218-41a2-9a3e-583db24a20a7 1073741824" returned: 0 in 0.764s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:56:53 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-dcb376fd-85b8-453f-98a8-1eed816d341b tempest-VolumeQuotasNegativeTestJSON-2080922197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-d2b49dc9-6218-41a2-9a3e-583db24a20a7 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:56:53 devstack sudo[88417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-d2b49dc9-6218-41a2-9a3e-583db24a20a7 Apr 22 17:56:53 devstack sudo[88417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:56:53 devstack sudo[88410]: pam_unix(sudo:session): session closed for user root Apr 22 17:56:53 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-5424f5a9-fdbf-4164-8d16-80a0466142fc tempest-CreateVolumesFromSnapshotTest-401145158 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-99b5cd7d-5139-4613-8517-312f9075d3e2" returned: 0 in 0.639s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:56:53 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-5424f5a9-fdbf-4164-8d16-80a0466142fc tempest-CreateVolumesFromSnapshotTest-401145158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-99b5cd7d-5139-4613-8517-312f9075d3e2.bafe583a-6dc5-4f86-8565-c516ccc50cee {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:56:53 devstack sudo[88422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-99b5cd7d-5139-4613-8517-312f9075d3e2.bafe583a-6dc5-4f86-8565-c516ccc50cee Apr 22 17:56:53 devstack sudo[88422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:56:53 devstack sudo[88415]: pam_unix(sudo:session): session closed for user root Apr 22 17:56:53 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-8e14a735-8094-4774-91bc-6dcc94b06ca8 tempest-VolumesCloneTest-1670162930 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-87ec7399-d7af-411b-ad57-ea92f14c1916" returned: 0 in 0.582s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:56:53 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-8e14a735-8094-4774-91bc-6dcc94b06ca8 tempest-VolumesCloneTest-1670162930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-87ec7399-d7af-411b-ad57-ea92f14c1916 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:56:53 devstack sudo[88427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-87ec7399-d7af-411b-ad57-ea92f14c1916 Apr 22 17:56:53 devstack sudo[88427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:56:53 devstack sudo[88417]: pam_unix(sudo:session): session closed for user root Apr 22 17:56:53 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-dcb376fd-85b8-453f-98a8-1eed816d341b tempest-VolumeQuotasNegativeTestJSON-2080922197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-d2b49dc9-6218-41a2-9a3e-583db24a20a7" returned: 0 in 0.524s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:56:53 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-dcb376fd-85b8-453f-98a8-1eed816d341b tempest-VolumeQuotasNegativeTestJSON-2080922197 None] <== create_volume: return (1328ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'} {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 17:56:53 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-dcb376fd-85b8-453f-98a8-1eed816d341b tempest-VolumeQuotasNegativeTestJSON-2080922197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.331s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:56:53 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-1624aaa1-f05c-4458-9ab6-5e19f89328f5 tempest-VolumesTransfersV357Test-1195682345 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.753s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:56:53 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-1624aaa1-f05c-4458-9ab6-5e19f89328f5 tempest-VolumesTransfersV357Test-1195682345 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:56:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1261349857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bfeac25-cc96-4471-954e-b24aeadbc7b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29193b0c0990493b83f3fc1016d5ecd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:56:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:56:42Z,use_quota=True,user_id='edff406fc1c94aff80730fc2014a2d15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)}" {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 17:56:53 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-1624aaa1-f05c-4458-9ab6-5e19f89328f5 tempest-VolumesTransfersV357Test-1195682345 None] Creating volume 3bfeac25-cc96-4471-954e-b24aeadbc7b7 {{(pid=81771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 17:56:53 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-1624aaa1-f05c-4458-9ab6-5e19f89328f5 tempest-VolumesTransfersV357Test-1195682345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:56:53 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-1624aaa1-f05c-4458-9ab6-5e19f89328f5 tempest-VolumesTransfersV357Test-1195682345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:56:53 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-1624aaa1-f05c-4458-9ab6-5e19f89328f5 tempest-VolumesTransfersV357Test-1195682345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:56:53 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-1624aaa1-f05c-4458-9ab6-5e19f89328f5 tempest-VolumesTransfersV357Test-1195682345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:56:53 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-1624aaa1-f05c-4458-9ab6-5e19f89328f5 tempest-VolumesTransfersV357Test-1195682345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:56:53 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-1624aaa1-f05c-4458-9ab6-5e19f89328f5 tempest-VolumesTransfersV357Test-1195682345 None] Selected osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 as target Quobyte volume. {{(pid=81771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 17:56:53 devstack cinder-volume[81771]: INFO cinder.volume.drivers.remotefs [None req-1624aaa1-f05c-4458-9ab6-5e19f89328f5 tempest-VolumesTransfersV357Test-1195682345 None] casted to osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 Apr 22 17:56:53 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-1624aaa1-f05c-4458-9ab6-5e19f89328f5 tempest-VolumesTransfersV357Test-1195682345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-3bfeac25-cc96-4471-954e-b24aeadbc7b7 1073741824 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:56:53 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-dcb376fd-85b8-453f-98a8-1eed816d341b tempest-VolumeQuotasNegativeTestJSON-2080922197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d4f18f5-f002-4a4e-904b-ac2c30eecbde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2b49dc9-6218-41a2-9a3e-583db24a20a7', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:56:53 devstack sudo[88431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-3bfeac25-cc96-4471-954e-b24aeadbc7b7 1073741824 Apr 22 17:56:53 devstack sudo[88431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:56:53 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-dcb376fd-85b8-453f-98a8-1eed816d341b tempest-VolumeQuotasNegativeTestJSON-2080922197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12f7993c-4bf3-415e-99eb-6db6f29fe1b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:56:53 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-dcb376fd-85b8-453f-98a8-1eed816d341b tempest-VolumeQuotasNegativeTestJSON-2080922197 None] Volume volume-d2b49dc9-6218-41a2-9a3e-583db24a20a7 (d2b49dc9-6218-41a2-9a3e-583db24a20a7): created successfully Apr 22 17:56:53 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-dcb376fd-85b8-453f-98a8-1eed816d341b tempest-VolumeQuotasNegativeTestJSON-2080922197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12f7993c-4bf3-415e-99eb-6db6f29fe1b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:56:53 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-dcb376fd-85b8-453f-98a8-1eed816d341b tempest-VolumeQuotasNegativeTestJSON-2080922197 None] Flow 'volume_create_manager' (fd1f271f-b5be-4139-989c-6a25f3778dc7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:56:53 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-dcb376fd-85b8-453f-98a8-1eed816d341b tempest-VolumeQuotasNegativeTestJSON-2080922197 None] Created volume successfully. Apr 22 17:56:53 devstack sudo[88422]: pam_unix(sudo:session): session closed for user root Apr 22 17:56:53 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-5424f5a9-fdbf-4164-8d16-80a0466142fc tempest-CreateVolumesFromSnapshotTest-401145158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-99b5cd7d-5139-4613-8517-312f9075d3e2.bafe583a-6dc5-4f86-8565-c516ccc50cee" returned: 0 in 0.682s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:56:53 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-5424f5a9-fdbf-4164-8d16-80a0466142fc tempest-CreateVolumesFromSnapshotTest-401145158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-99b5cd7d-5139-4613-8517-312f9075d3e2.bafe583a-6dc5-4f86-8565-c516ccc50cee {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:56:53 devstack sudo[88436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-99b5cd7d-5139-4613-8517-312f9075d3e2.bafe583a-6dc5-4f86-8565-c516ccc50cee Apr 22 17:56:53 devstack sudo[88436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:56:54 devstack sudo[88427]: pam_unix(sudo:session): session closed for user root Apr 22 17:56:54 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-8e14a735-8094-4774-91bc-6dcc94b06ca8 tempest-VolumesCloneTest-1670162930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-87ec7399-d7af-411b-ad57-ea92f14c1916" returned: 0 in 0.602s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:56:54 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-8e14a735-8094-4774-91bc-6dcc94b06ca8 tempest-VolumesCloneTest-1670162930 None] Lock "cinder-quobyte-87ec7399-d7af-411b-ad57-ea92f14c1916" released by "delete_volume" :: held 1.232s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:56:54 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-8e14a735-8094-4774-91bc-6dcc94b06ca8 tempest-VolumesCloneTest-1670162930 None] Created reservations ['c774539e-64cd-4b7a-beb2-fce1820420b7', '3f932889-679b-4d4f-a829-583be98a4e43', '791f27ee-c4ef-4159-9e81-2cbdcea5a946', '31de426b-31b3-4912-93f5-7fcbe46fce34'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 17:56:54 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-8e14a735-8094-4774-91bc-6dcc94b06ca8 tempest-VolumesCloneTest-1670162930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:56:54 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-8e14a735-8094-4774-91bc-6dcc94b06ca8 tempest-VolumesCloneTest-1670162930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:56:54 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-8e14a735-8094-4774-91bc-6dcc94b06ca8 tempest-VolumesCloneTest-1670162930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:56:54 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-8e14a735-8094-4774-91bc-6dcc94b06ca8 tempest-VolumesCloneTest-1670162930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:56:54 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-8e14a735-8094-4774-91bc-6dcc94b06ca8 tempest-VolumesCloneTest-1670162930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:56:54 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-8e14a735-8094-4774-91bc-6dcc94b06ca8 tempest-VolumesCloneTest-1670162930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:56:54 devstack sudo[88441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 Apr 22 17:56:54 devstack sudo[88441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:56:54 devstack sudo[88431]: pam_unix(sudo:session): session closed for user root Apr 22 17:56:54 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-1624aaa1-f05c-4458-9ab6-5e19f89328f5 tempest-VolumesTransfersV357Test-1195682345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-3bfeac25-cc96-4471-954e-b24aeadbc7b7 1073741824" returned: 0 in 0.740s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:56:54 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-1624aaa1-f05c-4458-9ab6-5e19f89328f5 tempest-VolumesTransfersV357Test-1195682345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-3bfeac25-cc96-4471-954e-b24aeadbc7b7 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:56:54 devstack sudo[88444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-3bfeac25-cc96-4471-954e-b24aeadbc7b7 Apr 22 17:56:54 devstack sudo[88444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:56:54 devstack sudo[88436]: pam_unix(sudo:session): session closed for user root Apr 22 17:56:54 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-5424f5a9-fdbf-4164-8d16-80a0466142fc tempest-CreateVolumesFromSnapshotTest-401145158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-99b5cd7d-5139-4613-8517-312f9075d3e2.bafe583a-6dc5-4f86-8565-c516ccc50cee" returned: 0 in 0.548s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:56:54 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-5424f5a9-fdbf-4164-8d16-80a0466142fc tempest-CreateVolumesFromSnapshotTest-401145158 None] Lock "cinder-quobyte-bafe583a-6dc5-4f86-8565-c516ccc50cee" released by "_delete_snapshot" :: held 2.582s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:56:54 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-5424f5a9-fdbf-4164-8d16-80a0466142fc tempest-CreateVolumesFromSnapshotTest-401145158 None] Lock "cinder-quobyte-99b5cd7d-5139-4613-8517-312f9075d3e2" released by "delete_snapshot" :: held 2.614s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:56:54 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-5424f5a9-fdbf-4164-8d16-80a0466142fc tempest-CreateVolumesFromSnapshotTest-401145158 None] Created reservations ['c03e3869-17f8-41a5-94fc-ff00682fcef4', '3ebb7bc7-b196-4cf3-bf0b-ff27ea4a7e67', 'ef452fde-57a6-4ca3-96be-a73c3713e122', '2d95c633-5c23-4149-a608-bc21a5496ae0'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 17:56:54 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-5424f5a9-fdbf-4164-8d16-80a0466142fc tempest-CreateVolumesFromSnapshotTest-401145158 None] Delete snapshot completed successfully. Apr 22 17:56:54 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-5424f5a9-fdbf-4164-8d16-80a0466142fc tempest-CreateVolumesFromSnapshotTest-401145158 None] Lock "cinder-bafe583a-6dc5-4f86-8565-c516ccc50cee-delete_snapshot" released by "delete_snapshot" :: held 2.772s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:56:54 devstack sudo[88441]: pam_unix(sudo:session): session closed for user root Apr 22 17:56:54 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-8e14a735-8094-4774-91bc-6dcc94b06ca8 tempest-VolumesCloneTest-1670162930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33" returned: 0 in 0.572s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:56:54 devstack cinder-volume[81771]: DEBUG cinder.manager [None req-8e14a735-8094-4774-91bc-6dcc94b06ca8 tempest-VolumesCloneTest-1670162930 None] Notifying Schedulers of capabilities ... {{(pid=81771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 17:56:54 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-8e14a735-8094-4774-91bc-6dcc94b06ca8 tempest-VolumesCloneTest-1670162930 None] Deleted volume successfully. Apr 22 17:56:54 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-8e14a735-8094-4774-91bc-6dcc94b06ca8 tempest-VolumesCloneTest-1670162930 None] Lock "cinder-87ec7399-d7af-411b-ad57-ea92f14c1916-delete_volume" released by "delete_volume" :: held 2.087s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:56:54 devstack sudo[88444]: pam_unix(sudo:session): session closed for user root Apr 22 17:56:54 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-1624aaa1-f05c-4458-9ab6-5e19f89328f5 tempest-VolumesTransfersV357Test-1195682345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-3bfeac25-cc96-4471-954e-b24aeadbc7b7" returned: 0 in 0.582s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:56:54 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-1624aaa1-f05c-4458-9ab6-5e19f89328f5 tempest-VolumesTransfersV357Test-1195682345 None] <== create_volume: return (1364ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'} {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 17:56:54 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-1624aaa1-f05c-4458-9ab6-5e19f89328f5 tempest-VolumesTransfersV357Test-1195682345 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.367s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:56:54 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-1624aaa1-f05c-4458-9ab6-5e19f89328f5 tempest-VolumesTransfersV357Test-1195682345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c37d56bf-34a8-443a-90d9-d433bdc8ffcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3bfeac25-cc96-4471-954e-b24aeadbc7b7', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:56:54 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-1624aaa1-f05c-4458-9ab6-5e19f89328f5 tempest-VolumesTransfersV357Test-1195682345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94481af1-f031-4455-b516-42be39a63c8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:56:55 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-1624aaa1-f05c-4458-9ab6-5e19f89328f5 tempest-VolumesTransfersV357Test-1195682345 None] Volume volume-3bfeac25-cc96-4471-954e-b24aeadbc7b7 (3bfeac25-cc96-4471-954e-b24aeadbc7b7): created successfully Apr 22 17:56:55 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-1624aaa1-f05c-4458-9ab6-5e19f89328f5 tempest-VolumesTransfersV357Test-1195682345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94481af1-f031-4455-b516-42be39a63c8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:56:55 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-1624aaa1-f05c-4458-9ab6-5e19f89328f5 tempest-VolumesTransfersV357Test-1195682345 None] Flow 'volume_create_manager' (6956e56c-6397-4790-bd25-f8c85ac5ad8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:56:55 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-1624aaa1-f05c-4458-9ab6-5e19f89328f5 tempest-VolumesTransfersV357Test-1195682345 None] Created volume successfully. Apr 22 17:56:55 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-0850b13b-cc68-40fa-962d-6ca37658c169 tempest-VolumesCloneTest-1670162930 None] Acquiring lock "cinder-7fb04710-31f8-445b-8cd6-d88e1e2d6006-delete_volume" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:56:55 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-0850b13b-cc68-40fa-962d-6ca37658c169 tempest-VolumesCloneTest-1670162930 None] Lock "cinder-7fb04710-31f8-445b-8cd6-d88e1e2d6006-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:56:55 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-335b77f5-c3c0-4c22-aea1-d367831f9c7e tempest-CreateVolumesFromSnapshotTest-401145158 None] Acquiring lock "cinder-99b5cd7d-5139-4613-8517-312f9075d3e2-delete_volume" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:56:55 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-0850b13b-cc68-40fa-962d-6ca37658c169 tempest-VolumesCloneTest-1670162930 None] Acquiring lock "cinder-quobyte-7fb04710-31f8-445b-8cd6-d88e1e2d6006" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:56:55 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-335b77f5-c3c0-4c22-aea1-d367831f9c7e tempest-CreateVolumesFromSnapshotTest-401145158 None] Lock "cinder-99b5cd7d-5139-4613-8517-312f9075d3e2-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:56:55 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-0850b13b-cc68-40fa-962d-6ca37658c169 tempest-VolumesCloneTest-1670162930 None] Lock "cinder-quobyte-7fb04710-31f8-445b-8cd6-d88e1e2d6006" acquired by "delete_volume" :: waited 0.031s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:56:55 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[daede551-e7af-43f1-9b38-de4cb9d24c18]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:56:55 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-0850b13b-cc68-40fa-962d-6ca37658c169 tempest-VolumesCloneTest-1670162930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7fb04710-31f8-445b-8cd6-d88e1e2d6006 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:56:55 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-335b77f5-c3c0-4c22-aea1-d367831f9c7e tempest-CreateVolumesFromSnapshotTest-401145158 None] Acquiring lock "cinder-quobyte-99b5cd7d-5139-4613-8517-312f9075d3e2" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:56:55 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-335b77f5-c3c0-4c22-aea1-d367831f9c7e tempest-CreateVolumesFromSnapshotTest-401145158 None] Lock "cinder-quobyte-99b5cd7d-5139-4613-8517-312f9075d3e2" acquired by "delete_volume" :: waited 0.020s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:56:55 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fd5c9a6-d2d5-4cd7-97f5-7ae44614f30f]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:56:55 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-335b77f5-c3c0-4c22-aea1-d367831f9c7e tempest-CreateVolumesFromSnapshotTest-401145158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-99b5cd7d-5139-4613-8517-312f9075d3e2 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:56:55 devstack sudo[88448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7fb04710-31f8-445b-8cd6-d88e1e2d6006 Apr 22 17:56:55 devstack sudo[88448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:56:55 devstack sudo[88449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-99b5cd7d-5139-4613-8517-312f9075d3e2 Apr 22 17:56:55 devstack sudo[88449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:56:55 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-6524324c-95ac-4dcd-ae6e-ab28523256f9 tempest-VolumeQuotasNegativeTestJSON-2080922197 None] Acquiring lock "cinder-d2b49dc9-6218-41a2-9a3e-583db24a20a7-delete_volume" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:56:55 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-6524324c-95ac-4dcd-ae6e-ab28523256f9 tempest-VolumeQuotasNegativeTestJSON-2080922197 None] Lock "cinder-d2b49dc9-6218-41a2-9a3e-583db24a20a7-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:56:55 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-6524324c-95ac-4dcd-ae6e-ab28523256f9 tempest-VolumeQuotasNegativeTestJSON-2080922197 None] Acquiring lock "cinder-quobyte-d2b49dc9-6218-41a2-9a3e-583db24a20a7" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:56:55 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-6524324c-95ac-4dcd-ae6e-ab28523256f9 tempest-VolumeQuotasNegativeTestJSON-2080922197 None] Lock "cinder-quobyte-d2b49dc9-6218-41a2-9a3e-583db24a20a7" acquired by "delete_volume" :: waited 0.013s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:56:55 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[d217efa2-25fd-4277-aa3a-50f6b94a1710]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:56:55 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-6524324c-95ac-4dcd-ae6e-ab28523256f9 tempest-VolumeQuotasNegativeTestJSON-2080922197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-d2b49dc9-6218-41a2-9a3e-583db24a20a7 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:56:55 devstack sudo[88452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-d2b49dc9-6218-41a2-9a3e-583db24a20a7 Apr 22 17:56:55 devstack sudo[88452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:56:55 devstack sudo[88448]: pam_unix(sudo:session): session closed for user root Apr 22 17:56:55 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-0850b13b-cc68-40fa-962d-6ca37658c169 tempest-VolumesCloneTest-1670162930 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7fb04710-31f8-445b-8cd6-d88e1e2d6006" returned: 0 in 0.628s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:56:55 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-0850b13b-cc68-40fa-962d-6ca37658c169 tempest-VolumesCloneTest-1670162930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7fb04710-31f8-445b-8cd6-d88e1e2d6006 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:56:55 devstack sudo[88460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7fb04710-31f8-445b-8cd6-d88e1e2d6006 Apr 22 17:56:55 devstack sudo[88460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:56:55 devstack sudo[88449]: pam_unix(sudo:session): session closed for user root Apr 22 17:56:55 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-335b77f5-c3c0-4c22-aea1-d367831f9c7e tempest-CreateVolumesFromSnapshotTest-401145158 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-99b5cd7d-5139-4613-8517-312f9075d3e2" returned: 0 in 0.589s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:56:55 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-335b77f5-c3c0-4c22-aea1-d367831f9c7e tempest-CreateVolumesFromSnapshotTest-401145158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-99b5cd7d-5139-4613-8517-312f9075d3e2 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:56:55 devstack sudo[88462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-99b5cd7d-5139-4613-8517-312f9075d3e2 Apr 22 17:56:55 devstack sudo[88462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:56:56 devstack sudo[88452]: pam_unix(sudo:session): session closed for user root Apr 22 17:56:56 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-6524324c-95ac-4dcd-ae6e-ab28523256f9 tempest-VolumeQuotasNegativeTestJSON-2080922197 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-d2b49dc9-6218-41a2-9a3e-583db24a20a7" returned: 0 in 0.628s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:56:56 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-6524324c-95ac-4dcd-ae6e-ab28523256f9 tempest-VolumeQuotasNegativeTestJSON-2080922197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-d2b49dc9-6218-41a2-9a3e-583db24a20a7 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:56:56 devstack sudo[88467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-d2b49dc9-6218-41a2-9a3e-583db24a20a7 Apr 22 17:56:56 devstack sudo[88467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:56:56 devstack sudo[88460]: pam_unix(sudo:session): session closed for user root Apr 22 17:56:56 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-0850b13b-cc68-40fa-962d-6ca37658c169 tempest-VolumesCloneTest-1670162930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7fb04710-31f8-445b-8cd6-d88e1e2d6006" returned: 0 in 0.560s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:56:56 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-0850b13b-cc68-40fa-962d-6ca37658c169 tempest-VolumesCloneTest-1670162930 None] Lock "cinder-quobyte-7fb04710-31f8-445b-8cd6-d88e1e2d6006" released by "delete_volume" :: held 1.272s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:56:56 devstack sudo[88462]: pam_unix(sudo:session): session closed for user root Apr 22 17:56:56 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-335b77f5-c3c0-4c22-aea1-d367831f9c7e tempest-CreateVolumesFromSnapshotTest-401145158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-99b5cd7d-5139-4613-8517-312f9075d3e2" returned: 0 in 0.602s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:56:56 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-335b77f5-c3c0-4c22-aea1-d367831f9c7e tempest-CreateVolumesFromSnapshotTest-401145158 None] Lock "cinder-quobyte-99b5cd7d-5139-4613-8517-312f9075d3e2" released by "delete_volume" :: held 1.254s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:56:56 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-0850b13b-cc68-40fa-962d-6ca37658c169 tempest-VolumesCloneTest-1670162930 None] Created reservations ['169dc51c-602d-4d32-8968-2836ad5b4cae', 'ba545be6-c3a9-4e3e-bae0-08f2ad6f68b5', '84170471-e21b-4f6e-b357-2def32be815c', '500671c2-a2d8-4241-a29c-874a95e3f2ff'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 17:56:56 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-335b77f5-c3c0-4c22-aea1-d367831f9c7e tempest-CreateVolumesFromSnapshotTest-401145158 None] Created reservations ['1d1ebc60-e9d4-4a3a-ad26-e49133829f8c', 'd771b231-e155-42f1-bdbe-5e46bedb3949', 'c22b4177-5843-400a-9ba6-dbc0a0f246bf', 'd776c578-d948-4b65-a5f4-e81890f43d0c'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 17:56:56 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-0850b13b-cc68-40fa-962d-6ca37658c169 tempest-VolumesCloneTest-1670162930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:56:56 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-0850b13b-cc68-40fa-962d-6ca37658c169 tempest-VolumesCloneTest-1670162930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:56:56 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-0850b13b-cc68-40fa-962d-6ca37658c169 tempest-VolumesCloneTest-1670162930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:56:56 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-0850b13b-cc68-40fa-962d-6ca37658c169 tempest-VolumesCloneTest-1670162930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:56:56 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-0850b13b-cc68-40fa-962d-6ca37658c169 tempest-VolumesCloneTest-1670162930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:56:56 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-0850b13b-cc68-40fa-962d-6ca37658c169 tempest-VolumesCloneTest-1670162930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:56:56 devstack sudo[88472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 Apr 22 17:56:56 devstack sudo[88472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:56:56 devstack sudo[88467]: pam_unix(sudo:session): session closed for user root Apr 22 17:56:56 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-335b77f5-c3c0-4c22-aea1-d367831f9c7e tempest-CreateVolumesFromSnapshotTest-401145158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:56:56 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-335b77f5-c3c0-4c22-aea1-d367831f9c7e tempest-CreateVolumesFromSnapshotTest-401145158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:56:56 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-335b77f5-c3c0-4c22-aea1-d367831f9c7e tempest-CreateVolumesFromSnapshotTest-401145158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:56:56 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-335b77f5-c3c0-4c22-aea1-d367831f9c7e tempest-CreateVolumesFromSnapshotTest-401145158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:56:56 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-335b77f5-c3c0-4c22-aea1-d367831f9c7e tempest-CreateVolumesFromSnapshotTest-401145158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:56:56 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-335b77f5-c3c0-4c22-aea1-d367831f9c7e tempest-CreateVolumesFromSnapshotTest-401145158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:56:56 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-6524324c-95ac-4dcd-ae6e-ab28523256f9 tempest-VolumeQuotasNegativeTestJSON-2080922197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-d2b49dc9-6218-41a2-9a3e-583db24a20a7" returned: 0 in 0.631s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:56:56 devstack sudo[88474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 Apr 22 17:56:56 devstack sudo[88474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:56:56 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-551296ef-474f-4c76-a22f-b842c0669135 tempest-VolumesTransfersV357Test-333697360 None] Transfer volume completed successfully. Apr 22 17:56:56 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-6524324c-95ac-4dcd-ae6e-ab28523256f9 tempest-VolumeQuotasNegativeTestJSON-2080922197 None] Lock "cinder-quobyte-d2b49dc9-6218-41a2-9a3e-583db24a20a7" released by "delete_volume" :: held 1.314s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:56:56 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-6524324c-95ac-4dcd-ae6e-ab28523256f9 tempest-VolumeQuotasNegativeTestJSON-2080922197 None] Created reservations ['2afa8c16-6805-4643-8000-3722c465e4b6', '3aa34b45-e616-4b3d-8dc7-66babac2e5ea', '7ff854cc-357c-4868-a56f-223824db73ce', '8c24601c-0642-4d44-be1e-08b5db891ded'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 17:56:56 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-6524324c-95ac-4dcd-ae6e-ab28523256f9 tempest-VolumeQuotasNegativeTestJSON-2080922197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:56:56 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-6524324c-95ac-4dcd-ae6e-ab28523256f9 tempest-VolumeQuotasNegativeTestJSON-2080922197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:56:56 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-6524324c-95ac-4dcd-ae6e-ab28523256f9 tempest-VolumeQuotasNegativeTestJSON-2080922197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:56:56 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-6524324c-95ac-4dcd-ae6e-ab28523256f9 tempest-VolumeQuotasNegativeTestJSON-2080922197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:56:56 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-6524324c-95ac-4dcd-ae6e-ab28523256f9 tempest-VolumeQuotasNegativeTestJSON-2080922197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:56:56 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-6524324c-95ac-4dcd-ae6e-ab28523256f9 tempest-VolumeQuotasNegativeTestJSON-2080922197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:56:56 devstack sudo[88476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 Apr 22 17:56:56 devstack sudo[88476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:56:57 devstack sudo[88472]: pam_unix(sudo:session): session closed for user root Apr 22 17:56:57 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-0850b13b-cc68-40fa-962d-6ca37658c169 tempest-VolumesCloneTest-1670162930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33" returned: 0 in 0.493s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:56:57 devstack cinder-volume[81771]: DEBUG cinder.manager [None req-0850b13b-cc68-40fa-962d-6ca37658c169 tempest-VolumesCloneTest-1670162930 None] Notifying Schedulers of capabilities ... {{(pid=81771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 17:56:57 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-0850b13b-cc68-40fa-962d-6ca37658c169 tempest-VolumesCloneTest-1670162930 None] Deleted volume successfully. Apr 22 17:56:57 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-0850b13b-cc68-40fa-962d-6ca37658c169 tempest-VolumesCloneTest-1670162930 None] Lock "cinder-7fb04710-31f8-445b-8cd6-d88e1e2d6006-delete_volume" released by "delete_volume" :: held 2.115s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:56:57 devstack sudo[88474]: pam_unix(sudo:session): session closed for user root Apr 22 17:56:57 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-335b77f5-c3c0-4c22-aea1-d367831f9c7e tempest-CreateVolumesFromSnapshotTest-401145158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33" returned: 0 in 0.574s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:56:57 devstack cinder-volume[81771]: DEBUG cinder.manager [None req-335b77f5-c3c0-4c22-aea1-d367831f9c7e tempest-CreateVolumesFromSnapshotTest-401145158 None] Notifying Schedulers of capabilities ... {{(pid=81771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 17:56:57 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-335b77f5-c3c0-4c22-aea1-d367831f9c7e tempest-CreateVolumesFromSnapshotTest-401145158 None] Deleted volume successfully. Apr 22 17:56:57 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-335b77f5-c3c0-4c22-aea1-d367831f9c7e tempest-CreateVolumesFromSnapshotTest-401145158 None] Lock "cinder-99b5cd7d-5139-4613-8517-312f9075d3e2-delete_volume" released by "delete_volume" :: held 2.236s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:56:57 devstack sudo[88476]: pam_unix(sudo:session): session closed for user root Apr 22 17:56:57 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-6524324c-95ac-4dcd-ae6e-ab28523256f9 tempest-VolumeQuotasNegativeTestJSON-2080922197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33" returned: 0 in 0.604s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:56:57 devstack cinder-volume[81771]: DEBUG cinder.manager [None req-6524324c-95ac-4dcd-ae6e-ab28523256f9 tempest-VolumeQuotasNegativeTestJSON-2080922197 None] Notifying Schedulers of capabilities ... {{(pid=81771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 17:56:57 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-6524324c-95ac-4dcd-ae6e-ab28523256f9 tempest-VolumeQuotasNegativeTestJSON-2080922197 None] Deleted volume successfully. Apr 22 17:56:57 devstack cinder-volume[81771]: DEBUG dbcounter [-] [81771] Writing DB stats cinder:SELECT=120,cinder:UPDATE=195,cinder:DELETE=15,cinder:INSERT=44 {{(pid=81771) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 22 17:56:57 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-6524324c-95ac-4dcd-ae6e-ab28523256f9 tempest-VolumeQuotasNegativeTestJSON-2080922197 None] Lock "cinder-d2b49dc9-6218-41a2-9a3e-583db24a20a7-delete_volume" released by "delete_volume" :: held 2.150s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:56:58 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-52d1619d-d13b-406f-9a1a-28562aa2396e tempest-VolumesTransfersV357Test-1746293251 None] Acquiring lock "cinder-3bfeac25-cc96-4471-954e-b24aeadbc7b7-delete_volume" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:56:58 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-52d1619d-d13b-406f-9a1a-28562aa2396e tempest-VolumesTransfersV357Test-1746293251 None] Lock "cinder-3bfeac25-cc96-4471-954e-b24aeadbc7b7-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:56:58 devstack cinder-volume[81771]: DEBUG dbcounter [-] [81771] Writing DB stats cinder:SELECT=145,cinder:UPDATE=153,cinder:INSERT=38,cinder:DELETE=12 {{(pid=81771) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 22 17:56:58 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-52d1619d-d13b-406f-9a1a-28562aa2396e tempest-VolumesTransfersV357Test-1746293251 None] Acquiring lock "cinder-quobyte-3bfeac25-cc96-4471-954e-b24aeadbc7b7" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:56:58 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-52d1619d-d13b-406f-9a1a-28562aa2396e tempest-VolumesTransfersV357Test-1746293251 None] Lock "cinder-quobyte-3bfeac25-cc96-4471-954e-b24aeadbc7b7" acquired by "delete_volume" :: waited 0.019s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:56:58 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e3a18fa-096f-4694-9179-c4027ed18130]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:56:58 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-52d1619d-d13b-406f-9a1a-28562aa2396e tempest-VolumesTransfersV357Test-1746293251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-3bfeac25-cc96-4471-954e-b24aeadbc7b7 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:56:58 devstack sudo[88516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-3bfeac25-cc96-4471-954e-b24aeadbc7b7 Apr 22 17:56:58 devstack sudo[88516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:56:59 devstack sudo[88516]: pam_unix(sudo:session): session closed for user root Apr 22 17:56:59 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-52d1619d-d13b-406f-9a1a-28562aa2396e tempest-VolumesTransfersV357Test-1746293251 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-3bfeac25-cc96-4471-954e-b24aeadbc7b7" returned: 0 in 0.791s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:56:59 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-52d1619d-d13b-406f-9a1a-28562aa2396e tempest-VolumesTransfersV357Test-1746293251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-3bfeac25-cc96-4471-954e-b24aeadbc7b7 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:56:59 devstack sudo[88521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-3bfeac25-cc96-4471-954e-b24aeadbc7b7 Apr 22 17:56:59 devstack sudo[88521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:56:59 devstack sudo[88521]: pam_unix(sudo:session): session closed for user root Apr 22 17:56:59 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-52d1619d-d13b-406f-9a1a-28562aa2396e tempest-VolumesTransfersV357Test-1746293251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-3bfeac25-cc96-4471-954e-b24aeadbc7b7" returned: 0 in 0.730s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:56:59 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-52d1619d-d13b-406f-9a1a-28562aa2396e tempest-VolumesTransfersV357Test-1746293251 None] Lock "cinder-quobyte-3bfeac25-cc96-4471-954e-b24aeadbc7b7" released by "delete_volume" :: held 1.579s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:56:59 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-52d1619d-d13b-406f-9a1a-28562aa2396e tempest-VolumesTransfersV357Test-1746293251 None] Created reservations ['dbafbd10-9850-4779-ab17-67925ae1f5e4', '420d8716-4e4b-4a15-9110-8d1702e29771', 'e186f729-1f5c-48f0-bf3a-807ab5ae8f12', '6812be2e-f033-4b1f-8658-483a80442c16'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 17:56:59 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-52d1619d-d13b-406f-9a1a-28562aa2396e tempest-VolumesTransfersV357Test-1746293251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:56:59 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-52d1619d-d13b-406f-9a1a-28562aa2396e tempest-VolumesTransfersV357Test-1746293251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:56:59 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-52d1619d-d13b-406f-9a1a-28562aa2396e tempest-VolumesTransfersV357Test-1746293251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:56:59 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-52d1619d-d13b-406f-9a1a-28562aa2396e tempest-VolumesTransfersV357Test-1746293251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:56:59 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-52d1619d-d13b-406f-9a1a-28562aa2396e tempest-VolumesTransfersV357Test-1746293251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:56:59 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-52d1619d-d13b-406f-9a1a-28562aa2396e tempest-VolumesTransfersV357Test-1746293251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:56:59 devstack sudo[88524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 Apr 22 17:56:59 devstack sudo[88524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:57:00 devstack sudo[88524]: pam_unix(sudo:session): session closed for user root Apr 22 17:57:00 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-52d1619d-d13b-406f-9a1a-28562aa2396e tempest-VolumesTransfersV357Test-1746293251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33" returned: 0 in 0.766s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:57:00 devstack cinder-volume[81771]: DEBUG cinder.manager [None req-52d1619d-d13b-406f-9a1a-28562aa2396e tempest-VolumesTransfersV357Test-1746293251 None] Notifying Schedulers of capabilities ... {{(pid=81771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 17:57:00 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-52d1619d-d13b-406f-9a1a-28562aa2396e tempest-VolumesTransfersV357Test-1746293251 None] Deleted volume successfully. Apr 22 17:57:00 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-52d1619d-d13b-406f-9a1a-28562aa2396e tempest-VolumesTransfersV357Test-1746293251 None] Lock "cinder-3bfeac25-cc96-4471-954e-b24aeadbc7b7-delete_volume" released by "delete_volume" :: held 2.604s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:57:00 devstack cinder-volume[81771]: DEBUG cinder.volume.flows.manager.create_volume [None req-4aba2c45-e8c8-4cbd-b307-e1972845664b tempest-VolumesTransfersV357Test-1195682345 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 17:57:00 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-4aba2c45-e8c8-4cbd-b307-e1972845664b tempest-VolumesTransfersV357Test-1195682345 None] Flow 'volume_create_manager' (acd5373e-3cfb-4735-b6ba-a92c2d626dc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:57:00 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-4aba2c45-e8c8-4cbd-b307-e1972845664b tempest-VolumesTransfersV357Test-1195682345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9705b5b-a6e4-4dbf-ab52-d1831194332e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:57:01 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-4aba2c45-e8c8-4cbd-b307-e1972845664b tempest-VolumesTransfersV357Test-1195682345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9705b5b-a6e4-4dbf-ab52-d1831194332e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:57:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1383028818',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c8199af-1c71-497e-960f-6c2cedb8956d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29193b0c0990493b83f3fc1016d5ecd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:57:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:57:01Z,use_quota=True,user_id='edff406fc1c94aff80730fc2014a2d15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:57:01 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-4aba2c45-e8c8-4cbd-b307-e1972845664b tempest-VolumesTransfersV357Test-1195682345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bee5c59-ef48-43c1-9194-1f9d8c39ba9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:57:01 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-4aba2c45-e8c8-4cbd-b307-e1972845664b tempest-VolumesTransfersV357Test-1195682345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bee5c59-ef48-43c1-9194-1f9d8c39ba9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:57:01 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-4aba2c45-e8c8-4cbd-b307-e1972845664b tempest-VolumesTransfersV357Test-1195682345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe033f6a-25e2-41af-83b4-b4ce30374c64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:57:01 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-4aba2c45-e8c8-4cbd-b307-e1972845664b tempest-VolumesTransfersV357Test-1195682345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe033f6a-25e2-41af-83b4-b4ce30374c64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c8199af-1c71-497e-960f-6c2cedb8956d', 'volume_name': 'volume-6c8199af-1c71-497e-960f-6c2cedb8956d', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:57:01 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-4aba2c45-e8c8-4cbd-b307-e1972845664b tempest-VolumesTransfersV357Test-1195682345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95c478e2-d211-4c1e-97d4-465f60e62fac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:57:01 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-4aba2c45-e8c8-4cbd-b307-e1972845664b tempest-VolumesTransfersV357Test-1195682345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95c478e2-d211-4c1e-97d4-465f60e62fac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:57:01 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-4aba2c45-e8c8-4cbd-b307-e1972845664b tempest-VolumesTransfersV357Test-1195682345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (912f20d8-9354-4b94-8c58-489b502674d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:57:01 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-4aba2c45-e8c8-4cbd-b307-e1972845664b tempest-VolumesTransfersV357Test-1195682345 None] Volume 6c8199af-1c71-497e-960f-6c2cedb8956d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c8199af-1c71-497e-960f-6c2cedb8956d', 'volume_size': 1} Apr 22 17:57:01 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-4aba2c45-e8c8-4cbd-b307-e1972845664b tempest-VolumesTransfersV357Test-1195682345 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:57:01 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-4aba2c45-e8c8-4cbd-b307-e1972845664b tempest-VolumesTransfersV357Test-1195682345 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:57:01 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-4aba2c45-e8c8-4cbd-b307-e1972845664b tempest-VolumesTransfersV357Test-1195682345 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:57:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1383028818',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c8199af-1c71-497e-960f-6c2cedb8956d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29193b0c0990493b83f3fc1016d5ecd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:57:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:57:01Z,use_quota=True,user_id='edff406fc1c94aff80730fc2014a2d15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)}" {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 17:57:01 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-4aba2c45-e8c8-4cbd-b307-e1972845664b tempest-VolumesTransfersV357Test-1195682345 None] Creating volume 6c8199af-1c71-497e-960f-6c2cedb8956d {{(pid=81771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 17:57:01 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-4aba2c45-e8c8-4cbd-b307-e1972845664b tempest-VolumesTransfersV357Test-1195682345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:57:01 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-4aba2c45-e8c8-4cbd-b307-e1972845664b tempest-VolumesTransfersV357Test-1195682345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:57:01 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-4aba2c45-e8c8-4cbd-b307-e1972845664b tempest-VolumesTransfersV357Test-1195682345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:57:01 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-4aba2c45-e8c8-4cbd-b307-e1972845664b tempest-VolumesTransfersV357Test-1195682345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:57:01 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-4aba2c45-e8c8-4cbd-b307-e1972845664b tempest-VolumesTransfersV357Test-1195682345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:57:01 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-4aba2c45-e8c8-4cbd-b307-e1972845664b tempest-VolumesTransfersV357Test-1195682345 None] Selected osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 as target Quobyte volume. {{(pid=81771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 17:57:01 devstack cinder-volume[81771]: INFO cinder.volume.drivers.remotefs [None req-4aba2c45-e8c8-4cbd-b307-e1972845664b tempest-VolumesTransfersV357Test-1195682345 None] casted to osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 Apr 22 17:57:01 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-4aba2c45-e8c8-4cbd-b307-e1972845664b tempest-VolumesTransfersV357Test-1195682345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-6c8199af-1c71-497e-960f-6c2cedb8956d 1073741824 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:57:01 devstack sudo[88528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-6c8199af-1c71-497e-960f-6c2cedb8956d 1073741824 Apr 22 17:57:01 devstack sudo[88528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:57:01 devstack cinder-volume[81771]: DEBUG cinder.volume.flows.manager.create_volume [None req-feec3bfb-8f1e-417a-af29-77b9d24fb07f tempest-VolumesListTestJSON-1236832366 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 17:57:01 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-feec3bfb-8f1e-417a-af29-77b9d24fb07f tempest-VolumesListTestJSON-1236832366 None] Flow 'volume_create_manager' (ff3cb417-9962-40ff-ae8f-33d08ff275b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:57:01 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-feec3bfb-8f1e-417a-af29-77b9d24fb07f tempest-VolumesListTestJSON-1236832366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9511f787-359b-40f0-b37f-251ca4c6fb1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:57:01 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-feec3bfb-8f1e-417a-af29-77b9d24fb07f tempest-VolumesListTestJSON-1236832366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9511f787-359b-40f0-b37f-251ca4c6fb1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:57:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1869521580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd7fc188-8cdc-45d0-ae69-e3532734841a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0977cd5a6bb84876a9178299209f6aeb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:57:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:57:02Z,use_quota=True,user_id='6a5ff43f4d0e42ae8f662ed64b8b2757',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:57:01 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-feec3bfb-8f1e-417a-af29-77b9d24fb07f tempest-VolumesListTestJSON-1236832366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1396951-ed4c-4c65-b7aa-50c10208d0f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:57:01 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-feec3bfb-8f1e-417a-af29-77b9d24fb07f tempest-VolumesListTestJSON-1236832366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1396951-ed4c-4c65-b7aa-50c10208d0f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:57:01 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-feec3bfb-8f1e-417a-af29-77b9d24fb07f tempest-VolumesListTestJSON-1236832366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c60d4c8-8845-4b98-9f7d-b5c31e9d3d08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:57:01 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-feec3bfb-8f1e-417a-af29-77b9d24fb07f tempest-VolumesListTestJSON-1236832366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c60d4c8-8845-4b98-9f7d-b5c31e9d3d08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd7fc188-8cdc-45d0-ae69-e3532734841a', 'volume_name': 'volume-bd7fc188-8cdc-45d0-ae69-e3532734841a', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:57:01 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-feec3bfb-8f1e-417a-af29-77b9d24fb07f tempest-VolumesListTestJSON-1236832366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ccb4459-d501-43c1-82e9-8c1832a418ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:57:01 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-feec3bfb-8f1e-417a-af29-77b9d24fb07f tempest-VolumesListTestJSON-1236832366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ccb4459-d501-43c1-82e9-8c1832a418ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:57:01 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-feec3bfb-8f1e-417a-af29-77b9d24fb07f tempest-VolumesListTestJSON-1236832366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3b1b8c9-2dc6-4de3-9980-1065be42c83c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:57:01 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-feec3bfb-8f1e-417a-af29-77b9d24fb07f tempest-VolumesListTestJSON-1236832366 None] Volume bd7fc188-8cdc-45d0-ae69-e3532734841a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd7fc188-8cdc-45d0-ae69-e3532734841a', 'volume_size': 1} Apr 22 17:57:01 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-feec3bfb-8f1e-417a-af29-77b9d24fb07f tempest-VolumesListTestJSON-1236832366 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:57:01 devstack sudo[88528]: pam_unix(sudo:session): session closed for user root Apr 22 17:57:01 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-4aba2c45-e8c8-4cbd-b307-e1972845664b tempest-VolumesTransfersV357Test-1195682345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-6c8199af-1c71-497e-960f-6c2cedb8956d 1073741824" returned: 0 in 0.847s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:57:01 devstack cinder-volume[81771]: DEBUG cinder.volume.flows.manager.create_volume [None req-3807512f-1882-4878-8ac8-5f40179735c1 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 17:57:01 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-3807512f-1882-4878-8ac8-5f40179735c1 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Flow 'volume_create_manager' (c59fe0bf-b41d-467c-87a7-caf224bead90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:57:01 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-3807512f-1882-4878-8ac8-5f40179735c1 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ab40966-3993-4732-9f64-78518432a105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:57:01 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-4aba2c45-e8c8-4cbd-b307-e1972845664b tempest-VolumesTransfersV357Test-1195682345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-6c8199af-1c71-497e-960f-6c2cedb8956d {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:57:02 devstack sudo[88533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-6c8199af-1c71-497e-960f-6c2cedb8956d Apr 22 17:57:02 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-3807512f-1882-4878-8ac8-5f40179735c1 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ab40966-3993-4732-9f64-78518432a105) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:57:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-185864388',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84922fe2-85bc-4cef-8917-dfbb0a9fcaec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cd098d792c4470498776cef33db9dbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:57:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:57:02Z,use_quota=True,user_id='e22bc8c7302248f1b33671862501bf0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:57:02 devstack sudo[88533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:57:02 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-3807512f-1882-4878-8ac8-5f40179735c1 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90c2c75f-8efb-41ab-b551-2610af6f8b5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:57:02 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-3807512f-1882-4878-8ac8-5f40179735c1 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90c2c75f-8efb-41ab-b551-2610af6f8b5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:57:02 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-3807512f-1882-4878-8ac8-5f40179735c1 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba72c8e5-d526-41a7-bd85-9bc539bca146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:57:02 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-3807512f-1882-4878-8ac8-5f40179735c1 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba72c8e5-d526-41a7-bd85-9bc539bca146) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84922fe2-85bc-4cef-8917-dfbb0a9fcaec', 'volume_name': 'volume-84922fe2-85bc-4cef-8917-dfbb0a9fcaec', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:57:02 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-3807512f-1882-4878-8ac8-5f40179735c1 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (158e218a-da92-4918-a19c-5aeda3e4e740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:57:02 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-3807512f-1882-4878-8ac8-5f40179735c1 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (158e218a-da92-4918-a19c-5aeda3e4e740) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:57:02 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-3807512f-1882-4878-8ac8-5f40179735c1 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8ef7b85-62c0-4328-bc8a-7cbc4ce9a90a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:57:02 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-3807512f-1882-4878-8ac8-5f40179735c1 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Volume 84922fe2-85bc-4cef-8917-dfbb0a9fcaec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84922fe2-85bc-4cef-8917-dfbb0a9fcaec', 'volume_size': 1} Apr 22 17:57:02 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-3807512f-1882-4878-8ac8-5f40179735c1 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:57:02 devstack sudo[88533]: pam_unix(sudo:session): session closed for user root Apr 22 17:57:02 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-4aba2c45-e8c8-4cbd-b307-e1972845664b tempest-VolumesTransfersV357Test-1195682345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-6c8199af-1c71-497e-960f-6c2cedb8956d" returned: 0 in 0.482s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:57:02 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-4aba2c45-e8c8-4cbd-b307-e1972845664b tempest-VolumesTransfersV357Test-1195682345 None] <== create_volume: return (1429ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'} {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 17:57:02 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-4aba2c45-e8c8-4cbd-b307-e1972845664b tempest-VolumesTransfersV357Test-1195682345 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.434s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:57:02 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-feec3bfb-8f1e-417a-af29-77b9d24fb07f tempest-VolumesListTestJSON-1236832366 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.727s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:57:02 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-feec3bfb-8f1e-417a-af29-77b9d24fb07f tempest-VolumesListTestJSON-1236832366 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:57:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1869521580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd7fc188-8cdc-45d0-ae69-e3532734841a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0977cd5a6bb84876a9178299209f6aeb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:57:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:57:02Z,use_quota=True,user_id='6a5ff43f4d0e42ae8f662ed64b8b2757',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)}" {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 17:57:02 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-feec3bfb-8f1e-417a-af29-77b9d24fb07f tempest-VolumesListTestJSON-1236832366 None] Creating volume bd7fc188-8cdc-45d0-ae69-e3532734841a {{(pid=81771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 17:57:02 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-feec3bfb-8f1e-417a-af29-77b9d24fb07f tempest-VolumesListTestJSON-1236832366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:57:02 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-feec3bfb-8f1e-417a-af29-77b9d24fb07f tempest-VolumesListTestJSON-1236832366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:57:02 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-feec3bfb-8f1e-417a-af29-77b9d24fb07f tempest-VolumesListTestJSON-1236832366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:57:02 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-feec3bfb-8f1e-417a-af29-77b9d24fb07f tempest-VolumesListTestJSON-1236832366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:57:02 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-feec3bfb-8f1e-417a-af29-77b9d24fb07f tempest-VolumesListTestJSON-1236832366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:57:02 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-feec3bfb-8f1e-417a-af29-77b9d24fb07f tempest-VolumesListTestJSON-1236832366 None] Selected osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 as target Quobyte volume. {{(pid=81771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 17:57:02 devstack cinder-volume[81771]: INFO cinder.volume.drivers.remotefs [None req-feec3bfb-8f1e-417a-af29-77b9d24fb07f tempest-VolumesListTestJSON-1236832366 None] casted to osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 Apr 22 17:57:02 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-feec3bfb-8f1e-417a-af29-77b9d24fb07f tempest-VolumesListTestJSON-1236832366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-bd7fc188-8cdc-45d0-ae69-e3532734841a 1073741824 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:57:02 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-4aba2c45-e8c8-4cbd-b307-e1972845664b tempest-VolumesTransfersV357Test-1195682345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (912f20d8-9354-4b94-8c58-489b502674d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c8199af-1c71-497e-960f-6c2cedb8956d', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:57:02 devstack sudo[88536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-bd7fc188-8cdc-45d0-ae69-e3532734841a 1073741824 Apr 22 17:57:02 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-4aba2c45-e8c8-4cbd-b307-e1972845664b tempest-VolumesTransfersV357Test-1195682345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9da2dcca-e220-42d1-86fd-eb5e5dcc1e02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:57:02 devstack sudo[88536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:57:02 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-4aba2c45-e8c8-4cbd-b307-e1972845664b tempest-VolumesTransfersV357Test-1195682345 None] Volume volume-6c8199af-1c71-497e-960f-6c2cedb8956d (6c8199af-1c71-497e-960f-6c2cedb8956d): created successfully Apr 22 17:57:02 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-4aba2c45-e8c8-4cbd-b307-e1972845664b tempest-VolumesTransfersV357Test-1195682345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9da2dcca-e220-42d1-86fd-eb5e5dcc1e02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:57:02 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-4aba2c45-e8c8-4cbd-b307-e1972845664b tempest-VolumesTransfersV357Test-1195682345 None] Flow 'volume_create_manager' (acd5373e-3cfb-4735-b6ba-a92c2d626dc5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:57:02 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-4aba2c45-e8c8-4cbd-b307-e1972845664b tempest-VolumesTransfersV357Test-1195682345 None] Created volume successfully. Apr 22 17:57:03 devstack sudo[88536]: pam_unix(sudo:session): session closed for user root Apr 22 17:57:03 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-feec3bfb-8f1e-417a-af29-77b9d24fb07f tempest-VolumesListTestJSON-1236832366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-bd7fc188-8cdc-45d0-ae69-e3532734841a 1073741824" returned: 0 in 0.756s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:57:03 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-feec3bfb-8f1e-417a-af29-77b9d24fb07f tempest-VolumesListTestJSON-1236832366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-bd7fc188-8cdc-45d0-ae69-e3532734841a {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:57:03 devstack sudo[88541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-bd7fc188-8cdc-45d0-ae69-e3532734841a Apr 22 17:57:03 devstack sudo[88541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:57:03 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-6f184b4a-4148-413f-abe6-aa11f912ee24 tempest-VolumesTransfersV357Test-1746293251 None] Acquiring lock "cinder-6c8199af-1c71-497e-960f-6c2cedb8956d-delete_volume" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:57:03 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-6f184b4a-4148-413f-abe6-aa11f912ee24 tempest-VolumesTransfersV357Test-1746293251 None] Lock "cinder-6c8199af-1c71-497e-960f-6c2cedb8956d-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:57:03 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-6f184b4a-4148-413f-abe6-aa11f912ee24 tempest-VolumesTransfersV357Test-1746293251 None] Acquiring lock "cinder-quobyte-6c8199af-1c71-497e-960f-6c2cedb8956d" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:57:03 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-6f184b4a-4148-413f-abe6-aa11f912ee24 tempest-VolumesTransfersV357Test-1746293251 None] Lock "cinder-quobyte-6c8199af-1c71-497e-960f-6c2cedb8956d" acquired by "delete_volume" :: waited 0.028s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:57:03 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[20728025-a2a8-4e72-afc6-229fb2525c9e]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:57:03 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-6f184b4a-4148-413f-abe6-aa11f912ee24 tempest-VolumesTransfersV357Test-1746293251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-6c8199af-1c71-497e-960f-6c2cedb8956d {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:57:03 devstack sudo[88543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-6c8199af-1c71-497e-960f-6c2cedb8956d Apr 22 17:57:03 devstack sudo[88543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:57:03 devstack sudo[88541]: pam_unix(sudo:session): session closed for user root Apr 22 17:57:03 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-feec3bfb-8f1e-417a-af29-77b9d24fb07f tempest-VolumesListTestJSON-1236832366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-bd7fc188-8cdc-45d0-ae69-e3532734841a" returned: 0 in 0.539s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:57:03 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-feec3bfb-8f1e-417a-af29-77b9d24fb07f tempest-VolumesListTestJSON-1236832366 None] <== create_volume: return (1331ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'} {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 17:57:03 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-feec3bfb-8f1e-417a-af29-77b9d24fb07f tempest-VolumesListTestJSON-1236832366 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.334s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:57:03 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-3807512f-1882-4878-8ac8-5f40179735c1 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.771s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:57:03 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-3807512f-1882-4878-8ac8-5f40179735c1 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:57:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-185864388',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84922fe2-85bc-4cef-8917-dfbb0a9fcaec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cd098d792c4470498776cef33db9dbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:57:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:57:02Z,use_quota=True,user_id='e22bc8c7302248f1b33671862501bf0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)}" {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 17:57:03 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-3807512f-1882-4878-8ac8-5f40179735c1 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Creating volume 84922fe2-85bc-4cef-8917-dfbb0a9fcaec {{(pid=81771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 17:57:03 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-3807512f-1882-4878-8ac8-5f40179735c1 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:57:03 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-3807512f-1882-4878-8ac8-5f40179735c1 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:57:03 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-3807512f-1882-4878-8ac8-5f40179735c1 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:57:03 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-3807512f-1882-4878-8ac8-5f40179735c1 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:57:03 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-3807512f-1882-4878-8ac8-5f40179735c1 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:57:03 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-3807512f-1882-4878-8ac8-5f40179735c1 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Selected osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 as target Quobyte volume. {{(pid=81771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 17:57:03 devstack cinder-volume[81771]: INFO cinder.volume.drivers.remotefs [None req-3807512f-1882-4878-8ac8-5f40179735c1 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] casted to osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 Apr 22 17:57:03 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-3807512f-1882-4878-8ac8-5f40179735c1 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-84922fe2-85bc-4cef-8917-dfbb0a9fcaec 1073741824 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:57:03 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-feec3bfb-8f1e-417a-af29-77b9d24fb07f tempest-VolumesListTestJSON-1236832366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3b1b8c9-2dc6-4de3-9980-1065be42c83c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd7fc188-8cdc-45d0-ae69-e3532734841a', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:57:03 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-feec3bfb-8f1e-417a-af29-77b9d24fb07f tempest-VolumesListTestJSON-1236832366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (535d562f-b667-44d2-8ad5-edde65be6e1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:57:03 devstack sudo[88546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-84922fe2-85bc-4cef-8917-dfbb0a9fcaec 1073741824 Apr 22 17:57:03 devstack sudo[88546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:57:03 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-feec3bfb-8f1e-417a-af29-77b9d24fb07f tempest-VolumesListTestJSON-1236832366 None] Volume volume-bd7fc188-8cdc-45d0-ae69-e3532734841a (bd7fc188-8cdc-45d0-ae69-e3532734841a): created successfully Apr 22 17:57:03 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-feec3bfb-8f1e-417a-af29-77b9d24fb07f tempest-VolumesListTestJSON-1236832366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (535d562f-b667-44d2-8ad5-edde65be6e1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:57:03 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-feec3bfb-8f1e-417a-af29-77b9d24fb07f tempest-VolumesListTestJSON-1236832366 None] Flow 'volume_create_manager' (ff3cb417-9962-40ff-ae8f-33d08ff275b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:57:03 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-feec3bfb-8f1e-417a-af29-77b9d24fb07f tempest-VolumesListTestJSON-1236832366 None] Created volume successfully. Apr 22 17:57:04 devstack sudo[88543]: pam_unix(sudo:session): session closed for user root Apr 22 17:57:04 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-6f184b4a-4148-413f-abe6-aa11f912ee24 tempest-VolumesTransfersV357Test-1746293251 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-6c8199af-1c71-497e-960f-6c2cedb8956d" returned: 0 in 0.659s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:57:04 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-6f184b4a-4148-413f-abe6-aa11f912ee24 tempest-VolumesTransfersV357Test-1746293251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-6c8199af-1c71-497e-960f-6c2cedb8956d {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:57:04 devstack sudo[88551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-6c8199af-1c71-497e-960f-6c2cedb8956d Apr 22 17:57:04 devstack sudo[88551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:57:04 devstack sudo[88546]: pam_unix(sudo:session): session closed for user root Apr 22 17:57:04 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-3807512f-1882-4878-8ac8-5f40179735c1 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-84922fe2-85bc-4cef-8917-dfbb0a9fcaec 1073741824" returned: 0 in 0.806s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:57:04 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-3807512f-1882-4878-8ac8-5f40179735c1 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-84922fe2-85bc-4cef-8917-dfbb0a9fcaec {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:57:04 devstack sudo[88557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-84922fe2-85bc-4cef-8917-dfbb0a9fcaec Apr 22 17:57:04 devstack sudo[88557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:57:04 devstack sudo[88551]: pam_unix(sudo:session): session closed for user root Apr 22 17:57:04 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-6f184b4a-4148-413f-abe6-aa11f912ee24 tempest-VolumesTransfersV357Test-1746293251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-6c8199af-1c71-497e-960f-6c2cedb8956d" returned: 0 in 0.603s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:57:04 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-6f184b4a-4148-413f-abe6-aa11f912ee24 tempest-VolumesTransfersV357Test-1746293251 None] Lock "cinder-quobyte-6c8199af-1c71-497e-960f-6c2cedb8956d" released by "delete_volume" :: held 1.308s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:57:04 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-6f184b4a-4148-413f-abe6-aa11f912ee24 tempest-VolumesTransfersV357Test-1746293251 None] Created reservations ['335a8a11-5126-4522-914f-d9cff9284d00', 'fdc69c4f-2162-4e90-9a39-a4c4cb22a6b7', 'c8f6d004-b977-4266-96c9-85add653b578', '6a9c6473-1202-4e94-9372-d4a1ddf4155d'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 17:57:04 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-6f184b4a-4148-413f-abe6-aa11f912ee24 tempest-VolumesTransfersV357Test-1746293251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:57:04 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-6f184b4a-4148-413f-abe6-aa11f912ee24 tempest-VolumesTransfersV357Test-1746293251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:57:04 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-6f184b4a-4148-413f-abe6-aa11f912ee24 tempest-VolumesTransfersV357Test-1746293251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:57:04 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-6f184b4a-4148-413f-abe6-aa11f912ee24 tempest-VolumesTransfersV357Test-1746293251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:57:04 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-6f184b4a-4148-413f-abe6-aa11f912ee24 tempest-VolumesTransfersV357Test-1746293251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:57:04 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-6f184b4a-4148-413f-abe6-aa11f912ee24 tempest-VolumesTransfersV357Test-1746293251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:57:04 devstack sudo[88559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 Apr 22 17:57:04 devstack sudo[88559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:57:05 devstack cinder-volume[81771]: DEBUG cinder.volume.flows.manager.create_volume [None req-03254cfb-9c9b-449e-baf7-013c2b63c4ec tempest-VolumesListTestJSON-1236832366 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 17:57:05 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-03254cfb-9c9b-449e-baf7-013c2b63c4ec tempest-VolumesListTestJSON-1236832366 None] Flow 'volume_create_manager' (5b3a3865-7ecc-4bc1-990c-4f321edbf43c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:57:05 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-03254cfb-9c9b-449e-baf7-013c2b63c4ec tempest-VolumesListTestJSON-1236832366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c75392b7-f4a3-4d2a-972f-98dce9150667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:57:05 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-03254cfb-9c9b-449e-baf7-013c2b63c4ec tempest-VolumesListTestJSON-1236832366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c75392b7-f4a3-4d2a-972f-98dce9150667) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:57:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1804789574',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a26762eb-85c8-41f4-bb89-1eca772c933a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0977cd5a6bb84876a9178299209f6aeb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:57:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:57:05Z,use_quota=True,user_id='6a5ff43f4d0e42ae8f662ed64b8b2757',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:57:05 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-03254cfb-9c9b-449e-baf7-013c2b63c4ec tempest-VolumesListTestJSON-1236832366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fa811e5-a046-4f81-b582-287a668d462f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:57:05 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-03254cfb-9c9b-449e-baf7-013c2b63c4ec tempest-VolumesListTestJSON-1236832366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fa811e5-a046-4f81-b582-287a668d462f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:57:05 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-03254cfb-9c9b-449e-baf7-013c2b63c4ec tempest-VolumesListTestJSON-1236832366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25050071-a460-4322-84b0-4b6a079732bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:57:05 devstack sudo[88557]: pam_unix(sudo:session): session closed for user root Apr 22 17:57:05 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-03254cfb-9c9b-449e-baf7-013c2b63c4ec tempest-VolumesListTestJSON-1236832366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25050071-a460-4322-84b0-4b6a079732bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a26762eb-85c8-41f4-bb89-1eca772c933a', 'volume_name': 'volume-a26762eb-85c8-41f4-bb89-1eca772c933a', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:57:05 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-03254cfb-9c9b-449e-baf7-013c2b63c4ec tempest-VolumesListTestJSON-1236832366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99c7d8b3-95e6-4051-b3d7-20ba32fb6bb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:57:05 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-03254cfb-9c9b-449e-baf7-013c2b63c4ec tempest-VolumesListTestJSON-1236832366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99c7d8b3-95e6-4051-b3d7-20ba32fb6bb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:57:05 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-03254cfb-9c9b-449e-baf7-013c2b63c4ec tempest-VolumesListTestJSON-1236832366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c65e3265-1958-4ae0-a402-3ab25e7053c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:57:05 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-03254cfb-9c9b-449e-baf7-013c2b63c4ec tempest-VolumesListTestJSON-1236832366 None] Volume a26762eb-85c8-41f4-bb89-1eca772c933a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a26762eb-85c8-41f4-bb89-1eca772c933a', 'volume_size': 1} Apr 22 17:57:05 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-03254cfb-9c9b-449e-baf7-013c2b63c4ec tempest-VolumesListTestJSON-1236832366 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:57:05 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-3807512f-1882-4878-8ac8-5f40179735c1 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-84922fe2-85bc-4cef-8917-dfbb0a9fcaec" returned: 0 in 0.670s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:57:05 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-3807512f-1882-4878-8ac8-5f40179735c1 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] <== create_volume: return (1526ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'} {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 17:57:05 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-3807512f-1882-4878-8ac8-5f40179735c1 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.529s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:57:05 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-03254cfb-9c9b-449e-baf7-013c2b63c4ec tempest-VolumesListTestJSON-1236832366 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:57:05 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-03254cfb-9c9b-449e-baf7-013c2b63c4ec tempest-VolumesListTestJSON-1236832366 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:57:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1804789574',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a26762eb-85c8-41f4-bb89-1eca772c933a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0977cd5a6bb84876a9178299209f6aeb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:57:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:57:05Z,use_quota=True,user_id='6a5ff43f4d0e42ae8f662ed64b8b2757',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)}" {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 17:57:05 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-03254cfb-9c9b-449e-baf7-013c2b63c4ec tempest-VolumesListTestJSON-1236832366 None] Creating volume a26762eb-85c8-41f4-bb89-1eca772c933a {{(pid=81771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 17:57:05 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-03254cfb-9c9b-449e-baf7-013c2b63c4ec tempest-VolumesListTestJSON-1236832366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:57:05 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-03254cfb-9c9b-449e-baf7-013c2b63c4ec tempest-VolumesListTestJSON-1236832366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:57:05 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-03254cfb-9c9b-449e-baf7-013c2b63c4ec tempest-VolumesListTestJSON-1236832366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:57:05 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-03254cfb-9c9b-449e-baf7-013c2b63c4ec tempest-VolumesListTestJSON-1236832366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:57:05 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-03254cfb-9c9b-449e-baf7-013c2b63c4ec tempest-VolumesListTestJSON-1236832366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:57:05 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-03254cfb-9c9b-449e-baf7-013c2b63c4ec tempest-VolumesListTestJSON-1236832366 None] Selected osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 as target Quobyte volume. {{(pid=81771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 17:57:05 devstack cinder-volume[81771]: INFO cinder.volume.drivers.remotefs [None req-03254cfb-9c9b-449e-baf7-013c2b63c4ec tempest-VolumesListTestJSON-1236832366 None] casted to osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 Apr 22 17:57:05 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-03254cfb-9c9b-449e-baf7-013c2b63c4ec tempest-VolumesListTestJSON-1236832366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a26762eb-85c8-41f4-bb89-1eca772c933a 1073741824 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:57:05 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-3807512f-1882-4878-8ac8-5f40179735c1 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8ef7b85-62c0-4328-bc8a-7cbc4ce9a90a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84922fe2-85bc-4cef-8917-dfbb0a9fcaec', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:57:05 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-3807512f-1882-4878-8ac8-5f40179735c1 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d04ee3a-13dc-4385-873b-3506d7dda4fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:57:05 devstack sudo[88562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a26762eb-85c8-41f4-bb89-1eca772c933a 1073741824 Apr 22 17:57:05 devstack sudo[88562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:57:05 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-3807512f-1882-4878-8ac8-5f40179735c1 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Volume volume-84922fe2-85bc-4cef-8917-dfbb0a9fcaec (84922fe2-85bc-4cef-8917-dfbb0a9fcaec): created successfully Apr 22 17:57:05 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-3807512f-1882-4878-8ac8-5f40179735c1 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d04ee3a-13dc-4385-873b-3506d7dda4fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:57:05 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-3807512f-1882-4878-8ac8-5f40179735c1 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Flow 'volume_create_manager' (c59fe0bf-b41d-467c-87a7-caf224bead90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:57:05 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-3807512f-1882-4878-8ac8-5f40179735c1 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Created volume successfully. Apr 22 17:57:05 devstack sudo[88559]: pam_unix(sudo:session): session closed for user root Apr 22 17:57:05 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-6f184b4a-4148-413f-abe6-aa11f912ee24 tempest-VolumesTransfersV357Test-1746293251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33" returned: 0 in 0.624s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:57:05 devstack cinder-volume[81771]: DEBUG cinder.manager [None req-6f184b4a-4148-413f-abe6-aa11f912ee24 tempest-VolumesTransfersV357Test-1746293251 None] Notifying Schedulers of capabilities ... {{(pid=81771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 17:57:05 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-6f184b4a-4148-413f-abe6-aa11f912ee24 tempest-VolumesTransfersV357Test-1746293251 None] Deleted volume successfully. Apr 22 17:57:05 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-6f184b4a-4148-413f-abe6-aa11f912ee24 tempest-VolumesTransfersV357Test-1746293251 None] Lock "cinder-6c8199af-1c71-497e-960f-6c2cedb8956d-delete_volume" released by "delete_volume" :: held 2.183s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:57:06 devstack sudo[88562]: pam_unix(sudo:session): session closed for user root Apr 22 17:57:06 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-03254cfb-9c9b-449e-baf7-013c2b63c4ec tempest-VolumesListTestJSON-1236832366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a26762eb-85c8-41f4-bb89-1eca772c933a 1073741824" returned: 0 in 0.758s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:57:06 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-03254cfb-9c9b-449e-baf7-013c2b63c4ec tempest-VolumesListTestJSON-1236832366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a26762eb-85c8-41f4-bb89-1eca772c933a {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:57:06 devstack sudo[88568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a26762eb-85c8-41f4-bb89-1eca772c933a Apr 22 17:57:06 devstack sudo[88568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:57:06 devstack cinder-volume[81771]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ee113fb-9afd-48ba-ad00-e8b305689e4c tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 17:57:06 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-1ee113fb-9afd-48ba-ad00-e8b305689e4c tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Flow 'volume_create_manager' (5a34bc9e-fbcc-4424-8e44-44f9e844d59b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:57:06 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-1ee113fb-9afd-48ba-ad00-e8b305689e4c tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a0b2cf4-98c8-4861-9d34-a3fd84e10195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:57:06 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-1ee113fb-9afd-48ba-ad00-e8b305689e4c tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a0b2cf4-98c8-4861-9d34-a3fd84e10195) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:57:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-577687359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c969251a-816d-47a6-adcc-46a769634696,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cd098d792c4470498776cef33db9dbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:57:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:57:07Z,use_quota=True,user_id='e22bc8c7302248f1b33671862501bf0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:57:06 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-1ee113fb-9afd-48ba-ad00-e8b305689e4c tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12f17e89-a3f3-4ded-bc0e-a959934183c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:57:06 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-1ee113fb-9afd-48ba-ad00-e8b305689e4c tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12f17e89-a3f3-4ded-bc0e-a959934183c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:57:06 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-1ee113fb-9afd-48ba-ad00-e8b305689e4c tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c573d4f8-1a6a-48ef-b2e1-fafc5e7af7fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:57:06 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-1ee113fb-9afd-48ba-ad00-e8b305689e4c tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c573d4f8-1a6a-48ef-b2e1-fafc5e7af7fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c969251a-816d-47a6-adcc-46a769634696', 'volume_name': 'volume-c969251a-816d-47a6-adcc-46a769634696', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:57:06 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-1ee113fb-9afd-48ba-ad00-e8b305689e4c tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f5a500d-fd93-498c-9849-488a7348cd97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:57:06 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-1ee113fb-9afd-48ba-ad00-e8b305689e4c tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f5a500d-fd93-498c-9849-488a7348cd97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:57:06 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-1ee113fb-9afd-48ba-ad00-e8b305689e4c tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f7d2b26-3702-4cfe-aae3-ecb1867fd6be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:57:06 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-1ee113fb-9afd-48ba-ad00-e8b305689e4c tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Volume c969251a-816d-47a6-adcc-46a769634696: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c969251a-816d-47a6-adcc-46a769634696', 'volume_size': 1} Apr 22 17:57:06 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-1ee113fb-9afd-48ba-ad00-e8b305689e4c tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:57:06 devstack sudo[88568]: pam_unix(sudo:session): session closed for user root Apr 22 17:57:06 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-03254cfb-9c9b-449e-baf7-013c2b63c4ec tempest-VolumesListTestJSON-1236832366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a26762eb-85c8-41f4-bb89-1eca772c933a" returned: 0 in 0.794s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:57:06 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-03254cfb-9c9b-449e-baf7-013c2b63c4ec tempest-VolumesListTestJSON-1236832366 None] <== create_volume: return (1628ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'} {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 17:57:06 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-03254cfb-9c9b-449e-baf7-013c2b63c4ec tempest-VolumesListTestJSON-1236832366 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.631s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:57:06 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-1ee113fb-9afd-48ba-ad00-e8b305689e4c tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.198s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:57:06 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-1ee113fb-9afd-48ba-ad00-e8b305689e4c tempest-CreateVolumesFromSourceVolumeTest-413232999 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:57:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-577687359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c969251a-816d-47a6-adcc-46a769634696,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cd098d792c4470498776cef33db9dbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:57:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:57:07Z,use_quota=True,user_id='e22bc8c7302248f1b33671862501bf0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)}" {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 17:57:06 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-1ee113fb-9afd-48ba-ad00-e8b305689e4c tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Creating volume c969251a-816d-47a6-adcc-46a769634696 {{(pid=81771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 17:57:06 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-1ee113fb-9afd-48ba-ad00-e8b305689e4c tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:57:06 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-1ee113fb-9afd-48ba-ad00-e8b305689e4c tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:57:06 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-1ee113fb-9afd-48ba-ad00-e8b305689e4c tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:57:07 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-1ee113fb-9afd-48ba-ad00-e8b305689e4c tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:57:07 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-1ee113fb-9afd-48ba-ad00-e8b305689e4c tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:57:07 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-1ee113fb-9afd-48ba-ad00-e8b305689e4c tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Selected osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 as target Quobyte volume. {{(pid=81771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 17:57:07 devstack cinder-volume[81771]: INFO cinder.volume.drivers.remotefs [None req-1ee113fb-9afd-48ba-ad00-e8b305689e4c tempest-CreateVolumesFromSourceVolumeTest-413232999 None] casted to osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 Apr 22 17:57:07 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-1ee113fb-9afd-48ba-ad00-e8b305689e4c tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-c969251a-816d-47a6-adcc-46a769634696 1073741824 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:57:07 devstack sudo[88571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-c969251a-816d-47a6-adcc-46a769634696 1073741824 Apr 22 17:57:07 devstack sudo[88571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:57:07 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-03254cfb-9c9b-449e-baf7-013c2b63c4ec tempest-VolumesListTestJSON-1236832366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c65e3265-1958-4ae0-a402-3ab25e7053c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a26762eb-85c8-41f4-bb89-1eca772c933a', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:57:07 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-03254cfb-9c9b-449e-baf7-013c2b63c4ec tempest-VolumesListTestJSON-1236832366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa18f1d6-ab50-477e-9de4-178aef33e22c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:57:07 devstack cinder-volume[81771]: DEBUG cinder.volume.flows.manager.create_volume [None req-93634d6a-4684-48ee-bf5b-6ab6ab22ba4d tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 17:57:07 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-93634d6a-4684-48ee-bf5b-6ab6ab22ba4d tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Flow 'volume_create_manager' (2aa716a4-6feb-4f5e-bf55-6cb32de734ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:57:07 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-93634d6a-4684-48ee-bf5b-6ab6ab22ba4d tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2e7451e-596d-432f-92e6-42639f8ab8de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:57:07 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-03254cfb-9c9b-449e-baf7-013c2b63c4ec tempest-VolumesListTestJSON-1236832366 None] Volume volume-a26762eb-85c8-41f4-bb89-1eca772c933a (a26762eb-85c8-41f4-bb89-1eca772c933a): created successfully Apr 22 17:57:07 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-03254cfb-9c9b-449e-baf7-013c2b63c4ec tempest-VolumesListTestJSON-1236832366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa18f1d6-ab50-477e-9de4-178aef33e22c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:57:07 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-03254cfb-9c9b-449e-baf7-013c2b63c4ec tempest-VolumesListTestJSON-1236832366 None] Flow 'volume_create_manager' (5b3a3865-7ecc-4bc1-990c-4f321edbf43c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:57:07 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-93634d6a-4684-48ee-bf5b-6ab6ab22ba4d tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2e7451e-596d-432f-92e6-42639f8ab8de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:57:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1879936420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63f19ffe-139f-4fdc-a047-7f4cd70740bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cd098d792c4470498776cef33db9dbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:57:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:57:07Z,use_quota=True,user_id='e22bc8c7302248f1b33671862501bf0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:57:07 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-93634d6a-4684-48ee-bf5b-6ab6ab22ba4d tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c753b66b-a29b-475e-9e82-3d6b112acb11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:57:07 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-93634d6a-4684-48ee-bf5b-6ab6ab22ba4d tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c753b66b-a29b-475e-9e82-3d6b112acb11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:57:07 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-93634d6a-4684-48ee-bf5b-6ab6ab22ba4d tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (848bf2f8-760e-4b19-adea-4604f88cc7ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:57:07 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-93634d6a-4684-48ee-bf5b-6ab6ab22ba4d tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (848bf2f8-760e-4b19-adea-4604f88cc7ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63f19ffe-139f-4fdc-a047-7f4cd70740bb', 'volume_name': 'volume-63f19ffe-139f-4fdc-a047-7f4cd70740bb', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:57:07 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-93634d6a-4684-48ee-bf5b-6ab6ab22ba4d tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14b64c7d-8fcf-46c6-8586-11618b2f8574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:57:07 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-93634d6a-4684-48ee-bf5b-6ab6ab22ba4d tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14b64c7d-8fcf-46c6-8586-11618b2f8574) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:57:07 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-93634d6a-4684-48ee-bf5b-6ab6ab22ba4d tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbda836d-00a2-4601-b54e-bf8eb1a30d23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:57:07 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-93634d6a-4684-48ee-bf5b-6ab6ab22ba4d tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Volume 63f19ffe-139f-4fdc-a047-7f4cd70740bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63f19ffe-139f-4fdc-a047-7f4cd70740bb', 'volume_size': 1} Apr 22 17:57:07 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-93634d6a-4684-48ee-bf5b-6ab6ab22ba4d tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:57:07 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-03254cfb-9c9b-449e-baf7-013c2b63c4ec tempest-VolumesListTestJSON-1236832366 None] Created volume successfully. Apr 22 17:57:07 devstack cinder-volume[81771]: DEBUG cinder.volume.flows.manager.create_volume [None req-49170388-7f6d-4ed1-8b73-25590e1a0dd3 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 17:57:07 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-49170388-7f6d-4ed1-8b73-25590e1a0dd3 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Flow 'volume_create_manager' (2b3276f1-cc44-497d-b603-c79928a0bdcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:57:07 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-49170388-7f6d-4ed1-8b73-25590e1a0dd3 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c9d428e-f7a3-4bc5-996b-006f1432c7dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:57:07 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-49170388-7f6d-4ed1-8b73-25590e1a0dd3 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c9d428e-f7a3-4bc5-996b-006f1432c7dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:57:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2131966894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23d599c3-c12e-4620-8edf-7e9f34a7ad91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cd098d792c4470498776cef33db9dbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:57:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:57:07Z,use_quota=True,user_id='e22bc8c7302248f1b33671862501bf0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:57:07 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-49170388-7f6d-4ed1-8b73-25590e1a0dd3 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12c832dd-a6aa-4a2a-be6f-6a524f3c7069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:57:07 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-49170388-7f6d-4ed1-8b73-25590e1a0dd3 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12c832dd-a6aa-4a2a-be6f-6a524f3c7069) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:57:07 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-49170388-7f6d-4ed1-8b73-25590e1a0dd3 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cbe4819-8130-4385-b1d4-f16c973ddce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:57:07 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-49170388-7f6d-4ed1-8b73-25590e1a0dd3 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cbe4819-8130-4385-b1d4-f16c973ddce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23d599c3-c12e-4620-8edf-7e9f34a7ad91', 'volume_name': 'volume-23d599c3-c12e-4620-8edf-7e9f34a7ad91', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:57:07 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-49170388-7f6d-4ed1-8b73-25590e1a0dd3 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54693690-848e-4a82-9277-27a6d4bea458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:57:07 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-49170388-7f6d-4ed1-8b73-25590e1a0dd3 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54693690-848e-4a82-9277-27a6d4bea458) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:57:07 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-49170388-7f6d-4ed1-8b73-25590e1a0dd3 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91e78269-85a4-4caf-9fc3-62ed05aa71ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:57:07 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-49170388-7f6d-4ed1-8b73-25590e1a0dd3 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Volume 23d599c3-c12e-4620-8edf-7e9f34a7ad91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23d599c3-c12e-4620-8edf-7e9f34a7ad91', 'volume_size': 1} Apr 22 17:57:07 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-49170388-7f6d-4ed1-8b73-25590e1a0dd3 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:57:08 devstack sudo[88571]: pam_unix(sudo:session): session closed for user root Apr 22 17:57:08 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-1ee113fb-9afd-48ba-ad00-e8b305689e4c tempest-CreateVolumesFromSourceVolumeTest-413232999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-c969251a-816d-47a6-adcc-46a769634696 1073741824" returned: 0 in 1.083s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:57:08 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-1ee113fb-9afd-48ba-ad00-e8b305689e4c tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-c969251a-816d-47a6-adcc-46a769634696 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:57:08 devstack sudo[88578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-c969251a-816d-47a6-adcc-46a769634696 Apr 22 17:57:08 devstack sudo[88578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:57:08 devstack cinder-volume[81771]: DEBUG cinder.volume.flows.manager.create_volume [None req-252f7985-af1d-4f41-83b8-d4fe3c5c7cc4 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 17:57:08 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-252f7985-af1d-4f41-83b8-d4fe3c5c7cc4 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Flow 'volume_create_manager' (2786565c-78a9-48d2-9278-ae220895a981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:57:08 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-252f7985-af1d-4f41-83b8-d4fe3c5c7cc4 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (360a21b9-84e8-4c32-8952-49aa3e38d195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:57:08 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-252f7985-af1d-4f41-83b8-d4fe3c5c7cc4 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (360a21b9-84e8-4c32-8952-49aa3e38d195) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:57:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-89973549',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a959699d-0396-4bc8-962d-830d918f4344,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cd098d792c4470498776cef33db9dbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:57:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:57:08Z,use_quota=True,user_id='e22bc8c7302248f1b33671862501bf0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:57:08 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-252f7985-af1d-4f41-83b8-d4fe3c5c7cc4 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3092680b-c818-42ad-bf78-f0715f3f23d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:57:08 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-252f7985-af1d-4f41-83b8-d4fe3c5c7cc4 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3092680b-c818-42ad-bf78-f0715f3f23d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:57:08 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-252f7985-af1d-4f41-83b8-d4fe3c5c7cc4 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10ea9e56-92e1-4b8b-aabe-cee9344c2f54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:57:08 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-252f7985-af1d-4f41-83b8-d4fe3c5c7cc4 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10ea9e56-92e1-4b8b-aabe-cee9344c2f54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a959699d-0396-4bc8-962d-830d918f4344', 'volume_name': 'volume-a959699d-0396-4bc8-962d-830d918f4344', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:57:08 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-252f7985-af1d-4f41-83b8-d4fe3c5c7cc4 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4e2fd88-a2b0-4103-a856-e621b16cfaeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:57:08 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-252f7985-af1d-4f41-83b8-d4fe3c5c7cc4 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4e2fd88-a2b0-4103-a856-e621b16cfaeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:57:08 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-252f7985-af1d-4f41-83b8-d4fe3c5c7cc4 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38fb2266-fc8b-4ad1-b22d-6e8485f9e810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:57:08 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-252f7985-af1d-4f41-83b8-d4fe3c5c7cc4 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Volume a959699d-0396-4bc8-962d-830d918f4344: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a959699d-0396-4bc8-962d-830d918f4344', 'volume_size': 1} Apr 22 17:57:08 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-252f7985-af1d-4f41-83b8-d4fe3c5c7cc4 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:57:08 devstack cinder-volume[81771]: DEBUG cinder.volume.flows.manager.create_volume [None req-563135f3-fe4e-4257-95bf-f9a7c55f0cf2 tempest-VolumesListTestJSON-1236832366 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 17:57:08 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-563135f3-fe4e-4257-95bf-f9a7c55f0cf2 tempest-VolumesListTestJSON-1236832366 None] Flow 'volume_create_manager' (f8b6becd-c92b-41c1-8824-18daaa6f9887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:57:08 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-563135f3-fe4e-4257-95bf-f9a7c55f0cf2 tempest-VolumesListTestJSON-1236832366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4591a391-ed06-4383-87ed-0b7be5d5c645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:57:08 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-563135f3-fe4e-4257-95bf-f9a7c55f0cf2 tempest-VolumesListTestJSON-1236832366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4591a391-ed06-4383-87ed-0b7be5d5c645) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:57:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-4137391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3362aaaa-cb65-444a-95ca-c0e578f6879a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0977cd5a6bb84876a9178299209f6aeb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:57:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:57:08Z,use_quota=True,user_id='6a5ff43f4d0e42ae8f662ed64b8b2757',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:57:08 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-563135f3-fe4e-4257-95bf-f9a7c55f0cf2 tempest-VolumesListTestJSON-1236832366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbff5e5c-889c-47f9-8591-d269d4f017f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:57:08 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-563135f3-fe4e-4257-95bf-f9a7c55f0cf2 tempest-VolumesListTestJSON-1236832366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbff5e5c-889c-47f9-8591-d269d4f017f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:57:08 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-563135f3-fe4e-4257-95bf-f9a7c55f0cf2 tempest-VolumesListTestJSON-1236832366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (501bfd25-d8fb-47a6-b02f-73159f450ec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:57:08 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-563135f3-fe4e-4257-95bf-f9a7c55f0cf2 tempest-VolumesListTestJSON-1236832366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (501bfd25-d8fb-47a6-b02f-73159f450ec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3362aaaa-cb65-444a-95ca-c0e578f6879a', 'volume_name': 'volume-3362aaaa-cb65-444a-95ca-c0e578f6879a', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:57:08 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-563135f3-fe4e-4257-95bf-f9a7c55f0cf2 tempest-VolumesListTestJSON-1236832366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0403e05a-548c-4551-a1a6-a21321cd4c82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:57:08 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-563135f3-fe4e-4257-95bf-f9a7c55f0cf2 tempest-VolumesListTestJSON-1236832366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0403e05a-548c-4551-a1a6-a21321cd4c82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:57:08 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-563135f3-fe4e-4257-95bf-f9a7c55f0cf2 tempest-VolumesListTestJSON-1236832366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea871844-bab6-4ea1-b4e7-3fa40c9a5e30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:57:08 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-563135f3-fe4e-4257-95bf-f9a7c55f0cf2 tempest-VolumesListTestJSON-1236832366 None] Volume 3362aaaa-cb65-444a-95ca-c0e578f6879a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3362aaaa-cb65-444a-95ca-c0e578f6879a', 'volume_size': 1} Apr 22 17:57:08 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-563135f3-fe4e-4257-95bf-f9a7c55f0cf2 tempest-VolumesListTestJSON-1236832366 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:57:08 devstack cinder-volume[81771]: DEBUG cinder.volume.flows.manager.create_volume [None req-146108b7-0197-420d-b406-537f76d74889 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 17:57:08 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-146108b7-0197-420d-b406-537f76d74889 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Flow 'volume_create_manager' (18c1dedd-f19a-4cd8-9173-21d24f8d0304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:57:08 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-146108b7-0197-420d-b406-537f76d74889 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (480c5cc1-a04f-4d76-9832-2e7a6f8e15d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:57:08 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-146108b7-0197-420d-b406-537f76d74889 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (480c5cc1-a04f-4d76-9832-2e7a6f8e15d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:57:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1155858732',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6cd2de8-bc7b-4fd8-8b1d-36a941d6da66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cd098d792c4470498776cef33db9dbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:57:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:57:09Z,use_quota=True,user_id='e22bc8c7302248f1b33671862501bf0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:57:08 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-146108b7-0197-420d-b406-537f76d74889 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ffb8521-b934-4dbf-abc2-b9c7d0a15e37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:57:08 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-146108b7-0197-420d-b406-537f76d74889 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ffb8521-b934-4dbf-abc2-b9c7d0a15e37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:57:08 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-146108b7-0197-420d-b406-537f76d74889 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b7dad32-b0f6-4c3b-a4c9-5cade9798fcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:57:08 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-146108b7-0197-420d-b406-537f76d74889 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b7dad32-b0f6-4c3b-a4c9-5cade9798fcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6cd2de8-bc7b-4fd8-8b1d-36a941d6da66', 'volume_name': 'volume-c6cd2de8-bc7b-4fd8-8b1d-36a941d6da66', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:57:08 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-146108b7-0197-420d-b406-537f76d74889 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7098545b-b109-4b6c-9ec1-0e73d2d7446c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:57:08 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-146108b7-0197-420d-b406-537f76d74889 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7098545b-b109-4b6c-9ec1-0e73d2d7446c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:57:08 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-146108b7-0197-420d-b406-537f76d74889 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7929b38-3dff-47cf-aac9-6a88dd3a7929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:57:08 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-146108b7-0197-420d-b406-537f76d74889 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Volume c6cd2de8-bc7b-4fd8-8b1d-36a941d6da66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6cd2de8-bc7b-4fd8-8b1d-36a941d6da66', 'volume_size': 1} Apr 22 17:57:08 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-146108b7-0197-420d-b406-537f76d74889 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:57:08 devstack sudo[88578]: pam_unix(sudo:session): session closed for user root Apr 22 17:57:08 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-1ee113fb-9afd-48ba-ad00-e8b305689e4c tempest-CreateVolumesFromSourceVolumeTest-413232999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-c969251a-816d-47a6-adcc-46a769634696" returned: 0 in 0.715s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:57:08 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-1ee113fb-9afd-48ba-ad00-e8b305689e4c tempest-CreateVolumesFromSourceVolumeTest-413232999 None] <== create_volume: return (1862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'} {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 17:57:08 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-1ee113fb-9afd-48ba-ad00-e8b305689e4c tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.865s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:57:08 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-93634d6a-4684-48ee-bf5b-6ab6ab22ba4d tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.584s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:57:08 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-93634d6a-4684-48ee-bf5b-6ab6ab22ba4d tempest-CreateVolumesFromSourceVolumeTest-413232999 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:57:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1879936420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63f19ffe-139f-4fdc-a047-7f4cd70740bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cd098d792c4470498776cef33db9dbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:57:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:57:07Z,use_quota=True,user_id='e22bc8c7302248f1b33671862501bf0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)}" {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 17:57:08 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-93634d6a-4684-48ee-bf5b-6ab6ab22ba4d tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Creating volume 63f19ffe-139f-4fdc-a047-7f4cd70740bb {{(pid=81771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 17:57:08 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-93634d6a-4684-48ee-bf5b-6ab6ab22ba4d tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:57:08 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-93634d6a-4684-48ee-bf5b-6ab6ab22ba4d tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:57:08 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-93634d6a-4684-48ee-bf5b-6ab6ab22ba4d tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:57:08 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-93634d6a-4684-48ee-bf5b-6ab6ab22ba4d tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:57:08 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-93634d6a-4684-48ee-bf5b-6ab6ab22ba4d tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:57:08 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-93634d6a-4684-48ee-bf5b-6ab6ab22ba4d tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Selected osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 as target Quobyte volume. {{(pid=81771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 17:57:08 devstack cinder-volume[81771]: INFO cinder.volume.drivers.remotefs [None req-93634d6a-4684-48ee-bf5b-6ab6ab22ba4d tempest-CreateVolumesFromSourceVolumeTest-413232999 None] casted to osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 Apr 22 17:57:08 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-93634d6a-4684-48ee-bf5b-6ab6ab22ba4d tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-63f19ffe-139f-4fdc-a047-7f4cd70740bb 1073741824 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:57:08 devstack sudo[88582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-63f19ffe-139f-4fdc-a047-7f4cd70740bb 1073741824 Apr 22 17:57:08 devstack sudo[88582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:57:08 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-1ee113fb-9afd-48ba-ad00-e8b305689e4c tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f7d2b26-3702-4cfe-aae3-ecb1867fd6be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c969251a-816d-47a6-adcc-46a769634696', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:57:08 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-1ee113fb-9afd-48ba-ad00-e8b305689e4c tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8573b37-cd7e-4045-a9b7-c363575b9844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:57:08 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-1ee113fb-9afd-48ba-ad00-e8b305689e4c tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Volume volume-c969251a-816d-47a6-adcc-46a769634696 (c969251a-816d-47a6-adcc-46a769634696): created successfully Apr 22 17:57:08 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-1ee113fb-9afd-48ba-ad00-e8b305689e4c tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8573b37-cd7e-4045-a9b7-c363575b9844) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:57:08 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-1ee113fb-9afd-48ba-ad00-e8b305689e4c tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Flow 'volume_create_manager' (5a34bc9e-fbcc-4424-8e44-44f9e844d59b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:57:08 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-1ee113fb-9afd-48ba-ad00-e8b305689e4c tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Created volume successfully. Apr 22 17:57:09 devstack sudo[88582]: pam_unix(sudo:session): session closed for user root Apr 22 17:57:09 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-93634d6a-4684-48ee-bf5b-6ab6ab22ba4d tempest-CreateVolumesFromSourceVolumeTest-413232999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-63f19ffe-139f-4fdc-a047-7f4cd70740bb 1073741824" returned: 0 in 1.021s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:57:09 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-93634d6a-4684-48ee-bf5b-6ab6ab22ba4d tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-63f19ffe-139f-4fdc-a047-7f4cd70740bb {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:57:09 devstack sudo[88587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-63f19ffe-139f-4fdc-a047-7f4cd70740bb Apr 22 17:57:09 devstack sudo[88587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:57:10 devstack sudo[88587]: pam_unix(sudo:session): session closed for user root Apr 22 17:57:10 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-93634d6a-4684-48ee-bf5b-6ab6ab22ba4d tempest-CreateVolumesFromSourceVolumeTest-413232999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-63f19ffe-139f-4fdc-a047-7f4cd70740bb" returned: 0 in 0.589s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:57:10 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-93634d6a-4684-48ee-bf5b-6ab6ab22ba4d tempest-CreateVolumesFromSourceVolumeTest-413232999 None] <== create_volume: return (1654ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'} {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 17:57:10 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-93634d6a-4684-48ee-bf5b-6ab6ab22ba4d tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.658s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:57:10 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-49170388-7f6d-4ed1-8b73-25590e1a0dd3 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.817s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:57:10 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-49170388-7f6d-4ed1-8b73-25590e1a0dd3 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:57:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2131966894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23d599c3-c12e-4620-8edf-7e9f34a7ad91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cd098d792c4470498776cef33db9dbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:57:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:57:07Z,use_quota=True,user_id='e22bc8c7302248f1b33671862501bf0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)}" {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 17:57:10 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-49170388-7f6d-4ed1-8b73-25590e1a0dd3 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Creating volume 23d599c3-c12e-4620-8edf-7e9f34a7ad91 {{(pid=81771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 17:57:10 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-49170388-7f6d-4ed1-8b73-25590e1a0dd3 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:57:10 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-49170388-7f6d-4ed1-8b73-25590e1a0dd3 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:57:10 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-49170388-7f6d-4ed1-8b73-25590e1a0dd3 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:57:10 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-49170388-7f6d-4ed1-8b73-25590e1a0dd3 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:57:10 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-49170388-7f6d-4ed1-8b73-25590e1a0dd3 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:57:10 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-49170388-7f6d-4ed1-8b73-25590e1a0dd3 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Selected osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 as target Quobyte volume. {{(pid=81771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 17:57:10 devstack cinder-volume[81771]: INFO cinder.volume.drivers.remotefs [None req-49170388-7f6d-4ed1-8b73-25590e1a0dd3 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] casted to osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 Apr 22 17:57:10 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-49170388-7f6d-4ed1-8b73-25590e1a0dd3 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-23d599c3-c12e-4620-8edf-7e9f34a7ad91 1073741824 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:57:10 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-93634d6a-4684-48ee-bf5b-6ab6ab22ba4d tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbda836d-00a2-4601-b54e-bf8eb1a30d23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63f19ffe-139f-4fdc-a047-7f4cd70740bb', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:57:10 devstack sudo[88590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-23d599c3-c12e-4620-8edf-7e9f34a7ad91 1073741824 Apr 22 17:57:10 devstack sudo[88590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:57:10 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-93634d6a-4684-48ee-bf5b-6ab6ab22ba4d tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd75be2c-b312-4384-9bbc-09c2515fea8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:57:10 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-93634d6a-4684-48ee-bf5b-6ab6ab22ba4d tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Volume volume-63f19ffe-139f-4fdc-a047-7f4cd70740bb (63f19ffe-139f-4fdc-a047-7f4cd70740bb): created successfully Apr 22 17:57:10 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-93634d6a-4684-48ee-bf5b-6ab6ab22ba4d tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd75be2c-b312-4384-9bbc-09c2515fea8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:57:10 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-93634d6a-4684-48ee-bf5b-6ab6ab22ba4d tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Flow 'volume_create_manager' (2aa716a4-6feb-4f5e-bf55-6cb32de734ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:57:10 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-93634d6a-4684-48ee-bf5b-6ab6ab22ba4d tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Created volume successfully. Apr 22 17:57:11 devstack sudo[88590]: pam_unix(sudo:session): session closed for user root Apr 22 17:57:11 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-49170388-7f6d-4ed1-8b73-25590e1a0dd3 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-23d599c3-c12e-4620-8edf-7e9f34a7ad91 1073741824" returned: 0 in 0.851s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:57:11 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-49170388-7f6d-4ed1-8b73-25590e1a0dd3 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-23d599c3-c12e-4620-8edf-7e9f34a7ad91 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:57:11 devstack sudo[88596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-23d599c3-c12e-4620-8edf-7e9f34a7ad91 Apr 22 17:57:11 devstack sudo[88596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:57:12 devstack sudo[88596]: pam_unix(sudo:session): session closed for user root Apr 22 17:57:12 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-49170388-7f6d-4ed1-8b73-25590e1a0dd3 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-23d599c3-c12e-4620-8edf-7e9f34a7ad91" returned: 0 in 0.571s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:57:12 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-49170388-7f6d-4ed1-8b73-25590e1a0dd3 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] <== create_volume: return (1474ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'} {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 17:57:12 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-49170388-7f6d-4ed1-8b73-25590e1a0dd3 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.479s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:57:12 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-252f7985-af1d-4f41-83b8-d4fe3c5c7cc4 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.462s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:57:12 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-252f7985-af1d-4f41-83b8-d4fe3c5c7cc4 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:57:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-89973549',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a959699d-0396-4bc8-962d-830d918f4344,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cd098d792c4470498776cef33db9dbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:57:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:57:08Z,use_quota=True,user_id='e22bc8c7302248f1b33671862501bf0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)}" {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 17:57:12 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-252f7985-af1d-4f41-83b8-d4fe3c5c7cc4 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Creating volume a959699d-0396-4bc8-962d-830d918f4344 {{(pid=81771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 17:57:12 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-252f7985-af1d-4f41-83b8-d4fe3c5c7cc4 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:57:12 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-252f7985-af1d-4f41-83b8-d4fe3c5c7cc4 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:57:12 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-252f7985-af1d-4f41-83b8-d4fe3c5c7cc4 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:57:12 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-252f7985-af1d-4f41-83b8-d4fe3c5c7cc4 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:57:12 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-252f7985-af1d-4f41-83b8-d4fe3c5c7cc4 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:57:12 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-252f7985-af1d-4f41-83b8-d4fe3c5c7cc4 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Selected osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 as target Quobyte volume. {{(pid=81771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 17:57:12 devstack cinder-volume[81771]: INFO cinder.volume.drivers.remotefs [None req-252f7985-af1d-4f41-83b8-d4fe3c5c7cc4 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] casted to osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 Apr 22 17:57:12 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-252f7985-af1d-4f41-83b8-d4fe3c5c7cc4 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a959699d-0396-4bc8-962d-830d918f4344 1073741824 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:57:12 devstack sudo[88599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a959699d-0396-4bc8-962d-830d918f4344 1073741824 Apr 22 17:57:12 devstack sudo[88599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:57:12 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-49170388-7f6d-4ed1-8b73-25590e1a0dd3 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91e78269-85a4-4caf-9fc3-62ed05aa71ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23d599c3-c12e-4620-8edf-7e9f34a7ad91', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:57:12 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-49170388-7f6d-4ed1-8b73-25590e1a0dd3 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1587789f-c5b5-4d05-8bd2-d2308667204e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:57:12 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-49170388-7f6d-4ed1-8b73-25590e1a0dd3 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Volume volume-23d599c3-c12e-4620-8edf-7e9f34a7ad91 (23d599c3-c12e-4620-8edf-7e9f34a7ad91): created successfully Apr 22 17:57:12 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-49170388-7f6d-4ed1-8b73-25590e1a0dd3 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1587789f-c5b5-4d05-8bd2-d2308667204e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:57:12 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-49170388-7f6d-4ed1-8b73-25590e1a0dd3 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Flow 'volume_create_manager' (2b3276f1-cc44-497d-b603-c79928a0bdcf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:57:12 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-49170388-7f6d-4ed1-8b73-25590e1a0dd3 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Created volume successfully. Apr 22 17:57:12 devstack cinder-volume[81771]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd997b9e-e520-4633-953a-a540377197ff tempest-VolumesNegativeTest-739465406 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 17:57:12 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-fd997b9e-e520-4633-953a-a540377197ff tempest-VolumesNegativeTest-739465406 None] Flow 'volume_create_manager' (fcf275f7-668f-4f82-ad60-d039db5020d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:57:12 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-fd997b9e-e520-4633-953a-a540377197ff tempest-VolumesNegativeTest-739465406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af59ad83-306b-4e87-8da8-91a40d619b7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:57:12 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-fd997b9e-e520-4633-953a-a540377197ff tempest-VolumesNegativeTest-739465406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af59ad83-306b-4e87-8da8-91a40d619b7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:57:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-364547394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6054ab2f-ba89-48c4-b6b8-f52e729f6c6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccd680990e4d43ef84b8e80fbbd12cb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:57:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:57:12Z,use_quota=True,user_id='93bb34c6448647eda742ba606f16f09d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:57:12 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-fd997b9e-e520-4633-953a-a540377197ff tempest-VolumesNegativeTest-739465406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7974130-37dd-4f6b-afe9-e42a02fde45f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:57:12 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-fd997b9e-e520-4633-953a-a540377197ff tempest-VolumesNegativeTest-739465406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7974130-37dd-4f6b-afe9-e42a02fde45f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:57:12 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-fd997b9e-e520-4633-953a-a540377197ff tempest-VolumesNegativeTest-739465406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ae8df3e-d37b-4f9b-b174-405a3035b6d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:57:12 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-fd997b9e-e520-4633-953a-a540377197ff tempest-VolumesNegativeTest-739465406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ae8df3e-d37b-4f9b-b174-405a3035b6d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6054ab2f-ba89-48c4-b6b8-f52e729f6c6e', 'volume_name': 'volume-6054ab2f-ba89-48c4-b6b8-f52e729f6c6e', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:57:12 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-fd997b9e-e520-4633-953a-a540377197ff tempest-VolumesNegativeTest-739465406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ad7215a-195e-4734-a8f9-5dc7a0b88fb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:57:12 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-fd997b9e-e520-4633-953a-a540377197ff tempest-VolumesNegativeTest-739465406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ad7215a-195e-4734-a8f9-5dc7a0b88fb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:57:12 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-fd997b9e-e520-4633-953a-a540377197ff tempest-VolumesNegativeTest-739465406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01dd5c36-592e-430a-8176-775fa70f6683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:57:12 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-fd997b9e-e520-4633-953a-a540377197ff tempest-VolumesNegativeTest-739465406 None] Volume 6054ab2f-ba89-48c4-b6b8-f52e729f6c6e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6054ab2f-ba89-48c4-b6b8-f52e729f6c6e', 'volume_size': 1} Apr 22 17:57:12 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-fd997b9e-e520-4633-953a-a540377197ff tempest-VolumesNegativeTest-739465406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:57:12 devstack sudo[88599]: pam_unix(sudo:session): session closed for user root Apr 22 17:57:12 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-252f7985-af1d-4f41-83b8-d4fe3c5c7cc4 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a959699d-0396-4bc8-962d-830d918f4344 1073741824" returned: 0 in 0.769s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:57:12 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-252f7985-af1d-4f41-83b8-d4fe3c5c7cc4 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a959699d-0396-4bc8-962d-830d918f4344 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:57:12 devstack sudo[88604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a959699d-0396-4bc8-962d-830d918f4344 Apr 22 17:57:12 devstack sudo[88604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:57:13 devstack sudo[88604]: pam_unix(sudo:session): session closed for user root Apr 22 17:57:13 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-252f7985-af1d-4f41-83b8-d4fe3c5c7cc4 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a959699d-0396-4bc8-962d-830d918f4344" returned: 0 in 0.499s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:57:13 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-252f7985-af1d-4f41-83b8-d4fe3c5c7cc4 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] <== create_volume: return (1333ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'} {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 17:57:13 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-252f7985-af1d-4f41-83b8-d4fe3c5c7cc4 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.335s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:57:13 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-563135f3-fe4e-4257-95bf-f9a7c55f0cf2 tempest-VolumesListTestJSON-1236832366 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.662s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:57:13 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-563135f3-fe4e-4257-95bf-f9a7c55f0cf2 tempest-VolumesListTestJSON-1236832366 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:57:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-4137391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3362aaaa-cb65-444a-95ca-c0e578f6879a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0977cd5a6bb84876a9178299209f6aeb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:57:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:57:08Z,use_quota=True,user_id='6a5ff43f4d0e42ae8f662ed64b8b2757',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)}" {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 17:57:13 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-563135f3-fe4e-4257-95bf-f9a7c55f0cf2 tempest-VolumesListTestJSON-1236832366 None] Creating volume 3362aaaa-cb65-444a-95ca-c0e578f6879a {{(pid=81771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 17:57:13 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-563135f3-fe4e-4257-95bf-f9a7c55f0cf2 tempest-VolumesListTestJSON-1236832366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:57:13 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-563135f3-fe4e-4257-95bf-f9a7c55f0cf2 tempest-VolumesListTestJSON-1236832366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:57:13 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-563135f3-fe4e-4257-95bf-f9a7c55f0cf2 tempest-VolumesListTestJSON-1236832366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:57:13 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-563135f3-fe4e-4257-95bf-f9a7c55f0cf2 tempest-VolumesListTestJSON-1236832366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:57:13 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-563135f3-fe4e-4257-95bf-f9a7c55f0cf2 tempest-VolumesListTestJSON-1236832366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:57:13 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-563135f3-fe4e-4257-95bf-f9a7c55f0cf2 tempest-VolumesListTestJSON-1236832366 None] Selected osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 as target Quobyte volume. {{(pid=81771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 17:57:13 devstack cinder-volume[81771]: INFO cinder.volume.drivers.remotefs [None req-563135f3-fe4e-4257-95bf-f9a7c55f0cf2 tempest-VolumesListTestJSON-1236832366 None] casted to osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 Apr 22 17:57:13 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-563135f3-fe4e-4257-95bf-f9a7c55f0cf2 tempest-VolumesListTestJSON-1236832366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-3362aaaa-cb65-444a-95ca-c0e578f6879a 1073741824 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:57:13 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-252f7985-af1d-4f41-83b8-d4fe3c5c7cc4 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38fb2266-fc8b-4ad1-b22d-6e8485f9e810) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a959699d-0396-4bc8-962d-830d918f4344', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:57:13 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-252f7985-af1d-4f41-83b8-d4fe3c5c7cc4 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e31f275b-62dc-4259-bc5f-f5f2c46ffd0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:57:13 devstack sudo[88607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-3362aaaa-cb65-444a-95ca-c0e578f6879a 1073741824 Apr 22 17:57:13 devstack sudo[88607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:57:13 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-252f7985-af1d-4f41-83b8-d4fe3c5c7cc4 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Volume volume-a959699d-0396-4bc8-962d-830d918f4344 (a959699d-0396-4bc8-962d-830d918f4344): created successfully Apr 22 17:57:13 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-252f7985-af1d-4f41-83b8-d4fe3c5c7cc4 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e31f275b-62dc-4259-bc5f-f5f2c46ffd0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:57:13 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-252f7985-af1d-4f41-83b8-d4fe3c5c7cc4 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Flow 'volume_create_manager' (2786565c-78a9-48d2-9278-ae220895a981) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:57:13 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-252f7985-af1d-4f41-83b8-d4fe3c5c7cc4 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Created volume successfully. Apr 22 17:57:14 devstack sudo[88607]: pam_unix(sudo:session): session closed for user root Apr 22 17:57:14 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-563135f3-fe4e-4257-95bf-f9a7c55f0cf2 tempest-VolumesListTestJSON-1236832366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-3362aaaa-cb65-444a-95ca-c0e578f6879a 1073741824" returned: 0 in 0.805s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:57:14 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-563135f3-fe4e-4257-95bf-f9a7c55f0cf2 tempest-VolumesListTestJSON-1236832366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-3362aaaa-cb65-444a-95ca-c0e578f6879a {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:57:14 devstack sudo[88614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-3362aaaa-cb65-444a-95ca-c0e578f6879a Apr 22 17:57:14 devstack sudo[88614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:57:14 devstack sudo[88614]: pam_unix(sudo:session): session closed for user root Apr 22 17:57:14 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-563135f3-fe4e-4257-95bf-f9a7c55f0cf2 tempest-VolumesListTestJSON-1236832366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-3362aaaa-cb65-444a-95ca-c0e578f6879a" returned: 0 in 0.535s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:57:14 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-563135f3-fe4e-4257-95bf-f9a7c55f0cf2 tempest-VolumesListTestJSON-1236832366 None] <== create_volume: return (1385ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'} {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 17:57:14 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-563135f3-fe4e-4257-95bf-f9a7c55f0cf2 tempest-VolumesListTestJSON-1236832366 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.387s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:57:14 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-146108b7-0197-420d-b406-537f76d74889 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.946s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:57:14 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-146108b7-0197-420d-b406-537f76d74889 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:57:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1155858732',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6cd2de8-bc7b-4fd8-8b1d-36a941d6da66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cd098d792c4470498776cef33db9dbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:57:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:57:09Z,use_quota=True,user_id='e22bc8c7302248f1b33671862501bf0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)}" {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 17:57:14 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-146108b7-0197-420d-b406-537f76d74889 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Creating volume c6cd2de8-bc7b-4fd8-8b1d-36a941d6da66 {{(pid=81771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 17:57:14 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-146108b7-0197-420d-b406-537f76d74889 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:57:14 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-146108b7-0197-420d-b406-537f76d74889 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:57:14 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-146108b7-0197-420d-b406-537f76d74889 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:57:14 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-146108b7-0197-420d-b406-537f76d74889 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:57:14 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-146108b7-0197-420d-b406-537f76d74889 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:57:14 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-146108b7-0197-420d-b406-537f76d74889 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Selected osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 as target Quobyte volume. {{(pid=81771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 17:57:14 devstack cinder-volume[81771]: INFO cinder.volume.drivers.remotefs [None req-146108b7-0197-420d-b406-537f76d74889 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] casted to osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 Apr 22 17:57:14 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-146108b7-0197-420d-b406-537f76d74889 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-c6cd2de8-bc7b-4fd8-8b1d-36a941d6da66 1073741824 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:57:14 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-563135f3-fe4e-4257-95bf-f9a7c55f0cf2 tempest-VolumesListTestJSON-1236832366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea871844-bab6-4ea1-b4e7-3fa40c9a5e30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3362aaaa-cb65-444a-95ca-c0e578f6879a', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:57:14 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-563135f3-fe4e-4257-95bf-f9a7c55f0cf2 tempest-VolumesListTestJSON-1236832366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (232a0c0d-8a57-4e68-a587-745ee1678aec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:57:14 devstack sudo[88617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-c6cd2de8-bc7b-4fd8-8b1d-36a941d6da66 1073741824 Apr 22 17:57:14 devstack sudo[88617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:57:14 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-563135f3-fe4e-4257-95bf-f9a7c55f0cf2 tempest-VolumesListTestJSON-1236832366 None] Volume volume-3362aaaa-cb65-444a-95ca-c0e578f6879a (3362aaaa-cb65-444a-95ca-c0e578f6879a): created successfully Apr 22 17:57:14 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-563135f3-fe4e-4257-95bf-f9a7c55f0cf2 tempest-VolumesListTestJSON-1236832366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (232a0c0d-8a57-4e68-a587-745ee1678aec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:57:14 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-563135f3-fe4e-4257-95bf-f9a7c55f0cf2 tempest-VolumesListTestJSON-1236832366 None] Flow 'volume_create_manager' (f8b6becd-c92b-41c1-8824-18daaa6f9887) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:57:14 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-563135f3-fe4e-4257-95bf-f9a7c55f0cf2 tempest-VolumesListTestJSON-1236832366 None] Created volume successfully. Apr 22 17:57:15 devstack sudo[88617]: pam_unix(sudo:session): session closed for user root Apr 22 17:57:15 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-146108b7-0197-420d-b406-537f76d74889 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-c6cd2de8-bc7b-4fd8-8b1d-36a941d6da66 1073741824" returned: 0 in 0.730s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:57:15 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-146108b7-0197-420d-b406-537f76d74889 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-c6cd2de8-bc7b-4fd8-8b1d-36a941d6da66 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:57:15 devstack sudo[88622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-c6cd2de8-bc7b-4fd8-8b1d-36a941d6da66 Apr 22 17:57:15 devstack sudo[88622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:57:16 devstack sudo[88622]: pam_unix(sudo:session): session closed for user root Apr 22 17:57:16 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-146108b7-0197-420d-b406-537f76d74889 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-c6cd2de8-bc7b-4fd8-8b1d-36a941d6da66" returned: 0 in 0.536s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:57:16 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-146108b7-0197-420d-b406-537f76d74889 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] <== create_volume: return (1312ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'} {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 17:57:16 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-146108b7-0197-420d-b406-537f76d74889 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.316s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:57:16 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-fd997b9e-e520-4633-953a-a540377197ff tempest-VolumesNegativeTest-739465406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.364s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:57:16 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-fd997b9e-e520-4633-953a-a540377197ff tempest-VolumesNegativeTest-739465406 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:57:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-364547394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6054ab2f-ba89-48c4-b6b8-f52e729f6c6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccd680990e4d43ef84b8e80fbbd12cb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:57:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:57:12Z,use_quota=True,user_id='93bb34c6448647eda742ba606f16f09d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)}" {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 17:57:16 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-fd997b9e-e520-4633-953a-a540377197ff tempest-VolumesNegativeTest-739465406 None] Creating volume 6054ab2f-ba89-48c4-b6b8-f52e729f6c6e {{(pid=81771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 17:57:16 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-fd997b9e-e520-4633-953a-a540377197ff tempest-VolumesNegativeTest-739465406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:57:16 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-fd997b9e-e520-4633-953a-a540377197ff tempest-VolumesNegativeTest-739465406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:57:16 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-fd997b9e-e520-4633-953a-a540377197ff tempest-VolumesNegativeTest-739465406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:57:16 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-fd997b9e-e520-4633-953a-a540377197ff tempest-VolumesNegativeTest-739465406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:57:16 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-fd997b9e-e520-4633-953a-a540377197ff tempest-VolumesNegativeTest-739465406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:57:16 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-fd997b9e-e520-4633-953a-a540377197ff tempest-VolumesNegativeTest-739465406 None] Selected osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 as target Quobyte volume. {{(pid=81771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 17:57:16 devstack cinder-volume[81771]: INFO cinder.volume.drivers.remotefs [None req-fd997b9e-e520-4633-953a-a540377197ff tempest-VolumesNegativeTest-739465406 None] casted to osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 Apr 22 17:57:16 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-fd997b9e-e520-4633-953a-a540377197ff tempest-VolumesNegativeTest-739465406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-6054ab2f-ba89-48c4-b6b8-f52e729f6c6e 1073741824 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:57:16 devstack sudo[88625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-6054ab2f-ba89-48c4-b6b8-f52e729f6c6e 1073741824 Apr 22 17:57:16 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-146108b7-0197-420d-b406-537f76d74889 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7929b38-3dff-47cf-aac9-6a88dd3a7929) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6cd2de8-bc7b-4fd8-8b1d-36a941d6da66', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:57:16 devstack sudo[88625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:57:16 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-146108b7-0197-420d-b406-537f76d74889 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fbaa318-c730-4c02-8338-aaababf8b920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:57:16 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-146108b7-0197-420d-b406-537f76d74889 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Volume volume-c6cd2de8-bc7b-4fd8-8b1d-36a941d6da66 (c6cd2de8-bc7b-4fd8-8b1d-36a941d6da66): created successfully Apr 22 17:57:16 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-146108b7-0197-420d-b406-537f76d74889 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fbaa318-c730-4c02-8338-aaababf8b920) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:57:16 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-146108b7-0197-420d-b406-537f76d74889 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Flow 'volume_create_manager' (18c1dedd-f19a-4cd8-9173-21d24f8d0304) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:57:16 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-146108b7-0197-420d-b406-537f76d74889 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Created volume successfully. Apr 22 17:57:16 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-94e691ca-d4d1-4022-9034-9ce1d5013d02 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Acquiring lock "cinder-c6cd2de8-bc7b-4fd8-8b1d-36a941d6da66-delete_volume" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:57:16 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-94e691ca-d4d1-4022-9034-9ce1d5013d02 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Lock "cinder-c6cd2de8-bc7b-4fd8-8b1d-36a941d6da66-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:57:16 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-94e691ca-d4d1-4022-9034-9ce1d5013d02 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Acquiring lock "cinder-quobyte-c6cd2de8-bc7b-4fd8-8b1d-36a941d6da66" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:57:16 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-94e691ca-d4d1-4022-9034-9ce1d5013d02 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Lock "cinder-quobyte-c6cd2de8-bc7b-4fd8-8b1d-36a941d6da66" acquired by "delete_volume" :: waited 0.022s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:57:16 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b7201a1-1255-4135-a7d8-7e11fa2327dc]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:57:16 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-94e691ca-d4d1-4022-9034-9ce1d5013d02 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-c6cd2de8-bc7b-4fd8-8b1d-36a941d6da66 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:57:16 devstack sudo[88629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-c6cd2de8-bc7b-4fd8-8b1d-36a941d6da66 Apr 22 17:57:16 devstack sudo[88629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:57:16 devstack sudo[88625]: pam_unix(sudo:session): session closed for user root Apr 22 17:57:16 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-fd997b9e-e520-4633-953a-a540377197ff tempest-VolumesNegativeTest-739465406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-6054ab2f-ba89-48c4-b6b8-f52e729f6c6e 1073741824" returned: 0 in 0.850s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:57:16 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-fd997b9e-e520-4633-953a-a540377197ff tempest-VolumesNegativeTest-739465406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-6054ab2f-ba89-48c4-b6b8-f52e729f6c6e {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:57:17 devstack sudo[88632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-6054ab2f-ba89-48c4-b6b8-f52e729f6c6e Apr 22 17:57:17 devstack sudo[88632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:57:17 devstack sudo[88629]: pam_unix(sudo:session): session closed for user root Apr 22 17:57:17 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-94e691ca-d4d1-4022-9034-9ce1d5013d02 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-c6cd2de8-bc7b-4fd8-8b1d-36a941d6da66" returned: 0 in 0.728s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:57:17 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-94e691ca-d4d1-4022-9034-9ce1d5013d02 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-c6cd2de8-bc7b-4fd8-8b1d-36a941d6da66 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:57:17 devstack sudo[88638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-c6cd2de8-bc7b-4fd8-8b1d-36a941d6da66 Apr 22 17:57:17 devstack sudo[88638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:57:17 devstack sudo[88632]: pam_unix(sudo:session): session closed for user root Apr 22 17:57:17 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-fd997b9e-e520-4633-953a-a540377197ff tempest-VolumesNegativeTest-739465406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-6054ab2f-ba89-48c4-b6b8-f52e729f6c6e" returned: 0 in 0.718s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:57:17 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-fd997b9e-e520-4633-953a-a540377197ff tempest-VolumesNegativeTest-739465406 None] <== create_volume: return (1619ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'} {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 17:57:17 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-fd997b9e-e520-4633-953a-a540377197ff tempest-VolumesNegativeTest-739465406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.622s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:57:17 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-fd997b9e-e520-4633-953a-a540377197ff tempest-VolumesNegativeTest-739465406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01dd5c36-592e-430a-8176-775fa70f6683) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6054ab2f-ba89-48c4-b6b8-f52e729f6c6e', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:57:17 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-fd997b9e-e520-4633-953a-a540377197ff tempest-VolumesNegativeTest-739465406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f777ff8-108b-4f09-b07d-3bd77867a9f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:57:17 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-fd997b9e-e520-4633-953a-a540377197ff tempest-VolumesNegativeTest-739465406 None] Volume volume-6054ab2f-ba89-48c4-b6b8-f52e729f6c6e (6054ab2f-ba89-48c4-b6b8-f52e729f6c6e): created successfully Apr 22 17:57:17 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-fd997b9e-e520-4633-953a-a540377197ff tempest-VolumesNegativeTest-739465406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f777ff8-108b-4f09-b07d-3bd77867a9f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:57:17 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-fd997b9e-e520-4633-953a-a540377197ff tempest-VolumesNegativeTest-739465406 None] Flow 'volume_create_manager' (fcf275f7-668f-4f82-ad60-d039db5020d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:57:17 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-fd997b9e-e520-4633-953a-a540377197ff tempest-VolumesNegativeTest-739465406 None] Created volume successfully. Apr 22 17:57:18 devstack sudo[88638]: pam_unix(sudo:session): session closed for user root Apr 22 17:57:18 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-94e691ca-d4d1-4022-9034-9ce1d5013d02 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-c6cd2de8-bc7b-4fd8-8b1d-36a941d6da66" returned: 0 in 0.724s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:57:18 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-94e691ca-d4d1-4022-9034-9ce1d5013d02 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Lock "cinder-quobyte-c6cd2de8-bc7b-4fd8-8b1d-36a941d6da66" released by "delete_volume" :: held 1.539s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:57:18 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-94e691ca-d4d1-4022-9034-9ce1d5013d02 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Created reservations ['ff4c48ac-20a2-4e22-a43e-08339cfe5b50', '9f09c9cc-d331-43e3-8f83-5f377207af1d', '2367398c-91a0-4a9a-bdd0-d1143901c0e6', 'af5a8893-7262-4d48-b0de-bdfc6dde49d7'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 17:57:18 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-94e691ca-d4d1-4022-9034-9ce1d5013d02 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:57:18 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-94e691ca-d4d1-4022-9034-9ce1d5013d02 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:57:18 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-94e691ca-d4d1-4022-9034-9ce1d5013d02 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:57:18 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-94e691ca-d4d1-4022-9034-9ce1d5013d02 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:57:18 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-94e691ca-d4d1-4022-9034-9ce1d5013d02 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:57:18 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-94e691ca-d4d1-4022-9034-9ce1d5013d02 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:57:18 devstack sudo[88642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 Apr 22 17:57:18 devstack sudo[88642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:57:18 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-1db9535f-af8f-42e8-b904-483afb1d3195 tempest-VolumesListTestJSON-1236832366 None] Acquiring lock "cinder-3362aaaa-cb65-444a-95ca-c0e578f6879a-delete_volume" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:57:18 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-1db9535f-af8f-42e8-b904-483afb1d3195 tempest-VolumesListTestJSON-1236832366 None] Lock "cinder-3362aaaa-cb65-444a-95ca-c0e578f6879a-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:57:18 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-1db9535f-af8f-42e8-b904-483afb1d3195 tempest-VolumesListTestJSON-1236832366 None] Acquiring lock "cinder-quobyte-3362aaaa-cb65-444a-95ca-c0e578f6879a" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:57:18 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-1db9535f-af8f-42e8-b904-483afb1d3195 tempest-VolumesListTestJSON-1236832366 None] Lock "cinder-quobyte-3362aaaa-cb65-444a-95ca-c0e578f6879a" acquired by "delete_volume" :: waited 0.024s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:57:18 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[20c415c3-095e-43ec-854c-399ff6700e60]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:57:18 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-1db9535f-af8f-42e8-b904-483afb1d3195 tempest-VolumesListTestJSON-1236832366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-3362aaaa-cb65-444a-95ca-c0e578f6879a {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:57:18 devstack sudo[88644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-3362aaaa-cb65-444a-95ca-c0e578f6879a Apr 22 17:57:18 devstack sudo[88644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:57:18 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-9c770230-28a5-41ac-adc6-12371ddf3128 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Acquiring lock "cinder-a959699d-0396-4bc8-962d-830d918f4344-delete_volume" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:57:18 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-9c770230-28a5-41ac-adc6-12371ddf3128 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Lock "cinder-a959699d-0396-4bc8-962d-830d918f4344-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:57:18 devstack sudo[88642]: pam_unix(sudo:session): session closed for user root Apr 22 17:57:18 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-94e691ca-d4d1-4022-9034-9ce1d5013d02 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33" returned: 0 in 0.575s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:57:18 devstack cinder-volume[81771]: DEBUG cinder.manager [None req-94e691ca-d4d1-4022-9034-9ce1d5013d02 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Notifying Schedulers of capabilities ... {{(pid=81771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 17:57:18 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-94e691ca-d4d1-4022-9034-9ce1d5013d02 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Deleted volume successfully. Apr 22 17:57:18 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-94e691ca-d4d1-4022-9034-9ce1d5013d02 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Lock "cinder-c6cd2de8-bc7b-4fd8-8b1d-36a941d6da66-delete_volume" released by "delete_volume" :: held 2.416s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:57:18 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-9c770230-28a5-41ac-adc6-12371ddf3128 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Acquiring lock "cinder-quobyte-a959699d-0396-4bc8-962d-830d918f4344" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:57:18 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-9c770230-28a5-41ac-adc6-12371ddf3128 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Lock "cinder-quobyte-a959699d-0396-4bc8-962d-830d918f4344" acquired by "delete_volume" :: waited 0.017s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:57:18 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba3c16b0-d636-4dbc-b5f2-5c84a4207718]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:57:18 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-9c770230-28a5-41ac-adc6-12371ddf3128 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a959699d-0396-4bc8-962d-830d918f4344 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:57:19 devstack sudo[88647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a959699d-0396-4bc8-962d-830d918f4344 Apr 22 17:57:19 devstack sudo[88647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:57:19 devstack sudo[88644]: pam_unix(sudo:session): session closed for user root Apr 22 17:57:19 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-1db9535f-af8f-42e8-b904-483afb1d3195 tempest-VolumesListTestJSON-1236832366 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-3362aaaa-cb65-444a-95ca-c0e578f6879a" returned: 0 in 0.741s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:57:19 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-1db9535f-af8f-42e8-b904-483afb1d3195 tempest-VolumesListTestJSON-1236832366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-3362aaaa-cb65-444a-95ca-c0e578f6879a {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:57:19 devstack sudo[88652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-3362aaaa-cb65-444a-95ca-c0e578f6879a Apr 22 17:57:19 devstack sudo[88652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:57:19 devstack sudo[88647]: pam_unix(sudo:session): session closed for user root Apr 22 17:57:19 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-9c770230-28a5-41ac-adc6-12371ddf3128 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a959699d-0396-4bc8-962d-830d918f4344" returned: 0 in 0.679s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:57:19 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-9c770230-28a5-41ac-adc6-12371ddf3128 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a959699d-0396-4bc8-962d-830d918f4344 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:57:19 devstack sudo[88660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a959699d-0396-4bc8-962d-830d918f4344 Apr 22 17:57:19 devstack sudo[88660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:57:19 devstack sudo[88652]: pam_unix(sudo:session): session closed for user root Apr 22 17:57:19 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-1db9535f-af8f-42e8-b904-483afb1d3195 tempest-VolumesListTestJSON-1236832366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-3362aaaa-cb65-444a-95ca-c0e578f6879a" returned: 0 in 0.622s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:57:19 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-1db9535f-af8f-42e8-b904-483afb1d3195 tempest-VolumesListTestJSON-1236832366 None] Lock "cinder-quobyte-3362aaaa-cb65-444a-95ca-c0e578f6879a" released by "delete_volume" :: held 1.413s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:57:19 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-1db9535f-af8f-42e8-b904-483afb1d3195 tempest-VolumesListTestJSON-1236832366 None] Created reservations ['a2e81a69-8e6b-4a6b-a47c-74b3cec75d52', 'cbac064e-5e84-4498-a8e4-a425865e7df4', '52a4efd2-94b7-4769-b335-dcfa15b1931f', 'c7698993-42b6-4346-b4eb-67395f335c31'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 17:57:20 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-1db9535f-af8f-42e8-b904-483afb1d3195 tempest-VolumesListTestJSON-1236832366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:57:20 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-1db9535f-af8f-42e8-b904-483afb1d3195 tempest-VolumesListTestJSON-1236832366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:57:20 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-1db9535f-af8f-42e8-b904-483afb1d3195 tempest-VolumesListTestJSON-1236832366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:57:20 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-1db9535f-af8f-42e8-b904-483afb1d3195 tempest-VolumesListTestJSON-1236832366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:57:20 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-1db9535f-af8f-42e8-b904-483afb1d3195 tempest-VolumesListTestJSON-1236832366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:57:20 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-1db9535f-af8f-42e8-b904-483afb1d3195 tempest-VolumesListTestJSON-1236832366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:57:20 devstack sudo[88663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 Apr 22 17:57:20 devstack sudo[88663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:57:20 devstack sudo[88660]: pam_unix(sudo:session): session closed for user root Apr 22 17:57:20 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-9c770230-28a5-41ac-adc6-12371ddf3128 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a959699d-0396-4bc8-962d-830d918f4344" returned: 0 in 0.715s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:57:20 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-9c770230-28a5-41ac-adc6-12371ddf3128 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Lock "cinder-quobyte-a959699d-0396-4bc8-962d-830d918f4344" released by "delete_volume" :: held 1.474s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:57:20 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-9c770230-28a5-41ac-adc6-12371ddf3128 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Created reservations ['ea77c726-50e1-476e-813c-5f399b7f7bb8', 'f0b7f29f-79c5-410f-a1db-e917ba232bc8', 'b817ca36-874d-41a1-b739-304c2639358c', 'cba90b3b-139d-4217-9344-3c0719645238'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 17:57:20 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-9c770230-28a5-41ac-adc6-12371ddf3128 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:57:20 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-9c770230-28a5-41ac-adc6-12371ddf3128 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:57:20 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-9c770230-28a5-41ac-adc6-12371ddf3128 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:57:20 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-9c770230-28a5-41ac-adc6-12371ddf3128 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:57:20 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-9c770230-28a5-41ac-adc6-12371ddf3128 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:57:20 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-9c770230-28a5-41ac-adc6-12371ddf3128 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:57:20 devstack sudo[88670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 Apr 22 17:57:20 devstack sudo[88670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:57:20 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-cca82518-7a7c-497b-94ee-bc3f22a31e35 tempest-VolumesListTestJSON-1236832366 None] Acquiring lock "cinder-a26762eb-85c8-41f4-bb89-1eca772c933a-delete_volume" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:57:20 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-cca82518-7a7c-497b-94ee-bc3f22a31e35 tempest-VolumesListTestJSON-1236832366 None] Lock "cinder-a26762eb-85c8-41f4-bb89-1eca772c933a-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:57:20 devstack sudo[88663]: pam_unix(sudo:session): session closed for user root Apr 22 17:57:20 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-cca82518-7a7c-497b-94ee-bc3f22a31e35 tempest-VolumesListTestJSON-1236832366 None] Acquiring lock "cinder-quobyte-a26762eb-85c8-41f4-bb89-1eca772c933a" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:57:20 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-1db9535f-af8f-42e8-b904-483afb1d3195 tempest-VolumesListTestJSON-1236832366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33" returned: 0 in 0.757s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:57:20 devstack cinder-volume[81771]: DEBUG cinder.manager [None req-1db9535f-af8f-42e8-b904-483afb1d3195 tempest-VolumesListTestJSON-1236832366 None] Notifying Schedulers of capabilities ... {{(pid=81771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 17:57:20 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-1db9535f-af8f-42e8-b904-483afb1d3195 tempest-VolumesListTestJSON-1236832366 None] Deleted volume successfully. Apr 22 17:57:20 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-cca82518-7a7c-497b-94ee-bc3f22a31e35 tempest-VolumesListTestJSON-1236832366 None] Lock "cinder-quobyte-a26762eb-85c8-41f4-bb89-1eca772c933a" acquired by "delete_volume" :: waited 0.046s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:57:20 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-1db9535f-af8f-42e8-b904-483afb1d3195 tempest-VolumesListTestJSON-1236832366 None] Lock "cinder-3362aaaa-cb65-444a-95ca-c0e578f6879a-delete_volume" released by "delete_volume" :: held 2.502s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:57:20 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[9100e532-4097-4196-86a6-4be1ac6bba3d]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:57:20 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-cca82518-7a7c-497b-94ee-bc3f22a31e35 tempest-VolumesListTestJSON-1236832366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a26762eb-85c8-41f4-bb89-1eca772c933a {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:57:21 devstack sudo[88672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a26762eb-85c8-41f4-bb89-1eca772c933a Apr 22 17:57:21 devstack sudo[88672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:57:21 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-eeae6074-73ff-4903-9651-2b56c597bc6b tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Acquiring lock "cinder-23d599c3-c12e-4620-8edf-7e9f34a7ad91-delete_volume" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:57:21 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-eeae6074-73ff-4903-9651-2b56c597bc6b tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Lock "cinder-23d599c3-c12e-4620-8edf-7e9f34a7ad91-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:57:21 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-eeae6074-73ff-4903-9651-2b56c597bc6b tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Acquiring lock "cinder-quobyte-23d599c3-c12e-4620-8edf-7e9f34a7ad91" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:57:21 devstack sudo[88670]: pam_unix(sudo:session): session closed for user root Apr 22 17:57:21 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-9c770230-28a5-41ac-adc6-12371ddf3128 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33" returned: 0 in 0.727s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:57:21 devstack cinder-volume[81771]: DEBUG cinder.manager [None req-9c770230-28a5-41ac-adc6-12371ddf3128 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Notifying Schedulers of capabilities ... {{(pid=81771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 17:57:21 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-eeae6074-73ff-4903-9651-2b56c597bc6b tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Lock "cinder-quobyte-23d599c3-c12e-4620-8edf-7e9f34a7ad91" acquired by "delete_volume" :: waited 0.031s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:57:21 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-9c770230-28a5-41ac-adc6-12371ddf3128 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Deleted volume successfully. Apr 22 17:57:21 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[633bb8bd-f61b-4ec9-986e-ad6a7b7f5ebd]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:57:21 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-eeae6074-73ff-4903-9651-2b56c597bc6b tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-23d599c3-c12e-4620-8edf-7e9f34a7ad91 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:57:21 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-9c770230-28a5-41ac-adc6-12371ddf3128 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Lock "cinder-a959699d-0396-4bc8-962d-830d918f4344-delete_volume" released by "delete_volume" :: held 2.593s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:57:21 devstack sudo[88675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-23d599c3-c12e-4620-8edf-7e9f34a7ad91 Apr 22 17:57:21 devstack sudo[88675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:57:21 devstack sudo[88672]: pam_unix(sudo:session): session closed for user root Apr 22 17:57:21 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-cca82518-7a7c-497b-94ee-bc3f22a31e35 tempest-VolumesListTestJSON-1236832366 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a26762eb-85c8-41f4-bb89-1eca772c933a" returned: 0 in 0.818s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:57:21 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-cca82518-7a7c-497b-94ee-bc3f22a31e35 tempest-VolumesListTestJSON-1236832366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a26762eb-85c8-41f4-bb89-1eca772c933a {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:57:21 devstack sudo[88680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a26762eb-85c8-41f4-bb89-1eca772c933a Apr 22 17:57:21 devstack sudo[88680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:57:22 devstack sudo[88675]: pam_unix(sudo:session): session closed for user root Apr 22 17:57:22 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-eeae6074-73ff-4903-9651-2b56c597bc6b tempest-CreateVolumesFromSourceVolumeTest-413232999 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-23d599c3-c12e-4620-8edf-7e9f34a7ad91" returned: 0 in 0.733s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:57:22 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-eeae6074-73ff-4903-9651-2b56c597bc6b tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-23d599c3-c12e-4620-8edf-7e9f34a7ad91 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:57:22 devstack sudo[88685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-23d599c3-c12e-4620-8edf-7e9f34a7ad91 Apr 22 17:57:22 devstack sudo[88685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:57:22 devstack sudo[88680]: pam_unix(sudo:session): session closed for user root Apr 22 17:57:22 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-cca82518-7a7c-497b-94ee-bc3f22a31e35 tempest-VolumesListTestJSON-1236832366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a26762eb-85c8-41f4-bb89-1eca772c933a" returned: 0 in 0.585s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:57:22 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-cca82518-7a7c-497b-94ee-bc3f22a31e35 tempest-VolumesListTestJSON-1236832366 None] Lock "cinder-quobyte-a26762eb-85c8-41f4-bb89-1eca772c933a" released by "delete_volume" :: held 1.463s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:57:22 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-cca82518-7a7c-497b-94ee-bc3f22a31e35 tempest-VolumesListTestJSON-1236832366 None] Created reservations ['47d31b72-6128-44e3-a14e-31eb792d0c80', '36d34921-1a6a-4d1f-96eb-13b1bd6eeb61', 'd293d6a7-8be1-454e-993a-0184c25e1f0a', '8a299d4e-c1e2-47c1-9dd4-31885a69d1a8'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 17:57:22 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-cca82518-7a7c-497b-94ee-bc3f22a31e35 tempest-VolumesListTestJSON-1236832366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:57:22 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-cca82518-7a7c-497b-94ee-bc3f22a31e35 tempest-VolumesListTestJSON-1236832366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:57:22 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-cca82518-7a7c-497b-94ee-bc3f22a31e35 tempest-VolumesListTestJSON-1236832366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:57:22 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-cca82518-7a7c-497b-94ee-bc3f22a31e35 tempest-VolumesListTestJSON-1236832366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:57:22 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-cca82518-7a7c-497b-94ee-bc3f22a31e35 tempest-VolumesListTestJSON-1236832366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:57:22 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-cca82518-7a7c-497b-94ee-bc3f22a31e35 tempest-VolumesListTestJSON-1236832366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:57:22 devstack sudo[88688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 Apr 22 17:57:22 devstack sudo[88688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:57:22 devstack sudo[88685]: pam_unix(sudo:session): session closed for user root Apr 22 17:57:22 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-eeae6074-73ff-4903-9651-2b56c597bc6b tempest-CreateVolumesFromSourceVolumeTest-413232999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-23d599c3-c12e-4620-8edf-7e9f34a7ad91" returned: 0 in 0.582s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:57:22 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-eeae6074-73ff-4903-9651-2b56c597bc6b tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Lock "cinder-quobyte-23d599c3-c12e-4620-8edf-7e9f34a7ad91" released by "delete_volume" :: held 1.363s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:57:22 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-eeae6074-73ff-4903-9651-2b56c597bc6b tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Created reservations ['4ce7c0ec-8e65-4bde-a45b-e759d39b9922', '5966cd26-8916-4025-a99c-508ee95524ea', 'dfc510f8-2906-48b9-aa90-1333acd20515', 'a9a719b3-9ea6-4284-ab78-740c12407503'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 17:57:22 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-eeae6074-73ff-4903-9651-2b56c597bc6b tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:57:22 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-eeae6074-73ff-4903-9651-2b56c597bc6b tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:57:22 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-eeae6074-73ff-4903-9651-2b56c597bc6b tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:57:22 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-eeae6074-73ff-4903-9651-2b56c597bc6b tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:57:22 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-eeae6074-73ff-4903-9651-2b56c597bc6b tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:57:22 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-eeae6074-73ff-4903-9651-2b56c597bc6b tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:57:22 devstack sudo[88692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 Apr 22 17:57:22 devstack sudo[88692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:57:23 devstack sudo[88688]: pam_unix(sudo:session): session closed for user root Apr 22 17:57:23 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-cca82518-7a7c-497b-94ee-bc3f22a31e35 tempest-VolumesListTestJSON-1236832366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33" returned: 0 in 0.553s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:57:23 devstack cinder-volume[81771]: DEBUG cinder.manager [None req-cca82518-7a7c-497b-94ee-bc3f22a31e35 tempest-VolumesListTestJSON-1236832366 None] Notifying Schedulers of capabilities ... {{(pid=81771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 17:57:23 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-cca82518-7a7c-497b-94ee-bc3f22a31e35 tempest-VolumesListTestJSON-1236832366 None] Deleted volume successfully. Apr 22 17:57:23 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-cca82518-7a7c-497b-94ee-bc3f22a31e35 tempest-VolumesListTestJSON-1236832366 None] Lock "cinder-a26762eb-85c8-41f4-bb89-1eca772c933a-delete_volume" released by "delete_volume" :: held 2.309s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:57:23 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-a59ea14f-8d11-4d58-95ad-f46ba118f688 tempest-VolumesListTestJSON-1236832366 None] Acquiring lock "cinder-bd7fc188-8cdc-45d0-ae69-e3532734841a-delete_volume" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:57:23 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-a59ea14f-8d11-4d58-95ad-f46ba118f688 tempest-VolumesListTestJSON-1236832366 None] Lock "cinder-bd7fc188-8cdc-45d0-ae69-e3532734841a-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:57:23 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-a59ea14f-8d11-4d58-95ad-f46ba118f688 tempest-VolumesListTestJSON-1236832366 None] Acquiring lock "cinder-quobyte-bd7fc188-8cdc-45d0-ae69-e3532734841a" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:57:23 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-a59ea14f-8d11-4d58-95ad-f46ba118f688 tempest-VolumesListTestJSON-1236832366 None] Lock "cinder-quobyte-bd7fc188-8cdc-45d0-ae69-e3532734841a" acquired by "delete_volume" :: waited 0.018s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:57:23 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[870e6f69-1bd4-4741-ac19-a180da7d7bec]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:57:23 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-a59ea14f-8d11-4d58-95ad-f46ba118f688 tempest-VolumesListTestJSON-1236832366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-bd7fc188-8cdc-45d0-ae69-e3532734841a {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:57:23 devstack sudo[88694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-bd7fc188-8cdc-45d0-ae69-e3532734841a Apr 22 17:57:23 devstack sudo[88694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:57:23 devstack sudo[88692]: pam_unix(sudo:session): session closed for user root Apr 22 17:57:23 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-eeae6074-73ff-4903-9651-2b56c597bc6b tempest-CreateVolumesFromSourceVolumeTest-413232999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33" returned: 0 in 0.590s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:57:23 devstack cinder-volume[81771]: DEBUG cinder.manager [None req-eeae6074-73ff-4903-9651-2b56c597bc6b tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Notifying Schedulers of capabilities ... {{(pid=81771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 17:57:23 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-eeae6074-73ff-4903-9651-2b56c597bc6b tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Deleted volume successfully. Apr 22 17:57:23 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-eeae6074-73ff-4903-9651-2b56c597bc6b tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Lock "cinder-23d599c3-c12e-4620-8edf-7e9f34a7ad91-delete_volume" released by "delete_volume" :: held 2.243s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:57:23 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-8e5c9715-890e-4a68-879e-607f51256b2e tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Acquiring lock "cinder-63f19ffe-139f-4fdc-a047-7f4cd70740bb-delete_volume" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:57:23 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-8e5c9715-890e-4a68-879e-607f51256b2e tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Lock "cinder-63f19ffe-139f-4fdc-a047-7f4cd70740bb-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:57:23 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-8e5c9715-890e-4a68-879e-607f51256b2e tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Acquiring lock "cinder-quobyte-63f19ffe-139f-4fdc-a047-7f4cd70740bb" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:57:23 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-8e5c9715-890e-4a68-879e-607f51256b2e tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Lock "cinder-quobyte-63f19ffe-139f-4fdc-a047-7f4cd70740bb" acquired by "delete_volume" :: waited 0.037s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:57:23 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[3589bdac-e598-4eb7-ab53-6e82c3ed18c2]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:57:23 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-8e5c9715-890e-4a68-879e-607f51256b2e tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-63f19ffe-139f-4fdc-a047-7f4cd70740bb {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:57:23 devstack sudo[88697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-63f19ffe-139f-4fdc-a047-7f4cd70740bb Apr 22 17:57:23 devstack sudo[88697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:57:23 devstack sudo[88694]: pam_unix(sudo:session): session closed for user root Apr 22 17:57:23 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-a59ea14f-8d11-4d58-95ad-f46ba118f688 tempest-VolumesListTestJSON-1236832366 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-bd7fc188-8cdc-45d0-ae69-e3532734841a" returned: 0 in 0.765s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:57:23 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-a59ea14f-8d11-4d58-95ad-f46ba118f688 tempest-VolumesListTestJSON-1236832366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-bd7fc188-8cdc-45d0-ae69-e3532734841a {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:57:24 devstack sudo[88702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-bd7fc188-8cdc-45d0-ae69-e3532734841a Apr 22 17:57:24 devstack sudo[88702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:57:24 devstack sudo[88697]: pam_unix(sudo:session): session closed for user root Apr 22 17:57:24 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-8e5c9715-890e-4a68-879e-607f51256b2e tempest-CreateVolumesFromSourceVolumeTest-413232999 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-63f19ffe-139f-4fdc-a047-7f4cd70740bb" returned: 0 in 0.726s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:57:24 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-8e5c9715-890e-4a68-879e-607f51256b2e tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-63f19ffe-139f-4fdc-a047-7f4cd70740bb {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:57:24 devstack sudo[88707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-63f19ffe-139f-4fdc-a047-7f4cd70740bb Apr 22 17:57:24 devstack sudo[88707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:57:24 devstack sudo[88702]: pam_unix(sudo:session): session closed for user root Apr 22 17:57:24 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-a59ea14f-8d11-4d58-95ad-f46ba118f688 tempest-VolumesListTestJSON-1236832366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-bd7fc188-8cdc-45d0-ae69-e3532734841a" returned: 0 in 0.684s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:57:24 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-a59ea14f-8d11-4d58-95ad-f46ba118f688 tempest-VolumesListTestJSON-1236832366 None] Lock "cinder-quobyte-bd7fc188-8cdc-45d0-ae69-e3532734841a" released by "delete_volume" :: held 1.509s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:57:24 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-a59ea14f-8d11-4d58-95ad-f46ba118f688 tempest-VolumesListTestJSON-1236832366 None] Created reservations ['136e4229-a1ba-4aa7-98fc-f3f49f623f65', '05121e08-2ae2-4a01-ab59-bc914de0a756', 'f172f825-bf65-4add-8249-6b6fcee68901', 'e065bdd1-0b01-487a-8052-8394ad3874b1'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 17:57:24 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-a59ea14f-8d11-4d58-95ad-f46ba118f688 tempest-VolumesListTestJSON-1236832366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:57:24 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-a59ea14f-8d11-4d58-95ad-f46ba118f688 tempest-VolumesListTestJSON-1236832366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:57:24 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-a59ea14f-8d11-4d58-95ad-f46ba118f688 tempest-VolumesListTestJSON-1236832366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:57:24 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-a59ea14f-8d11-4d58-95ad-f46ba118f688 tempest-VolumesListTestJSON-1236832366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:57:24 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-a59ea14f-8d11-4d58-95ad-f46ba118f688 tempest-VolumesListTestJSON-1236832366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:57:24 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-a59ea14f-8d11-4d58-95ad-f46ba118f688 tempest-VolumesListTestJSON-1236832366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:57:24 devstack sudo[88710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 Apr 22 17:57:24 devstack sudo[88710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:57:25 devstack sudo[88707]: pam_unix(sudo:session): session closed for user root Apr 22 17:57:25 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-8e5c9715-890e-4a68-879e-607f51256b2e tempest-CreateVolumesFromSourceVolumeTest-413232999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-63f19ffe-139f-4fdc-a047-7f4cd70740bb" returned: 0 in 0.567s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:57:25 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-8e5c9715-890e-4a68-879e-607f51256b2e tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Lock "cinder-quobyte-63f19ffe-139f-4fdc-a047-7f4cd70740bb" released by "delete_volume" :: held 1.391s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:57:25 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-8e5c9715-890e-4a68-879e-607f51256b2e tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Created reservations ['120cdea4-b07c-416b-ad17-8fc62045f3ae', 'dee25638-28fc-4e62-9d88-4b7e6cb39d73', '7a64225d-592f-48a7-ae5f-a011f6eadeb3', '0ef103ed-34db-4293-9ed5-2c85962cd17b'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 17:57:25 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-8e5c9715-890e-4a68-879e-607f51256b2e tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:57:25 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-8e5c9715-890e-4a68-879e-607f51256b2e tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:57:25 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-8e5c9715-890e-4a68-879e-607f51256b2e tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:57:25 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-8e5c9715-890e-4a68-879e-607f51256b2e tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:57:25 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-8e5c9715-890e-4a68-879e-607f51256b2e tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:57:25 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-8e5c9715-890e-4a68-879e-607f51256b2e tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:57:25 devstack sudo[88713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 Apr 22 17:57:25 devstack sudo[88713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:57:25 devstack sudo[88710]: pam_unix(sudo:session): session closed for user root Apr 22 17:57:25 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-a59ea14f-8d11-4d58-95ad-f46ba118f688 tempest-VolumesListTestJSON-1236832366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33" returned: 0 in 0.910s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:57:25 devstack cinder-volume[81771]: DEBUG cinder.manager [None req-a59ea14f-8d11-4d58-95ad-f46ba118f688 tempest-VolumesListTestJSON-1236832366 None] Notifying Schedulers of capabilities ... {{(pid=81771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 17:57:25 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-a59ea14f-8d11-4d58-95ad-f46ba118f688 tempest-VolumesListTestJSON-1236832366 None] Deleted volume successfully. Apr 22 17:57:25 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-a59ea14f-8d11-4d58-95ad-f46ba118f688 tempest-VolumesListTestJSON-1236832366 None] Lock "cinder-bd7fc188-8cdc-45d0-ae69-e3532734841a-delete_volume" released by "delete_volume" :: held 2.757s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:57:26 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-ed00e066-888c-45b0-a032-2d065bdc4eb7 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Acquiring lock "cinder-c969251a-816d-47a6-adcc-46a769634696-delete_volume" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:57:26 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-ed00e066-888c-45b0-a032-2d065bdc4eb7 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Lock "cinder-c969251a-816d-47a6-adcc-46a769634696-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:57:26 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-ed00e066-888c-45b0-a032-2d065bdc4eb7 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Acquiring lock "cinder-quobyte-c969251a-816d-47a6-adcc-46a769634696" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:57:26 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-ed00e066-888c-45b0-a032-2d065bdc4eb7 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Lock "cinder-quobyte-c969251a-816d-47a6-adcc-46a769634696" acquired by "delete_volume" :: waited 0.023s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:57:26 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[511a4831-19ef-4732-8eba-a1acce51d75a]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:57:26 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-ed00e066-888c-45b0-a032-2d065bdc4eb7 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-c969251a-816d-47a6-adcc-46a769634696 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:57:26 devstack sudo[88713]: pam_unix(sudo:session): session closed for user root Apr 22 17:57:26 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-8e5c9715-890e-4a68-879e-607f51256b2e tempest-CreateVolumesFromSourceVolumeTest-413232999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33" returned: 0 in 1.014s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:57:26 devstack cinder-volume[81771]: DEBUG cinder.manager [None req-8e5c9715-890e-4a68-879e-607f51256b2e tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Notifying Schedulers of capabilities ... {{(pid=81771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 17:57:26 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-8e5c9715-890e-4a68-879e-607f51256b2e tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Deleted volume successfully. Apr 22 17:57:26 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-8e5c9715-890e-4a68-879e-607f51256b2e tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Lock "cinder-63f19ffe-139f-4fdc-a047-7f4cd70740bb-delete_volume" released by "delete_volume" :: held 2.669s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:57:26 devstack sudo[88717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-c969251a-816d-47a6-adcc-46a769634696 Apr 22 17:57:26 devstack sudo[88717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:57:26 devstack sudo[88717]: pam_unix(sudo:session): session closed for user root Apr 22 17:57:26 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-ed00e066-888c-45b0-a032-2d065bdc4eb7 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-c969251a-816d-47a6-adcc-46a769634696" returned: 0 in 0.654s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:57:26 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-ed00e066-888c-45b0-a032-2d065bdc4eb7 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-c969251a-816d-47a6-adcc-46a769634696 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:57:26 devstack sudo[88734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-c969251a-816d-47a6-adcc-46a769634696 Apr 22 17:57:26 devstack sudo[88734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:57:27 devstack sudo[88734]: pam_unix(sudo:session): session closed for user root Apr 22 17:57:27 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-ed00e066-888c-45b0-a032-2d065bdc4eb7 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-c969251a-816d-47a6-adcc-46a769634696" returned: 0 in 0.740s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:57:27 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-ed00e066-888c-45b0-a032-2d065bdc4eb7 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Lock "cinder-quobyte-c969251a-816d-47a6-adcc-46a769634696" released by "delete_volume" :: held 1.463s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:57:27 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-ed00e066-888c-45b0-a032-2d065bdc4eb7 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Created reservations ['c944dc08-5809-4009-b54e-8c5646885d84', '6bdf10b4-6296-4a5c-ac03-94f579bf53e3', 'eec577ad-bd42-44b0-8d90-897035d49320', '011e1f74-fdc7-4c13-8e20-5fe771bb1aa2'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 17:57:27 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-ed00e066-888c-45b0-a032-2d065bdc4eb7 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:57:27 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-ed00e066-888c-45b0-a032-2d065bdc4eb7 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:57:27 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-ed00e066-888c-45b0-a032-2d065bdc4eb7 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:57:27 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-ed00e066-888c-45b0-a032-2d065bdc4eb7 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:57:27 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-ed00e066-888c-45b0-a032-2d065bdc4eb7 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:57:27 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-ed00e066-888c-45b0-a032-2d065bdc4eb7 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:57:27 devstack sudo[88741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 Apr 22 17:57:27 devstack sudo[88741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:57:28 devstack sudo[88741]: pam_unix(sudo:session): session closed for user root Apr 22 17:57:28 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-ed00e066-888c-45b0-a032-2d065bdc4eb7 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33" returned: 0 in 0.588s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:57:28 devstack cinder-volume[81771]: DEBUG cinder.manager [None req-ed00e066-888c-45b0-a032-2d065bdc4eb7 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Notifying Schedulers of capabilities ... {{(pid=81771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 17:57:28 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-aebaffa8-073f-4221-9ddd-031b86151d97 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Acquiring lock "cinder-84922fe2-85bc-4cef-8917-dfbb0a9fcaec-delete_volume" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:57:28 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-ed00e066-888c-45b0-a032-2d065bdc4eb7 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Deleted volume successfully. Apr 22 17:57:28 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-aebaffa8-073f-4221-9ddd-031b86151d97 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Lock "cinder-84922fe2-85bc-4cef-8917-dfbb0a9fcaec-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:57:28 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-ed00e066-888c-45b0-a032-2d065bdc4eb7 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Lock "cinder-c969251a-816d-47a6-adcc-46a769634696-delete_volume" released by "delete_volume" :: held 2.391s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:57:28 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-aebaffa8-073f-4221-9ddd-031b86151d97 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Acquiring lock "cinder-quobyte-84922fe2-85bc-4cef-8917-dfbb0a9fcaec" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:57:28 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-aebaffa8-073f-4221-9ddd-031b86151d97 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Lock "cinder-quobyte-84922fe2-85bc-4cef-8917-dfbb0a9fcaec" acquired by "delete_volume" :: waited 0.022s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:57:28 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[844c27ad-de31-4e23-a16a-005e4b6d213a]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:57:28 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-aebaffa8-073f-4221-9ddd-031b86151d97 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-84922fe2-85bc-4cef-8917-dfbb0a9fcaec {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:57:28 devstack sudo[88744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-84922fe2-85bc-4cef-8917-dfbb0a9fcaec Apr 22 17:57:28 devstack sudo[88744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:57:29 devstack sudo[88744]: pam_unix(sudo:session): session closed for user root Apr 22 17:57:29 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-aebaffa8-073f-4221-9ddd-031b86151d97 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-84922fe2-85bc-4cef-8917-dfbb0a9fcaec" returned: 0 in 0.754s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:57:29 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-aebaffa8-073f-4221-9ddd-031b86151d97 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-84922fe2-85bc-4cef-8917-dfbb0a9fcaec {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:57:29 devstack sudo[88750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-84922fe2-85bc-4cef-8917-dfbb0a9fcaec Apr 22 17:57:29 devstack sudo[88750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:57:29 devstack sudo[88750]: pam_unix(sudo:session): session closed for user root Apr 22 17:57:29 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-aebaffa8-073f-4221-9ddd-031b86151d97 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-84922fe2-85bc-4cef-8917-dfbb0a9fcaec" returned: 0 in 0.596s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:57:29 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-aebaffa8-073f-4221-9ddd-031b86151d97 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Lock "cinder-quobyte-84922fe2-85bc-4cef-8917-dfbb0a9fcaec" released by "delete_volume" :: held 1.407s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:57:29 devstack cinder-volume[81771]: DEBUG oslo_service.periodic_task [None req-1a7bdab5-8190-4e00-a2e2-843e5894ab49 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81771) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 22 17:57:29 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-1a7bdab5-8190-4e00-a2e2-843e5894ab49 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:57:29 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-1a7bdab5-8190-4e00-a2e2-843e5894ab49 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:57:29 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-1a7bdab5-8190-4e00-a2e2-843e5894ab49 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:57:29 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-1a7bdab5-8190-4e00-a2e2-843e5894ab49 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:57:29 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-1a7bdab5-8190-4e00-a2e2-843e5894ab49 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:57:29 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-1a7bdab5-8190-4e00-a2e2-843e5894ab49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:57:29 devstack sudo[88759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 Apr 22 17:57:29 devstack sudo[88759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:57:30 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-aebaffa8-073f-4221-9ddd-031b86151d97 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Created reservations ['f799b3b8-7126-4226-85c2-f0dfe3bf2f3b', 'ef63331c-7dbf-4471-9dbb-d777e1e45b68', 'e815c14e-b463-4331-88ab-1c4ccf97f33a', 'a5d5d404-3424-4868-94a3-132e651451a3'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 17:57:30 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-aebaffa8-073f-4221-9ddd-031b86151d97 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:57:30 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-aebaffa8-073f-4221-9ddd-031b86151d97 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:57:30 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-aebaffa8-073f-4221-9ddd-031b86151d97 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:57:30 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-aebaffa8-073f-4221-9ddd-031b86151d97 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:57:30 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-aebaffa8-073f-4221-9ddd-031b86151d97 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:57:30 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-aebaffa8-073f-4221-9ddd-031b86151d97 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:57:30 devstack sudo[88761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 Apr 22 17:57:30 devstack sudo[88761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:57:30 devstack sudo[88759]: pam_unix(sudo:session): session closed for user root Apr 22 17:57:30 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-1a7bdab5-8190-4e00-a2e2-843e5894ab49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33" returned: 0 in 0.841s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:57:30 devstack cinder-volume[81771]: DEBUG cinder.manager [None req-1a7bdab5-8190-4e00-a2e2-843e5894ab49 None None] Notifying Schedulers of capabilities ... {{(pid=81771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 17:57:31 devstack sudo[88761]: pam_unix(sudo:session): session closed for user root Apr 22 17:57:31 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-aebaffa8-073f-4221-9ddd-031b86151d97 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33" returned: 0 in 1.030s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:57:31 devstack cinder-volume[81771]: DEBUG cinder.manager [None req-aebaffa8-073f-4221-9ddd-031b86151d97 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Notifying Schedulers of capabilities ... {{(pid=81771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 17:57:31 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-aebaffa8-073f-4221-9ddd-031b86151d97 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Deleted volume successfully. Apr 22 17:57:31 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-aebaffa8-073f-4221-9ddd-031b86151d97 tempest-CreateVolumesFromSourceVolumeTest-413232999 None] Lock "cinder-84922fe2-85bc-4cef-8917-dfbb0a9fcaec-delete_volume" released by "delete_volume" :: held 2.843s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:57:35 devstack cinder-volume[81771]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c8b8503-ff93-45c6-a941-abdcb67b7eb6 tempest-VolumeDependencyTests-1342970489 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 17:57:35 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-9c8b8503-ff93-45c6-a941-abdcb67b7eb6 tempest-VolumeDependencyTests-1342970489 None] Flow 'volume_create_manager' (0dd107ae-3b92-41b1-817a-b79dd7c4da4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:57:35 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-9c8b8503-ff93-45c6-a941-abdcb67b7eb6 tempest-VolumeDependencyTests-1342970489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c153240-7d8e-4fa9-aac9-1e4be539a6e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:57:35 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-9c8b8503-ff93-45c6-a941-abdcb67b7eb6 tempest-VolumeDependencyTests-1342970489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c153240-7d8e-4fa9-aac9-1e4be539a6e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:57:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1611185429',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41cc83a1-79c3-45c2-b90d-524e07e0bc01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d3bf696f1c14db28b5f059aabc09943',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:57:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:57:35Z,use_quota=True,user_id='422aa3fabef34bd591f6367bd7cbfa6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:57:35 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-9c8b8503-ff93-45c6-a941-abdcb67b7eb6 tempest-VolumeDependencyTests-1342970489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f9c514c-0936-462d-8097-edec9cec42a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:57:35 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-9c8b8503-ff93-45c6-a941-abdcb67b7eb6 tempest-VolumeDependencyTests-1342970489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f9c514c-0936-462d-8097-edec9cec42a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:57:35 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-9c8b8503-ff93-45c6-a941-abdcb67b7eb6 tempest-VolumeDependencyTests-1342970489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10c37418-f7b7-4833-9fd8-2202195cc124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:57:35 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-9c8b8503-ff93-45c6-a941-abdcb67b7eb6 tempest-VolumeDependencyTests-1342970489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10c37418-f7b7-4833-9fd8-2202195cc124) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41cc83a1-79c3-45c2-b90d-524e07e0bc01', 'volume_name': 'volume-41cc83a1-79c3-45c2-b90d-524e07e0bc01', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:57:35 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-9c8b8503-ff93-45c6-a941-abdcb67b7eb6 tempest-VolumeDependencyTests-1342970489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51c94319-cf58-452b-be2e-d982b730876f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:57:35 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-9c8b8503-ff93-45c6-a941-abdcb67b7eb6 tempest-VolumeDependencyTests-1342970489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51c94319-cf58-452b-be2e-d982b730876f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:57:35 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-9c8b8503-ff93-45c6-a941-abdcb67b7eb6 tempest-VolumeDependencyTests-1342970489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55876bc9-a8af-42cd-9615-51c249f0b58c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:57:35 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-9c8b8503-ff93-45c6-a941-abdcb67b7eb6 tempest-VolumeDependencyTests-1342970489 None] Volume 41cc83a1-79c3-45c2-b90d-524e07e0bc01: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41cc83a1-79c3-45c2-b90d-524e07e0bc01', 'volume_size': 1} Apr 22 17:57:35 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-9c8b8503-ff93-45c6-a941-abdcb67b7eb6 tempest-VolumeDependencyTests-1342970489 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:57:35 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-9c8b8503-ff93-45c6-a941-abdcb67b7eb6 tempest-VolumeDependencyTests-1342970489 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:57:35 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-9c8b8503-ff93-45c6-a941-abdcb67b7eb6 tempest-VolumeDependencyTests-1342970489 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:57:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1611185429',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41cc83a1-79c3-45c2-b90d-524e07e0bc01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d3bf696f1c14db28b5f059aabc09943',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:57:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:57:35Z,use_quota=True,user_id='422aa3fabef34bd591f6367bd7cbfa6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)}" {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 17:57:35 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-9c8b8503-ff93-45c6-a941-abdcb67b7eb6 tempest-VolumeDependencyTests-1342970489 None] Creating volume 41cc83a1-79c3-45c2-b90d-524e07e0bc01 {{(pid=81771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 17:57:35 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-9c8b8503-ff93-45c6-a941-abdcb67b7eb6 tempest-VolumeDependencyTests-1342970489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:57:35 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-9c8b8503-ff93-45c6-a941-abdcb67b7eb6 tempest-VolumeDependencyTests-1342970489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:57:35 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-9c8b8503-ff93-45c6-a941-abdcb67b7eb6 tempest-VolumeDependencyTests-1342970489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:57:35 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-9c8b8503-ff93-45c6-a941-abdcb67b7eb6 tempest-VolumeDependencyTests-1342970489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:57:35 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-9c8b8503-ff93-45c6-a941-abdcb67b7eb6 tempest-VolumeDependencyTests-1342970489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:57:35 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-9c8b8503-ff93-45c6-a941-abdcb67b7eb6 tempest-VolumeDependencyTests-1342970489 None] Selected osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 as target Quobyte volume. {{(pid=81771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 17:57:35 devstack cinder-volume[81771]: INFO cinder.volume.drivers.remotefs [None req-9c8b8503-ff93-45c6-a941-abdcb67b7eb6 tempest-VolumeDependencyTests-1342970489 None] casted to osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 Apr 22 17:57:35 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-9c8b8503-ff93-45c6-a941-abdcb67b7eb6 tempest-VolumeDependencyTests-1342970489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-41cc83a1-79c3-45c2-b90d-524e07e0bc01 1073741824 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:57:35 devstack sudo[88766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-41cc83a1-79c3-45c2-b90d-524e07e0bc01 1073741824 Apr 22 17:57:35 devstack sudo[88766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:57:36 devstack sudo[88766]: pam_unix(sudo:session): session closed for user root Apr 22 17:57:36 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-9c8b8503-ff93-45c6-a941-abdcb67b7eb6 tempest-VolumeDependencyTests-1342970489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-41cc83a1-79c3-45c2-b90d-524e07e0bc01 1073741824" returned: 0 in 0.739s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:57:36 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-9c8b8503-ff93-45c6-a941-abdcb67b7eb6 tempest-VolumeDependencyTests-1342970489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-41cc83a1-79c3-45c2-b90d-524e07e0bc01 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:57:36 devstack sudo[88771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-41cc83a1-79c3-45c2-b90d-524e07e0bc01 Apr 22 17:57:36 devstack sudo[88771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:57:36 devstack sudo[88771]: pam_unix(sudo:session): session closed for user root Apr 22 17:57:36 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-9c8b8503-ff93-45c6-a941-abdcb67b7eb6 tempest-VolumeDependencyTests-1342970489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-41cc83a1-79c3-45c2-b90d-524e07e0bc01" returned: 0 in 0.574s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:57:36 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-9c8b8503-ff93-45c6-a941-abdcb67b7eb6 tempest-VolumeDependencyTests-1342970489 None] <== create_volume: return (1373ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'} {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 17:57:36 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-9c8b8503-ff93-45c6-a941-abdcb67b7eb6 tempest-VolumeDependencyTests-1342970489 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.377s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:57:36 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-9c8b8503-ff93-45c6-a941-abdcb67b7eb6 tempest-VolumeDependencyTests-1342970489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55876bc9-a8af-42cd-9615-51c249f0b58c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41cc83a1-79c3-45c2-b90d-524e07e0bc01', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:57:36 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-9c8b8503-ff93-45c6-a941-abdcb67b7eb6 tempest-VolumeDependencyTests-1342970489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92f82d92-da6d-4ef2-8f91-577d13e9c191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:57:37 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-9c8b8503-ff93-45c6-a941-abdcb67b7eb6 tempest-VolumeDependencyTests-1342970489 None] Volume volume-41cc83a1-79c3-45c2-b90d-524e07e0bc01 (41cc83a1-79c3-45c2-b90d-524e07e0bc01): created successfully Apr 22 17:57:37 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-9c8b8503-ff93-45c6-a941-abdcb67b7eb6 tempest-VolumeDependencyTests-1342970489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92f82d92-da6d-4ef2-8f91-577d13e9c191) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:57:37 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-9c8b8503-ff93-45c6-a941-abdcb67b7eb6 tempest-VolumeDependencyTests-1342970489 None] Flow 'volume_create_manager' (0dd107ae-3b92-41b1-817a-b79dd7c4da4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:57:37 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-9c8b8503-ff93-45c6-a941-abdcb67b7eb6 tempest-VolumeDependencyTests-1342970489 None] Created volume successfully. Apr 22 17:57:37 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-9391a59a-358b-46d2-90be-6094cd8df202 tempest-VolumeDependencyTests-1342970489 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:57:37 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-9391a59a-358b-46d2-90be-6094cd8df202 tempest-VolumeDependencyTests-1342970489 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:57:37 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-9391a59a-358b-46d2-90be-6094cd8df202 tempest-VolumeDependencyTests-1342970489 None] Creating offline snapshot c84bf4be-958b-4053-84ce-6e509b51db5a of volume 41cc83a1-79c3-45c2-b90d-524e07e0bc01 {{(pid=81771) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 22 17:57:38 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[db6bd8ba-a61f-4a0b-9524-6023d70a219f]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:57:38 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-9391a59a-358b-46d2-90be-6094cd8df202 tempest-VolumeDependencyTests-1342970489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-41cc83a1-79c3-45c2-b90d-524e07e0bc01 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:57:38 devstack sudo[88775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-41cc83a1-79c3-45c2-b90d-524e07e0bc01 Apr 22 17:57:38 devstack sudo[88775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:57:38 devstack sudo[88775]: pam_unix(sudo:session): session closed for user root Apr 22 17:57:38 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-9391a59a-358b-46d2-90be-6094cd8df202 tempest-VolumeDependencyTests-1342970489 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-41cc83a1-79c3-45c2-b90d-524e07e0bc01" returned: 0 in 0.782s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:57:38 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-9391a59a-358b-46d2-90be-6094cd8df202 tempest-VolumeDependencyTests-1342970489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-41cc83a1-79c3-45c2-b90d-524e07e0bc01,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-41cc83a1-79c3-45c2-b90d-524e07e0bc01.c84bf4be-958b-4053-84ce-6e509b51db5a 1G {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:57:38 devstack sudo[88780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-41cc83a1-79c3-45c2-b90d-524e07e0bc01,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-41cc83a1-79c3-45c2-b90d-524e07e0bc01.c84bf4be-958b-4053-84ce-6e509b51db5a 1G Apr 22 17:57:38 devstack sudo[88780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:57:39 devstack sudo[88780]: pam_unix(sudo:session): session closed for user root Apr 22 17:57:39 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-9391a59a-358b-46d2-90be-6094cd8df202 tempest-VolumeDependencyTests-1342970489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-41cc83a1-79c3-45c2-b90d-524e07e0bc01,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-41cc83a1-79c3-45c2-b90d-524e07e0bc01.c84bf4be-958b-4053-84ce-6e509b51db5a 1G" returned: 0 in 0.700s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:57:39 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-9391a59a-358b-46d2-90be-6094cd8df202 tempest-VolumeDependencyTests-1342970489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41cc83a1-79c3-45c2-b90d-524e07e0bc01 -F qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-41cc83a1-79c3-45c2-b90d-524e07e0bc01.c84bf4be-958b-4053-84ce-6e509b51db5a {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:57:39 devstack sudo[88785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41cc83a1-79c3-45c2-b90d-524e07e0bc01 -F qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-41cc83a1-79c3-45c2-b90d-524e07e0bc01.c84bf4be-958b-4053-84ce-6e509b51db5a Apr 22 17:57:39 devstack sudo[88785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:57:40 devstack sudo[88785]: pam_unix(sudo:session): session closed for user root Apr 22 17:57:40 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-9391a59a-358b-46d2-90be-6094cd8df202 tempest-VolumeDependencyTests-1342970489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41cc83a1-79c3-45c2-b90d-524e07e0bc01 -F qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-41cc83a1-79c3-45c2-b90d-524e07e0bc01.c84bf4be-958b-4053-84ce-6e509b51db5a" returned: 0 in 0.611s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:57:40 devstack cinder-volume[81771]: WARNING cinder.volume.drivers.remotefs [None req-9391a59a-358b-46d2-90be-6094cd8df202 tempest-VolumeDependencyTests-1342970489 None] /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-41cc83a1-79c3-45c2-b90d-524e07e0bc01.c84bf4be-958b-4053-84ce-6e509b51db5a is being set with open permissions: ugo+rw Apr 22 17:57:40 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-9391a59a-358b-46d2-90be-6094cd8df202 tempest-VolumeDependencyTests-1342970489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-41cc83a1-79c3-45c2-b90d-524e07e0bc01.c84bf4be-958b-4053-84ce-6e509b51db5a {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:57:40 devstack sudo[88790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-41cc83a1-79c3-45c2-b90d-524e07e0bc01.c84bf4be-958b-4053-84ce-6e509b51db5a Apr 22 17:57:40 devstack sudo[88790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:57:40 devstack sudo[88790]: pam_unix(sudo:session): session closed for user root Apr 22 17:57:40 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-9391a59a-358b-46d2-90be-6094cd8df202 tempest-VolumeDependencyTests-1342970489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-41cc83a1-79c3-45c2-b90d-524e07e0bc01.c84bf4be-958b-4053-84ce-6e509b51db5a" returned: 0 in 0.464s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:57:40 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-9391a59a-358b-46d2-90be-6094cd8df202 tempest-VolumeDependencyTests-1342970489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-41cc83a1-79c3-45c2-b90d-524e07e0bc01.info {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:57:40 devstack sudo[88793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-41cc83a1-79c3-45c2-b90d-524e07e0bc01.info Apr 22 17:57:40 devstack sudo[88793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:57:41 devstack sudo[88793]: pam_unix(sudo:session): session closed for user root Apr 22 17:57:41 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-9391a59a-358b-46d2-90be-6094cd8df202 tempest-VolumeDependencyTests-1342970489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-41cc83a1-79c3-45c2-b90d-524e07e0bc01.info" returned: 0 in 0.527s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:57:41 devstack cinder-volume[81771]: WARNING cinder.volume.drivers.remotefs [None req-9391a59a-358b-46d2-90be-6094cd8df202 tempest-VolumeDependencyTests-1342970489 None] /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-41cc83a1-79c3-45c2-b90d-524e07e0bc01.info is being set with open permissions: ugo+rw Apr 22 17:57:41 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-9391a59a-358b-46d2-90be-6094cd8df202 tempest-VolumeDependencyTests-1342970489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-41cc83a1-79c3-45c2-b90d-524e07e0bc01.info {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:57:41 devstack sudo[88796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-41cc83a1-79c3-45c2-b90d-524e07e0bc01.info Apr 22 17:57:41 devstack sudo[88796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:57:41 devstack sudo[88796]: pam_unix(sudo:session): session closed for user root Apr 22 17:57:41 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-9391a59a-358b-46d2-90be-6094cd8df202 tempest-VolumeDependencyTests-1342970489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-41cc83a1-79c3-45c2-b90d-524e07e0bc01.info" returned: 0 in 0.492s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:57:41 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-9391a59a-358b-46d2-90be-6094cd8df202 tempest-VolumeDependencyTests-1342970489 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.694s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:57:41 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-9391a59a-358b-46d2-90be-6094cd8df202 tempest-VolumeDependencyTests-1342970489 None] Create snapshot completed successfully Apr 22 17:57:42 devstack cinder-volume[81771]: DEBUG cinder.volume.flows.manager.create_volume [None req-7eab6e40-8678-423e-8bf1-0ce78a60ed70 tempest-VolumeDependencyTests-1342970489 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 17:57:42 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-7eab6e40-8678-423e-8bf1-0ce78a60ed70 tempest-VolumeDependencyTests-1342970489 None] Flow 'volume_create_manager' (5e80ddeb-179f-4394-964d-844d2fb3136e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:57:42 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-7eab6e40-8678-423e-8bf1-0ce78a60ed70 tempest-VolumeDependencyTests-1342970489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16622421-6daa-4f3a-a1c9-ed02c0fe2c85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:57:42 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-7eab6e40-8678-423e-8bf1-0ce78a60ed70 tempest-VolumeDependencyTests-1342970489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16622421-6daa-4f3a-a1c9-ed02c0fe2c85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:57:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1028045233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d24c540-8f0d-423b-aede-5c629f057998,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d3bf696f1c14db28b5f059aabc09943',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:57:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c84bf4be-958b-4053-84ce-6e509b51db5a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:57:43Z,use_quota=True,user_id='422aa3fabef34bd591f6367bd7cbfa6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:57:42 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-7eab6e40-8678-423e-8bf1-0ce78a60ed70 tempest-VolumeDependencyTests-1342970489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e480df7-02eb-455e-bcda-5a675d06447e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:57:42 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-7eab6e40-8678-423e-8bf1-0ce78a60ed70 tempest-VolumeDependencyTests-1342970489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e480df7-02eb-455e-bcda-5a675d06447e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:57:42 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-7eab6e40-8678-423e-8bf1-0ce78a60ed70 tempest-VolumeDependencyTests-1342970489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a019fb82-77bd-4b05-9fcb-747461a37dd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:57:42 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-7eab6e40-8678-423e-8bf1-0ce78a60ed70 tempest-VolumeDependencyTests-1342970489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a019fb82-77bd-4b05-9fcb-747461a37dd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6d24c540-8f0d-423b-aede-5c629f057998', 'volume_name': 'volume-6d24c540-8f0d-423b-aede-5c629f057998', 'volume_size': 1, 'snapshot_id': 'c84bf4be-958b-4053-84ce-6e509b51db5a'}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:57:42 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-7eab6e40-8678-423e-8bf1-0ce78a60ed70 tempest-VolumeDependencyTests-1342970489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82c8488d-8c8b-455f-9a5e-6d30aa3477b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:57:42 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-7eab6e40-8678-423e-8bf1-0ce78a60ed70 tempest-VolumeDependencyTests-1342970489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82c8488d-8c8b-455f-9a5e-6d30aa3477b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:57:42 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-7eab6e40-8678-423e-8bf1-0ce78a60ed70 tempest-VolumeDependencyTests-1342970489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9baa6f5b-525a-4ab6-8880-f3dceffa3d8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:57:42 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-7eab6e40-8678-423e-8bf1-0ce78a60ed70 tempest-VolumeDependencyTests-1342970489 None] Volume 6d24c540-8f0d-423b-aede-5c629f057998: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6d24c540-8f0d-423b-aede-5c629f057998', 'volume_size': 1, 'snapshot_id': 'c84bf4be-958b-4053-84ce-6e509b51db5a'} Apr 22 17:57:42 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-7eab6e40-8678-423e-8bf1-0ce78a60ed70 tempest-VolumeDependencyTests-1342970489 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:57:42 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-7eab6e40-8678-423e-8bf1-0ce78a60ed70 tempest-VolumeDependencyTests-1342970489 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:57:42 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-7eab6e40-8678-423e-8bf1-0ce78a60ed70 tempest-VolumeDependencyTests-1342970489 None] Acquiring lock "cinder-quobyte-c84bf4be-958b-4053-84ce-6e509b51db5a-6d24c540-8f0d-423b-aede-5c629f057998" by "_create_volume_from_snapshot" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:57:42 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-7eab6e40-8678-423e-8bf1-0ce78a60ed70 tempest-VolumeDependencyTests-1342970489 None] Lock "cinder-quobyte-c84bf4be-958b-4053-84ce-6e509b51db5a-6d24c540-8f0d-423b-aede-5c629f057998" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:57:42 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-7eab6e40-8678-423e-8bf1-0ce78a60ed70 tempest-VolumeDependencyTests-1342970489 None] Creating volume 6d24c540-8f0d-423b-aede-5c629f057998 from snapshot c84bf4be-958b-4053-84ce-6e509b51db5a {{(pid=81771) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 22 17:57:42 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-7eab6e40-8678-423e-8bf1-0ce78a60ed70 tempest-VolumeDependencyTests-1342970489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:57:42 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-7eab6e40-8678-423e-8bf1-0ce78a60ed70 tempest-VolumeDependencyTests-1342970489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:57:42 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-7eab6e40-8678-423e-8bf1-0ce78a60ed70 tempest-VolumeDependencyTests-1342970489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:57:42 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-7eab6e40-8678-423e-8bf1-0ce78a60ed70 tempest-VolumeDependencyTests-1342970489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:57:42 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-7eab6e40-8678-423e-8bf1-0ce78a60ed70 tempest-VolumeDependencyTests-1342970489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:57:42 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-7eab6e40-8678-423e-8bf1-0ce78a60ed70 tempest-VolumeDependencyTests-1342970489 None] Selected osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 as target Quobyte volume. {{(pid=81771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 17:57:42 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-7eab6e40-8678-423e-8bf1-0ce78a60ed70 tempest-VolumeDependencyTests-1342970489 None] Acquiring lock "cinder-quobyte-6d24c540-8f0d-423b-aede-5c629f057998" by "_copy_volume_from_snapshot" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:57:42 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-7eab6e40-8678-423e-8bf1-0ce78a60ed70 tempest-VolumeDependencyTests-1342970489 None] Lock "cinder-quobyte-6d24c540-8f0d-423b-aede-5c629f057998" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:57:42 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-7eab6e40-8678-423e-8bf1-0ce78a60ed70 tempest-VolumeDependencyTests-1342970489 None] snapshot: c84bf4be-958b-4053-84ce-6e509b51db5a, volume: 6d24c540-8f0d-423b-aede-5c629f057998, {{(pid=81771) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 22 17:57:42 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-7eab6e40-8678-423e-8bf1-0ce78a60ed70 tempest-VolumeDependencyTests-1342970489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:57:42 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-7eab6e40-8678-423e-8bf1-0ce78a60ed70 tempest-VolumeDependencyTests-1342970489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:57:42 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-7eab6e40-8678-423e-8bf1-0ce78a60ed70 tempest-VolumeDependencyTests-1342970489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:57:42 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-7eab6e40-8678-423e-8bf1-0ce78a60ed70 tempest-VolumeDependencyTests-1342970489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:57:42 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-7eab6e40-8678-423e-8bf1-0ce78a60ed70 tempest-VolumeDependencyTests-1342970489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:57:42 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d443757-836d-45bc-b84e-4d62e42a653e]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:57:42 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-7eab6e40-8678-423e-8bf1-0ce78a60ed70 tempest-VolumeDependencyTests-1342970489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-41cc83a1-79c3-45c2-b90d-524e07e0bc01.c84bf4be-958b-4053-84ce-6e509b51db5a {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:57:43 devstack sudo[88799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-41cc83a1-79c3-45c2-b90d-524e07e0bc01.c84bf4be-958b-4053-84ce-6e509b51db5a Apr 22 17:57:43 devstack sudo[88799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:57:43 devstack sudo[88799]: pam_unix(sudo:session): session closed for user root Apr 22 17:57:43 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-7eab6e40-8678-423e-8bf1-0ce78a60ed70 tempest-VolumeDependencyTests-1342970489 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-41cc83a1-79c3-45c2-b90d-524e07e0bc01.c84bf4be-958b-4053-84ce-6e509b51db5a" returned: 0 in 0.761s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:57:43 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-7eab6e40-8678-423e-8bf1-0ce78a60ed70 tempest-VolumeDependencyTests-1342970489 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-41cc83a1-79c3-45c2-b90d-524e07e0bc01(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81771) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 22 17:57:43 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-7eab6e40-8678-423e-8bf1-0ce78a60ed70 tempest-VolumeDependencyTests-1342970489 None] will copy from snapshot at /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-41cc83a1-79c3-45c2-b90d-524e07e0bc01 {{(pid=81771) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 22 17:57:43 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-7eab6e40-8678-423e-8bf1-0ce78a60ed70 tempest-VolumeDependencyTests-1342970489 None] Creating direct copy from snapshot {{(pid=81771) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 22 17:57:43 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[9782d0ee-8fa8-4615-9ce6-808b66f28549]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:57:43 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-7eab6e40-8678-423e-8bf1-0ce78a60ed70 tempest-VolumeDependencyTests-1342970489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-41cc83a1-79c3-45c2-b90d-524e07e0bc01 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:57:43 devstack sudo[88806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-41cc83a1-79c3-45c2-b90d-524e07e0bc01 Apr 22 17:57:43 devstack sudo[88806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:57:44 devstack sudo[88806]: pam_unix(sudo:session): session closed for user root Apr 22 17:57:44 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-7eab6e40-8678-423e-8bf1-0ce78a60ed70 tempest-VolumeDependencyTests-1342970489 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-41cc83a1-79c3-45c2-b90d-524e07e0bc01" returned: 0 in 0.859s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:57:44 devstack cinder-volume[81771]: DEBUG cinder.utils [None req-7eab6e40-8678-423e-8bf1-0ce78a60ed70 tempest-VolumeDependencyTests-1342970489 None] Path /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-6d24c540-8f0d-423b-aede-5c629f057998 not found in is_blk_device check {{(pid=81771) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 22 17:57:44 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-7eab6e40-8678-423e-8bf1-0ce78a60ed70 tempest-VolumeDependencyTests-1342970489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-41cc83a1-79c3-45c2-b90d-524e07e0bc01 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-6d24c540-8f0d-423b-aede-5c629f057998 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:57:44 devstack sudo[88818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-41cc83a1-79c3-45c2-b90d-524e07e0bc01 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-6d24c540-8f0d-423b-aede-5c629f057998 Apr 22 17:57:44 devstack sudo[88818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:57:50 devstack cinder-volume[81771]: DEBUG cinder.volume.flows.manager.create_volume [None req-175b34d9-7a2e-4052-b1c9-baa588fff2a5 tempest-VolumesSnapshotTestJSON-1790417655 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 17:57:50 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-175b34d9-7a2e-4052-b1c9-baa588fff2a5 tempest-VolumesSnapshotTestJSON-1790417655 None] Flow 'volume_create_manager' (3ca6f3f9-3633-4a5e-8422-f3795f2b7007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:57:50 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-175b34d9-7a2e-4052-b1c9-baa588fff2a5 tempest-VolumesSnapshotTestJSON-1790417655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dd18f10-4ccf-4580-b872-47f736b27281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:57:50 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-175b34d9-7a2e-4052-b1c9-baa588fff2a5 tempest-VolumesSnapshotTestJSON-1790417655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dd18f10-4ccf-4580-b872-47f736b27281) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:57:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-699144419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de7f585b-1457-43df-9fef-6a683d2f7884,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afd9a86ddfc94168aaf00fc1e9b425f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:57:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:57:50Z,use_quota=True,user_id='e1b4ff9f921345ce968b249e8ba0c04b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:57:50 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-175b34d9-7a2e-4052-b1c9-baa588fff2a5 tempest-VolumesSnapshotTestJSON-1790417655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93b520cd-7c69-454a-bed5-4515cd2ca7e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:57:50 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-175b34d9-7a2e-4052-b1c9-baa588fff2a5 tempest-VolumesSnapshotTestJSON-1790417655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93b520cd-7c69-454a-bed5-4515cd2ca7e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:57:50 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-175b34d9-7a2e-4052-b1c9-baa588fff2a5 tempest-VolumesSnapshotTestJSON-1790417655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbe70ec1-9b6e-47e1-884a-90ba2aaa65e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:57:50 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-175b34d9-7a2e-4052-b1c9-baa588fff2a5 tempest-VolumesSnapshotTestJSON-1790417655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbe70ec1-9b6e-47e1-884a-90ba2aaa65e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de7f585b-1457-43df-9fef-6a683d2f7884', 'volume_name': 'volume-de7f585b-1457-43df-9fef-6a683d2f7884', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:57:50 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-175b34d9-7a2e-4052-b1c9-baa588fff2a5 tempest-VolumesSnapshotTestJSON-1790417655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e81920b-cad8-43b6-bb62-7bd8782093ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:57:50 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-175b34d9-7a2e-4052-b1c9-baa588fff2a5 tempest-VolumesSnapshotTestJSON-1790417655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e81920b-cad8-43b6-bb62-7bd8782093ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:57:50 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-175b34d9-7a2e-4052-b1c9-baa588fff2a5 tempest-VolumesSnapshotTestJSON-1790417655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b03d370-24aa-4351-bfb7-f4347eada6a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:57:50 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-175b34d9-7a2e-4052-b1c9-baa588fff2a5 tempest-VolumesSnapshotTestJSON-1790417655 None] Volume de7f585b-1457-43df-9fef-6a683d2f7884: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de7f585b-1457-43df-9fef-6a683d2f7884', 'volume_size': 1} Apr 22 17:57:50 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-175b34d9-7a2e-4052-b1c9-baa588fff2a5 tempest-VolumesSnapshotTestJSON-1790417655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:57:54 devstack sudo[88818]: pam_unix(sudo:session): session closed for user root Apr 22 17:57:54 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-7eab6e40-8678-423e-8bf1-0ce78a60ed70 tempest-VolumeDependencyTests-1342970489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-41cc83a1-79c3-45c2-b90d-524e07e0bc01 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-6d24c540-8f0d-423b-aede-5c629f057998" returned: 0 in 9.685s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:57:54 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[33cf0bef-7ae7-4330-b658-b9d304ca2c55]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:57:54 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-7eab6e40-8678-423e-8bf1-0ce78a60ed70 tempest-VolumeDependencyTests-1342970489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-41cc83a1-79c3-45c2-b90d-524e07e0bc01 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:57:54 devstack sudo[88891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-41cc83a1-79c3-45c2-b90d-524e07e0bc01 Apr 22 17:57:54 devstack sudo[88891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:57:55 devstack sudo[88891]: pam_unix(sudo:session): session closed for user root Apr 22 17:57:55 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-7eab6e40-8678-423e-8bf1-0ce78a60ed70 tempest-VolumeDependencyTests-1342970489 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-41cc83a1-79c3-45c2-b90d-524e07e0bc01" returned: 0 in 1.161s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:57:55 devstack cinder-volume[81771]: DEBUG cinder.image.image_utils [None req-7eab6e40-8678-423e-8bf1-0ce78a60ed70 tempest-VolumeDependencyTests-1342970489 None] Image conversion details: src /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-41cc83a1-79c3-45c2-b90d-524e07e0bc01, size 1024.00 MB, duration 9.69 sec, destination /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-6d24c540-8f0d-423b-aede-5c629f057998 {{(pid=81771) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 22 17:57:55 devstack cinder-volume[81771]: INFO cinder.image.image_utils [None req-7eab6e40-8678-423e-8bf1-0ce78a60ed70 tempest-VolumeDependencyTests-1342970489 None] Converted 1024.00 MB image at 105.71 MB/s Apr 22 17:57:55 devstack cinder-volume[81771]: WARNING cinder.volume.drivers.remotefs [None req-7eab6e40-8678-423e-8bf1-0ce78a60ed70 tempest-VolumeDependencyTests-1342970489 None] /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-6d24c540-8f0d-423b-aede-5c629f057998 is being set with open permissions: ugo+rw Apr 22 17:57:55 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-7eab6e40-8678-423e-8bf1-0ce78a60ed70 tempest-VolumeDependencyTests-1342970489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-6d24c540-8f0d-423b-aede-5c629f057998 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:57:55 devstack sudo[88899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-6d24c540-8f0d-423b-aede-5c629f057998 Apr 22 17:57:55 devstack sudo[88899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:57:56 devstack sudo[88899]: pam_unix(sudo:session): session closed for user root Apr 22 17:57:56 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-7eab6e40-8678-423e-8bf1-0ce78a60ed70 tempest-VolumeDependencyTests-1342970489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-6d24c540-8f0d-423b-aede-5c629f057998" returned: 0 in 0.744s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:57:56 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-7eab6e40-8678-423e-8bf1-0ce78a60ed70 tempest-VolumeDependencyTests-1342970489 None] Lock "cinder-quobyte-6d24c540-8f0d-423b-aede-5c629f057998" released by "_copy_volume_from_snapshot" :: held 13.353s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:57:56 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-7eab6e40-8678-423e-8bf1-0ce78a60ed70 tempest-VolumeDependencyTests-1342970489 None] Lock "cinder-quobyte-c84bf4be-958b-4053-84ce-6e509b51db5a-6d24c540-8f0d-423b-aede-5c629f057998" released by "_create_volume_from_snapshot" :: held 13.402s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:57:56 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-7eab6e40-8678-423e-8bf1-0ce78a60ed70 tempest-VolumeDependencyTests-1342970489 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 13.424s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:57:56 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-175b34d9-7a2e-4052-b1c9-baa588fff2a5 tempest-VolumesSnapshotTestJSON-1790417655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.679s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:57:56 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-175b34d9-7a2e-4052-b1c9-baa588fff2a5 tempest-VolumesSnapshotTestJSON-1790417655 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:57:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-699144419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de7f585b-1457-43df-9fef-6a683d2f7884,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afd9a86ddfc94168aaf00fc1e9b425f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:57:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:57:50Z,use_quota=True,user_id='e1b4ff9f921345ce968b249e8ba0c04b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)}" {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 17:57:56 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-175b34d9-7a2e-4052-b1c9-baa588fff2a5 tempest-VolumesSnapshotTestJSON-1790417655 None] Creating volume de7f585b-1457-43df-9fef-6a683d2f7884 {{(pid=81771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 17:57:56 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-175b34d9-7a2e-4052-b1c9-baa588fff2a5 tempest-VolumesSnapshotTestJSON-1790417655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:57:56 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-175b34d9-7a2e-4052-b1c9-baa588fff2a5 tempest-VolumesSnapshotTestJSON-1790417655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:57:56 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-175b34d9-7a2e-4052-b1c9-baa588fff2a5 tempest-VolumesSnapshotTestJSON-1790417655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:57:56 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-175b34d9-7a2e-4052-b1c9-baa588fff2a5 tempest-VolumesSnapshotTestJSON-1790417655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:57:56 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-175b34d9-7a2e-4052-b1c9-baa588fff2a5 tempest-VolumesSnapshotTestJSON-1790417655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:57:56 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-175b34d9-7a2e-4052-b1c9-baa588fff2a5 tempest-VolumesSnapshotTestJSON-1790417655 None] Selected osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 as target Quobyte volume. {{(pid=81771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 17:57:56 devstack cinder-volume[81771]: INFO cinder.volume.drivers.remotefs [None req-175b34d9-7a2e-4052-b1c9-baa588fff2a5 tempest-VolumesSnapshotTestJSON-1790417655 None] casted to osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 Apr 22 17:57:56 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-175b34d9-7a2e-4052-b1c9-baa588fff2a5 tempest-VolumesSnapshotTestJSON-1790417655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-de7f585b-1457-43df-9fef-6a683d2f7884 1073741824 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:57:56 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-7eab6e40-8678-423e-8bf1-0ce78a60ed70 tempest-VolumeDependencyTests-1342970489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9baa6f5b-525a-4ab6-8880-f3dceffa3d8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d24c540-8f0d-423b-aede-5c629f057998', 'volume_size': 1, 'snapshot_id': 'c84bf4be-958b-4053-84ce-6e509b51db5a'}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:57:56 devstack sudo[88914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-de7f585b-1457-43df-9fef-6a683d2f7884 1073741824 Apr 22 17:57:56 devstack sudo[88914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:57:56 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-7eab6e40-8678-423e-8bf1-0ce78a60ed70 tempest-VolumeDependencyTests-1342970489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca1302c9-c691-4251-b288-bc25e40da228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:57:56 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-7eab6e40-8678-423e-8bf1-0ce78a60ed70 tempest-VolumeDependencyTests-1342970489 None] Volume volume-6d24c540-8f0d-423b-aede-5c629f057998 (6d24c540-8f0d-423b-aede-5c629f057998): created successfully Apr 22 17:57:56 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-7eab6e40-8678-423e-8bf1-0ce78a60ed70 tempest-VolumeDependencyTests-1342970489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca1302c9-c691-4251-b288-bc25e40da228) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:57:56 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-7eab6e40-8678-423e-8bf1-0ce78a60ed70 tempest-VolumeDependencyTests-1342970489 None] Flow 'volume_create_manager' (5e80ddeb-179f-4394-964d-844d2fb3136e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:57:56 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-7eab6e40-8678-423e-8bf1-0ce78a60ed70 tempest-VolumeDependencyTests-1342970489 None] Created volume successfully. Apr 22 17:57:56 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-62eb52cf-12e7-4b63-8d33-95a673fe1e3a tempest-VolumeDependencyTests-1342970489 None] Acquiring lock "cinder-c84bf4be-958b-4053-84ce-6e509b51db5a-delete_snapshot" by "delete_snapshot" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:57:56 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-62eb52cf-12e7-4b63-8d33-95a673fe1e3a tempest-VolumeDependencyTests-1342970489 None] Lock "cinder-c84bf4be-958b-4053-84ce-6e509b51db5a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:57:56 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-62eb52cf-12e7-4b63-8d33-95a673fe1e3a tempest-VolumeDependencyTests-1342970489 None] Acquiring lock "cinder-quobyte-41cc83a1-79c3-45c2-b90d-524e07e0bc01" by "delete_snapshot" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:57:56 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-62eb52cf-12e7-4b63-8d33-95a673fe1e3a tempest-VolumeDependencyTests-1342970489 None] Lock "cinder-quobyte-41cc83a1-79c3-45c2-b90d-524e07e0bc01" acquired by "delete_snapshot" :: waited 0.017s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:57:56 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-62eb52cf-12e7-4b63-8d33-95a673fe1e3a tempest-VolumeDependencyTests-1342970489 None] Acquiring lock "cinder-quobyte-c84bf4be-958b-4053-84ce-6e509b51db5a" by "_delete_snapshot" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:57:56 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-62eb52cf-12e7-4b63-8d33-95a673fe1e3a tempest-VolumeDependencyTests-1342970489 None] Lock "cinder-quobyte-c84bf4be-958b-4053-84ce-6e509b51db5a" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:57:56 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-62eb52cf-12e7-4b63-8d33-95a673fe1e3a tempest-VolumeDependencyTests-1342970489 None] Deleting offline snapshot c84bf4be-958b-4053-84ce-6e509b51db5a of volume 41cc83a1-79c3-45c2-b90d-524e07e0bc01 {{(pid=81771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 22 17:57:56 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-62eb52cf-12e7-4b63-8d33-95a673fe1e3a tempest-VolumeDependencyTests-1342970489 None] snapshot_file for this snap is: volume-41cc83a1-79c3-45c2-b90d-524e07e0bc01.c84bf4be-958b-4053-84ce-6e509b51db5a {{(pid=81771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 22 17:57:56 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9edf963-7e20-499c-acee-cb9b0b11ae4e]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:57:56 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-62eb52cf-12e7-4b63-8d33-95a673fe1e3a tempest-VolumeDependencyTests-1342970489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-41cc83a1-79c3-45c2-b90d-524e07e0bc01.c84bf4be-958b-4053-84ce-6e509b51db5a {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:57:56 devstack sudo[88933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-41cc83a1-79c3-45c2-b90d-524e07e0bc01.c84bf4be-958b-4053-84ce-6e509b51db5a Apr 22 17:57:56 devstack sudo[88933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:57:57 devstack sudo[88914]: pam_unix(sudo:session): session closed for user root Apr 22 17:57:57 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-175b34d9-7a2e-4052-b1c9-baa588fff2a5 tempest-VolumesSnapshotTestJSON-1790417655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-de7f585b-1457-43df-9fef-6a683d2f7884 1073741824" returned: 0 in 1.043s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:57:57 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-175b34d9-7a2e-4052-b1c9-baa588fff2a5 tempest-VolumesSnapshotTestJSON-1790417655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-de7f585b-1457-43df-9fef-6a683d2f7884 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:57:57 devstack sudo[88943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-de7f585b-1457-43df-9fef-6a683d2f7884 Apr 22 17:57:57 devstack sudo[88943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:57:57 devstack sudo[88933]: pam_unix(sudo:session): session closed for user root Apr 22 17:57:57 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-62eb52cf-12e7-4b63-8d33-95a673fe1e3a tempest-VolumeDependencyTests-1342970489 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-41cc83a1-79c3-45c2-b90d-524e07e0bc01.c84bf4be-958b-4053-84ce-6e509b51db5a" returned: 0 in 0.650s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:57:57 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-62eb52cf-12e7-4b63-8d33-95a673fe1e3a tempest-VolumeDependencyTests-1342970489 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-41cc83a1-79c3-45c2-b90d-524e07e0bc01(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81771) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 22 17:57:57 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bfa28c9-e564-4cd0-8f56-59e08c74c8e1]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:57:57 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-62eb52cf-12e7-4b63-8d33-95a673fe1e3a tempest-VolumeDependencyTests-1342970489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-41cc83a1-79c3-45c2-b90d-524e07e0bc01 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:57:57 devstack sudo[88945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-41cc83a1-79c3-45c2-b90d-524e07e0bc01 Apr 22 17:57:57 devstack sudo[88945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:57:57 devstack sudo[88943]: pam_unix(sudo:session): session closed for user root Apr 22 17:57:57 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-175b34d9-7a2e-4052-b1c9-baa588fff2a5 tempest-VolumesSnapshotTestJSON-1790417655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-de7f585b-1457-43df-9fef-6a683d2f7884" returned: 0 in 0.595s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:57:57 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-175b34d9-7a2e-4052-b1c9-baa588fff2a5 tempest-VolumesSnapshotTestJSON-1790417655 None] <== create_volume: return (1690ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'} {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 17:57:57 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-175b34d9-7a2e-4052-b1c9-baa588fff2a5 tempest-VolumesSnapshotTestJSON-1790417655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.709s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:57:57 devstack cinder-volume[81771]: DEBUG dbcounter [-] [81771] Writing DB stats cinder:SELECT=84,cinder:INSERT=31,cinder:UPDATE=116,cinder:DELETE=12 {{(pid=81771) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 22 17:57:57 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-175b34d9-7a2e-4052-b1c9-baa588fff2a5 tempest-VolumesSnapshotTestJSON-1790417655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b03d370-24aa-4351-bfb7-f4347eada6a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de7f585b-1457-43df-9fef-6a683d2f7884', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:57:57 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-175b34d9-7a2e-4052-b1c9-baa588fff2a5 tempest-VolumesSnapshotTestJSON-1790417655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1338ba3b-9db9-4ce1-b1d2-84f19303a4ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:57:57 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-175b34d9-7a2e-4052-b1c9-baa588fff2a5 tempest-VolumesSnapshotTestJSON-1790417655 None] Volume volume-de7f585b-1457-43df-9fef-6a683d2f7884 (de7f585b-1457-43df-9fef-6a683d2f7884): created successfully Apr 22 17:57:57 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-175b34d9-7a2e-4052-b1c9-baa588fff2a5 tempest-VolumesSnapshotTestJSON-1790417655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1338ba3b-9db9-4ce1-b1d2-84f19303a4ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:57:57 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-175b34d9-7a2e-4052-b1c9-baa588fff2a5 tempest-VolumesSnapshotTestJSON-1790417655 None] Flow 'volume_create_manager' (3ca6f3f9-3633-4a5e-8422-f3795f2b7007) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:57:57 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-175b34d9-7a2e-4052-b1c9-baa588fff2a5 tempest-VolumesSnapshotTestJSON-1790417655 None] Created volume successfully. Apr 22 17:57:58 devstack sudo[88945]: pam_unix(sudo:session): session closed for user root Apr 22 17:57:58 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-62eb52cf-12e7-4b63-8d33-95a673fe1e3a tempest-VolumeDependencyTests-1342970489 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-41cc83a1-79c3-45c2-b90d-524e07e0bc01" returned: 0 in 0.739s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:57:58 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-62eb52cf-12e7-4b63-8d33-95a673fe1e3a tempest-VolumeDependencyTests-1342970489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-41cc83a1-79c3-45c2-b90d-524e07e0bc01.c84bf4be-958b-4053-84ce-6e509b51db5a {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:57:58 devstack sudo[88986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-41cc83a1-79c3-45c2-b90d-524e07e0bc01.c84bf4be-958b-4053-84ce-6e509b51db5a Apr 22 17:57:58 devstack sudo[88986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:57:58 devstack cinder-volume[81771]: DEBUG dbcounter [-] [81771] Writing DB stats cinder:SELECT=91,cinder:UPDATE=144,cinder:INSERT=27,cinder:DELETE=14 {{(pid=81771) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 22 17:57:58 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-4acac9da-5f29-4f83-876c-71f6c3583a13 tempest-VolumesSnapshotTestJSON-1790417655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:57:58 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-4acac9da-5f29-4f83-876c-71f6c3583a13 tempest-VolumesSnapshotTestJSON-1790417655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:57:58 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-4acac9da-5f29-4f83-876c-71f6c3583a13 tempest-VolumesSnapshotTestJSON-1790417655 None] Creating offline snapshot 2e7e8f8d-423a-4196-b40f-1f111c00fef7 of volume de7f585b-1457-43df-9fef-6a683d2f7884 {{(pid=81771) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 22 17:57:58 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[36110329-7756-4dcf-b020-58c439c6b45e]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:57:58 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-4acac9da-5f29-4f83-876c-71f6c3583a13 tempest-VolumesSnapshotTestJSON-1790417655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-de7f585b-1457-43df-9fef-6a683d2f7884 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:57:58 devstack sudo[88989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-de7f585b-1457-43df-9fef-6a683d2f7884 Apr 22 17:57:58 devstack sudo[88989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:57:59 devstack sudo[88986]: pam_unix(sudo:session): session closed for user root Apr 22 17:57:59 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-62eb52cf-12e7-4b63-8d33-95a673fe1e3a tempest-VolumeDependencyTests-1342970489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-41cc83a1-79c3-45c2-b90d-524e07e0bc01.c84bf4be-958b-4053-84ce-6e509b51db5a" returned: 0 in 0.969s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:57:59 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-62eb52cf-12e7-4b63-8d33-95a673fe1e3a tempest-VolumeDependencyTests-1342970489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-41cc83a1-79c3-45c2-b90d-524e07e0bc01.c84bf4be-958b-4053-84ce-6e509b51db5a {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:57:59 devstack sudo[88994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-41cc83a1-79c3-45c2-b90d-524e07e0bc01.c84bf4be-958b-4053-84ce-6e509b51db5a Apr 22 17:57:59 devstack sudo[88994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:57:59 devstack sudo[88989]: pam_unix(sudo:session): session closed for user root Apr 22 17:57:59 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-4acac9da-5f29-4f83-876c-71f6c3583a13 tempest-VolumesSnapshotTestJSON-1790417655 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-de7f585b-1457-43df-9fef-6a683d2f7884" returned: 0 in 0.729s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:57:59 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-4acac9da-5f29-4f83-876c-71f6c3583a13 tempest-VolumesSnapshotTestJSON-1790417655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-de7f585b-1457-43df-9fef-6a683d2f7884,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-de7f585b-1457-43df-9fef-6a683d2f7884.2e7e8f8d-423a-4196-b40f-1f111c00fef7 1G {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:57:59 devstack sudo[88999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-de7f585b-1457-43df-9fef-6a683d2f7884,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-de7f585b-1457-43df-9fef-6a683d2f7884.2e7e8f8d-423a-4196-b40f-1f111c00fef7 1G Apr 22 17:57:59 devstack sudo[88999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:57:59 devstack sudo[88994]: pam_unix(sudo:session): session closed for user root Apr 22 17:57:59 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-62eb52cf-12e7-4b63-8d33-95a673fe1e3a tempest-VolumeDependencyTests-1342970489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-41cc83a1-79c3-45c2-b90d-524e07e0bc01.c84bf4be-958b-4053-84ce-6e509b51db5a" returned: 0 in 0.502s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:57:59 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-62eb52cf-12e7-4b63-8d33-95a673fe1e3a tempest-VolumeDependencyTests-1342970489 None] Lock "cinder-quobyte-c84bf4be-958b-4053-84ce-6e509b51db5a" released by "_delete_snapshot" :: held 2.978s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:57:59 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-62eb52cf-12e7-4b63-8d33-95a673fe1e3a tempest-VolumeDependencyTests-1342970489 None] Lock "cinder-quobyte-41cc83a1-79c3-45c2-b90d-524e07e0bc01" released by "delete_snapshot" :: held 3.009s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:57:59 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-62eb52cf-12e7-4b63-8d33-95a673fe1e3a tempest-VolumeDependencyTests-1342970489 None] Created reservations ['ea1e8b59-ed30-4a95-957c-598e839c292a', '62b1a6ab-4cae-4b9f-9252-00b1a2ee87a6', '5858ab24-401e-40a6-bed4-a8a677a0f13b', 'd171ca68-f29f-4e6b-bb11-1f950d3ef4aa'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 17:57:59 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-62eb52cf-12e7-4b63-8d33-95a673fe1e3a tempest-VolumeDependencyTests-1342970489 None] Delete snapshot completed successfully. Apr 22 17:57:59 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-62eb52cf-12e7-4b63-8d33-95a673fe1e3a tempest-VolumeDependencyTests-1342970489 None] Lock "cinder-c84bf4be-958b-4053-84ce-6e509b51db5a-delete_snapshot" released by "delete_snapshot" :: held 3.166s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:57:59 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-bc05cb29-1aaa-4588-b8e3-3c6d1adbace4 tempest-VolumeDependencyTests-1342970489 None] Acquiring lock "cinder-41cc83a1-79c3-45c2-b90d-524e07e0bc01-delete_volume" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:57:59 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-bc05cb29-1aaa-4588-b8e3-3c6d1adbace4 tempest-VolumeDependencyTests-1342970489 None] Lock "cinder-41cc83a1-79c3-45c2-b90d-524e07e0bc01-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:57:59 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-bc05cb29-1aaa-4588-b8e3-3c6d1adbace4 tempest-VolumeDependencyTests-1342970489 None] Acquiring lock "cinder-quobyte-41cc83a1-79c3-45c2-b90d-524e07e0bc01" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:57:59 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-bc05cb29-1aaa-4588-b8e3-3c6d1adbace4 tempest-VolumeDependencyTests-1342970489 None] Lock "cinder-quobyte-41cc83a1-79c3-45c2-b90d-524e07e0bc01" acquired by "delete_volume" :: waited 0.025s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:58:00 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[24690b36-3595-483b-b61f-9be7b3898341]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:58:00 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-bc05cb29-1aaa-4588-b8e3-3c6d1adbace4 tempest-VolumeDependencyTests-1342970489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-41cc83a1-79c3-45c2-b90d-524e07e0bc01 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:58:00 devstack sudo[88999]: pam_unix(sudo:session): session closed for user root Apr 22 17:58:00 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-4acac9da-5f29-4f83-876c-71f6c3583a13 tempest-VolumesSnapshotTestJSON-1790417655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-de7f585b-1457-43df-9fef-6a683d2f7884,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-de7f585b-1457-43df-9fef-6a683d2f7884.2e7e8f8d-423a-4196-b40f-1f111c00fef7 1G" returned: 0 in 0.773s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:58:00 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-4acac9da-5f29-4f83-876c-71f6c3583a13 tempest-VolumesSnapshotTestJSON-1790417655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de7f585b-1457-43df-9fef-6a683d2f7884 -F qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-de7f585b-1457-43df-9fef-6a683d2f7884.2e7e8f8d-423a-4196-b40f-1f111c00fef7 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:58:00 devstack sudo[89010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de7f585b-1457-43df-9fef-6a683d2f7884 -F qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-de7f585b-1457-43df-9fef-6a683d2f7884.2e7e8f8d-423a-4196-b40f-1f111c00fef7 Apr 22 17:58:00 devstack sudo[89010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:58:00 devstack sudo[89009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-41cc83a1-79c3-45c2-b90d-524e07e0bc01 Apr 22 17:58:00 devstack sudo[89009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:58:00 devstack sudo[89009]: pam_unix(sudo:session): session closed for user root Apr 22 17:58:00 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-bc05cb29-1aaa-4588-b8e3-3c6d1adbace4 tempest-VolumeDependencyTests-1342970489 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-41cc83a1-79c3-45c2-b90d-524e07e0bc01" returned: 0 in 0.563s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:58:00 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-bc05cb29-1aaa-4588-b8e3-3c6d1adbace4 tempest-VolumeDependencyTests-1342970489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-41cc83a1-79c3-45c2-b90d-524e07e0bc01 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:58:00 devstack sudo[89019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-41cc83a1-79c3-45c2-b90d-524e07e0bc01 Apr 22 17:58:00 devstack sudo[89019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:58:00 devstack sudo[89010]: pam_unix(sudo:session): session closed for user root Apr 22 17:58:00 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-4acac9da-5f29-4f83-876c-71f6c3583a13 tempest-VolumesSnapshotTestJSON-1790417655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de7f585b-1457-43df-9fef-6a683d2f7884 -F qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-de7f585b-1457-43df-9fef-6a683d2f7884.2e7e8f8d-423a-4196-b40f-1f111c00fef7" returned: 0 in 0.556s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:58:00 devstack cinder-volume[81771]: WARNING cinder.volume.drivers.remotefs [None req-4acac9da-5f29-4f83-876c-71f6c3583a13 tempest-VolumesSnapshotTestJSON-1790417655 None] /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-de7f585b-1457-43df-9fef-6a683d2f7884.2e7e8f8d-423a-4196-b40f-1f111c00fef7 is being set with open permissions: ugo+rw Apr 22 17:58:00 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-4acac9da-5f29-4f83-876c-71f6c3583a13 tempest-VolumesSnapshotTestJSON-1790417655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-de7f585b-1457-43df-9fef-6a683d2f7884.2e7e8f8d-423a-4196-b40f-1f111c00fef7 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:58:00 devstack sudo[89021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-de7f585b-1457-43df-9fef-6a683d2f7884.2e7e8f8d-423a-4196-b40f-1f111c00fef7 Apr 22 17:58:00 devstack sudo[89021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:58:01 devstack sudo[89019]: pam_unix(sudo:session): session closed for user root Apr 22 17:58:01 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-bc05cb29-1aaa-4588-b8e3-3c6d1adbace4 tempest-VolumeDependencyTests-1342970489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-41cc83a1-79c3-45c2-b90d-524e07e0bc01" returned: 0 in 0.465s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:58:01 devstack sudo[89021]: pam_unix(sudo:session): session closed for user root Apr 22 17:58:01 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-bc05cb29-1aaa-4588-b8e3-3c6d1adbace4 tempest-VolumeDependencyTests-1342970489 None] Lock "cinder-quobyte-41cc83a1-79c3-45c2-b90d-524e07e0bc01" released by "delete_volume" :: held 1.117s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:58:01 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-4acac9da-5f29-4f83-876c-71f6c3583a13 tempest-VolumesSnapshotTestJSON-1790417655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-de7f585b-1457-43df-9fef-6a683d2f7884.2e7e8f8d-423a-4196-b40f-1f111c00fef7" returned: 0 in 0.454s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:58:01 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-bc05cb29-1aaa-4588-b8e3-3c6d1adbace4 tempest-VolumeDependencyTests-1342970489 None] Created reservations ['96765491-6c79-4a98-80e0-aec7f4d17bf5', '2bf9af48-e468-47b1-925b-5c5d13055a79', 'e6fff1f5-2710-475d-b6f9-9f0c1b336fb5', '221022c1-c094-419e-8397-7aa1c68af33c'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 17:58:01 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-4acac9da-5f29-4f83-876c-71f6c3583a13 tempest-VolumesSnapshotTestJSON-1790417655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-de7f585b-1457-43df-9fef-6a683d2f7884.info {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:58:01 devstack sudo[89025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-de7f585b-1457-43df-9fef-6a683d2f7884.info Apr 22 17:58:01 devstack sudo[89025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:58:01 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-bc05cb29-1aaa-4588-b8e3-3c6d1adbace4 tempest-VolumeDependencyTests-1342970489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:58:01 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-bc05cb29-1aaa-4588-b8e3-3c6d1adbace4 tempest-VolumeDependencyTests-1342970489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:58:01 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-bc05cb29-1aaa-4588-b8e3-3c6d1adbace4 tempest-VolumeDependencyTests-1342970489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:58:01 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-bc05cb29-1aaa-4588-b8e3-3c6d1adbace4 tempest-VolumeDependencyTests-1342970489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:58:01 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-bc05cb29-1aaa-4588-b8e3-3c6d1adbace4 tempest-VolumeDependencyTests-1342970489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:58:01 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-bc05cb29-1aaa-4588-b8e3-3c6d1adbace4 tempest-VolumeDependencyTests-1342970489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:58:01 devstack sudo[89027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 Apr 22 17:58:01 devstack sudo[89027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:58:01 devstack sudo[89025]: pam_unix(sudo:session): session closed for user root Apr 22 17:58:01 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-4acac9da-5f29-4f83-876c-71f6c3583a13 tempest-VolumesSnapshotTestJSON-1790417655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-de7f585b-1457-43df-9fef-6a683d2f7884.info" returned: 0 in 0.518s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:58:01 devstack cinder-volume[81771]: WARNING cinder.volume.drivers.remotefs [None req-4acac9da-5f29-4f83-876c-71f6c3583a13 tempest-VolumesSnapshotTestJSON-1790417655 None] /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-de7f585b-1457-43df-9fef-6a683d2f7884.info is being set with open permissions: ugo+rw Apr 22 17:58:01 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-4acac9da-5f29-4f83-876c-71f6c3583a13 tempest-VolumesSnapshotTestJSON-1790417655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-de7f585b-1457-43df-9fef-6a683d2f7884.info {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:58:01 devstack sudo[89036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-de7f585b-1457-43df-9fef-6a683d2f7884.info Apr 22 17:58:01 devstack sudo[89036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:58:01 devstack sudo[89027]: pam_unix(sudo:session): session closed for user root Apr 22 17:58:01 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-bc05cb29-1aaa-4588-b8e3-3c6d1adbace4 tempest-VolumeDependencyTests-1342970489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33" returned: 0 in 0.544s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:58:01 devstack cinder-volume[81771]: DEBUG cinder.manager [None req-bc05cb29-1aaa-4588-b8e3-3c6d1adbace4 tempest-VolumeDependencyTests-1342970489 None] Notifying Schedulers of capabilities ... {{(pid=81771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 17:58:01 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-bc05cb29-1aaa-4588-b8e3-3c6d1adbace4 tempest-VolumeDependencyTests-1342970489 None] Deleted volume successfully. Apr 22 17:58:01 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-bc05cb29-1aaa-4588-b8e3-3c6d1adbace4 tempest-VolumeDependencyTests-1342970489 None] Lock "cinder-41cc83a1-79c3-45c2-b90d-524e07e0bc01-delete_volume" released by "delete_volume" :: held 1.913s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:58:02 devstack sudo[89036]: pam_unix(sudo:session): session closed for user root Apr 22 17:58:02 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-4acac9da-5f29-4f83-876c-71f6c3583a13 tempest-VolumesSnapshotTestJSON-1790417655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-de7f585b-1457-43df-9fef-6a683d2f7884.info" returned: 0 in 0.495s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:58:02 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-4acac9da-5f29-4f83-876c-71f6c3583a13 tempest-VolumesSnapshotTestJSON-1790417655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.669s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:58:02 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-4acac9da-5f29-4f83-876c-71f6c3583a13 tempest-VolumesSnapshotTestJSON-1790417655 None] Create snapshot completed successfully Apr 22 17:58:02 devstack cinder-volume[81771]: DEBUG cinder.volume.flows.manager.create_volume [None req-7915f804-d2f3-448d-8c7d-59aa2e3e950e tempest-VolumeDependencyTests-1342970489 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 17:58:02 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-7915f804-d2f3-448d-8c7d-59aa2e3e950e tempest-VolumeDependencyTests-1342970489 None] Flow 'volume_create_manager' (a035ed12-969f-4921-a5e6-e59d990f40d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:58:02 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-7915f804-d2f3-448d-8c7d-59aa2e3e950e tempest-VolumeDependencyTests-1342970489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e91fc8d-f2ba-45c9-9a58-d36171984539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:58:02 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-7915f804-d2f3-448d-8c7d-59aa2e3e950e tempest-VolumeDependencyTests-1342970489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e91fc8d-f2ba-45c9-9a58-d36171984539) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:58:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1479707672',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5f27f97-ac85-4453-b8d7-ed21791d840a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d3bf696f1c14db28b5f059aabc09943',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:58:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:58:02Z,use_quota=True,user_id='422aa3fabef34bd591f6367bd7cbfa6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:58:02 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-7915f804-d2f3-448d-8c7d-59aa2e3e950e tempest-VolumeDependencyTests-1342970489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdbd2597-625f-4951-a5b5-b1160936aff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:58:02 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-7915f804-d2f3-448d-8c7d-59aa2e3e950e tempest-VolumeDependencyTests-1342970489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdbd2597-625f-4951-a5b5-b1160936aff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:58:02 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-7915f804-d2f3-448d-8c7d-59aa2e3e950e tempest-VolumeDependencyTests-1342970489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66ed0ee4-d621-4262-a795-92a27625b28d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:58:02 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-7915f804-d2f3-448d-8c7d-59aa2e3e950e tempest-VolumeDependencyTests-1342970489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66ed0ee4-d621-4262-a795-92a27625b28d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5f27f97-ac85-4453-b8d7-ed21791d840a', 'volume_name': 'volume-b5f27f97-ac85-4453-b8d7-ed21791d840a', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:58:02 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-7915f804-d2f3-448d-8c7d-59aa2e3e950e tempest-VolumeDependencyTests-1342970489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (061d40ea-0f78-4229-aa03-7c0538605c76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:58:02 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-7915f804-d2f3-448d-8c7d-59aa2e3e950e tempest-VolumeDependencyTests-1342970489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (061d40ea-0f78-4229-aa03-7c0538605c76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:58:02 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-7915f804-d2f3-448d-8c7d-59aa2e3e950e tempest-VolumeDependencyTests-1342970489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (261d34f1-b9bb-4ae2-add9-41eeffe448f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:58:02 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-7915f804-d2f3-448d-8c7d-59aa2e3e950e tempest-VolumeDependencyTests-1342970489 None] Volume b5f27f97-ac85-4453-b8d7-ed21791d840a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5f27f97-ac85-4453-b8d7-ed21791d840a', 'volume_size': 1} Apr 22 17:58:02 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-7915f804-d2f3-448d-8c7d-59aa2e3e950e tempest-VolumeDependencyTests-1342970489 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:58:02 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-7915f804-d2f3-448d-8c7d-59aa2e3e950e tempest-VolumeDependencyTests-1342970489 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:58:02 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-7915f804-d2f3-448d-8c7d-59aa2e3e950e tempest-VolumeDependencyTests-1342970489 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:58:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1479707672',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5f27f97-ac85-4453-b8d7-ed21791d840a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d3bf696f1c14db28b5f059aabc09943',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:58:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:58:02Z,use_quota=True,user_id='422aa3fabef34bd591f6367bd7cbfa6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)}" {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 17:58:02 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-7915f804-d2f3-448d-8c7d-59aa2e3e950e tempest-VolumeDependencyTests-1342970489 None] Creating volume b5f27f97-ac85-4453-b8d7-ed21791d840a {{(pid=81771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 17:58:02 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-7915f804-d2f3-448d-8c7d-59aa2e3e950e tempest-VolumeDependencyTests-1342970489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:58:02 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-7915f804-d2f3-448d-8c7d-59aa2e3e950e tempest-VolumeDependencyTests-1342970489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:58:02 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-7915f804-d2f3-448d-8c7d-59aa2e3e950e tempest-VolumeDependencyTests-1342970489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:58:02 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-7915f804-d2f3-448d-8c7d-59aa2e3e950e tempest-VolumeDependencyTests-1342970489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:58:02 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-7915f804-d2f3-448d-8c7d-59aa2e3e950e tempest-VolumeDependencyTests-1342970489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:58:02 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-7915f804-d2f3-448d-8c7d-59aa2e3e950e tempest-VolumeDependencyTests-1342970489 None] Selected osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 as target Quobyte volume. {{(pid=81771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 17:58:02 devstack cinder-volume[81771]: INFO cinder.volume.drivers.remotefs [None req-7915f804-d2f3-448d-8c7d-59aa2e3e950e tempest-VolumeDependencyTests-1342970489 None] casted to osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 Apr 22 17:58:02 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-7915f804-d2f3-448d-8c7d-59aa2e3e950e tempest-VolumeDependencyTests-1342970489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b5f27f97-ac85-4453-b8d7-ed21791d840a 1073741824 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:58:02 devstack sudo[89048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b5f27f97-ac85-4453-b8d7-ed21791d840a 1073741824 Apr 22 17:58:02 devstack sudo[89048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:58:03 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-dd0bd821-3e91-4cff-add2-0a7a56301d8d tempest-VolumesSnapshotTestJSON-1790417655 None] Acquiring lock "cinder-2e7e8f8d-423a-4196-b40f-1f111c00fef7-delete_snapshot" by "delete_snapshot" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:58:03 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-dd0bd821-3e91-4cff-add2-0a7a56301d8d tempest-VolumesSnapshotTestJSON-1790417655 None] Lock "cinder-2e7e8f8d-423a-4196-b40f-1f111c00fef7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.075s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:58:03 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-dd0bd821-3e91-4cff-add2-0a7a56301d8d tempest-VolumesSnapshotTestJSON-1790417655 None] Acquiring lock "cinder-quobyte-de7f585b-1457-43df-9fef-6a683d2f7884" by "delete_snapshot" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:58:03 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-dd0bd821-3e91-4cff-add2-0a7a56301d8d tempest-VolumesSnapshotTestJSON-1790417655 None] Lock "cinder-quobyte-de7f585b-1457-43df-9fef-6a683d2f7884" acquired by "delete_snapshot" :: waited 0.043s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:58:03 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-dd0bd821-3e91-4cff-add2-0a7a56301d8d tempest-VolumesSnapshotTestJSON-1790417655 None] Acquiring lock "cinder-quobyte-2e7e8f8d-423a-4196-b40f-1f111c00fef7" by "_delete_snapshot" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:58:03 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-dd0bd821-3e91-4cff-add2-0a7a56301d8d tempest-VolumesSnapshotTestJSON-1790417655 None] Lock "cinder-quobyte-2e7e8f8d-423a-4196-b40f-1f111c00fef7" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:58:03 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-dd0bd821-3e91-4cff-add2-0a7a56301d8d tempest-VolumesSnapshotTestJSON-1790417655 None] Deleting offline snapshot 2e7e8f8d-423a-4196-b40f-1f111c00fef7 of volume de7f585b-1457-43df-9fef-6a683d2f7884 {{(pid=81771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 22 17:58:03 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-dd0bd821-3e91-4cff-add2-0a7a56301d8d tempest-VolumesSnapshotTestJSON-1790417655 None] snapshot_file for this snap is: volume-de7f585b-1457-43df-9fef-6a683d2f7884.2e7e8f8d-423a-4196-b40f-1f111c00fef7 {{(pid=81771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 22 17:58:03 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[0488913b-c386-462a-a153-c6c8fe7ffeeb]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:58:03 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-dd0bd821-3e91-4cff-add2-0a7a56301d8d tempest-VolumesSnapshotTestJSON-1790417655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-de7f585b-1457-43df-9fef-6a683d2f7884.2e7e8f8d-423a-4196-b40f-1f111c00fef7 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:58:03 devstack sudo[89083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-de7f585b-1457-43df-9fef-6a683d2f7884.2e7e8f8d-423a-4196-b40f-1f111c00fef7 Apr 22 17:58:03 devstack sudo[89083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:58:03 devstack sudo[89048]: pam_unix(sudo:session): session closed for user root Apr 22 17:58:03 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-7915f804-d2f3-448d-8c7d-59aa2e3e950e tempest-VolumeDependencyTests-1342970489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b5f27f97-ac85-4453-b8d7-ed21791d840a 1073741824" returned: 0 in 1.229s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:58:03 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-7915f804-d2f3-448d-8c7d-59aa2e3e950e tempest-VolumeDependencyTests-1342970489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b5f27f97-ac85-4453-b8d7-ed21791d840a {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:58:03 devstack sudo[89086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b5f27f97-ac85-4453-b8d7-ed21791d840a Apr 22 17:58:03 devstack sudo[89086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:58:04 devstack sudo[89083]: pam_unix(sudo:session): session closed for user root Apr 22 17:58:04 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-dd0bd821-3e91-4cff-add2-0a7a56301d8d tempest-VolumesSnapshotTestJSON-1790417655 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-de7f585b-1457-43df-9fef-6a683d2f7884.2e7e8f8d-423a-4196-b40f-1f111c00fef7" returned: 0 in 0.926s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:58:04 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-dd0bd821-3e91-4cff-add2-0a7a56301d8d tempest-VolumesSnapshotTestJSON-1790417655 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-de7f585b-1457-43df-9fef-6a683d2f7884(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81771) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 22 17:58:04 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[c18ae309-8a94-45dc-a678-2254b95782ad]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:58:04 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-dd0bd821-3e91-4cff-add2-0a7a56301d8d tempest-VolumesSnapshotTestJSON-1790417655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-de7f585b-1457-43df-9fef-6a683d2f7884 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:58:04 devstack sudo[89093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-de7f585b-1457-43df-9fef-6a683d2f7884 Apr 22 17:58:04 devstack sudo[89093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:58:04 devstack sudo[89086]: pam_unix(sudo:session): session closed for user root Apr 22 17:58:04 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-7915f804-d2f3-448d-8c7d-59aa2e3e950e tempest-VolumeDependencyTests-1342970489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b5f27f97-ac85-4453-b8d7-ed21791d840a" returned: 0 in 0.774s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:58:04 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-7915f804-d2f3-448d-8c7d-59aa2e3e950e tempest-VolumeDependencyTests-1342970489 None] <== create_volume: return (2100ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'} {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 17:58:04 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-7915f804-d2f3-448d-8c7d-59aa2e3e950e tempest-VolumeDependencyTests-1342970489 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.103s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:58:04 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-7915f804-d2f3-448d-8c7d-59aa2e3e950e tempest-VolumeDependencyTests-1342970489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (261d34f1-b9bb-4ae2-add9-41eeffe448f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5f27f97-ac85-4453-b8d7-ed21791d840a', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:58:04 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-7915f804-d2f3-448d-8c7d-59aa2e3e950e tempest-VolumeDependencyTests-1342970489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4381c468-f690-47e4-a486-0a0f08f26ba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:58:04 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-7915f804-d2f3-448d-8c7d-59aa2e3e950e tempest-VolumeDependencyTests-1342970489 None] Volume volume-b5f27f97-ac85-4453-b8d7-ed21791d840a (b5f27f97-ac85-4453-b8d7-ed21791d840a): created successfully Apr 22 17:58:04 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-7915f804-d2f3-448d-8c7d-59aa2e3e950e tempest-VolumeDependencyTests-1342970489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4381c468-f690-47e4-a486-0a0f08f26ba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:58:04 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-7915f804-d2f3-448d-8c7d-59aa2e3e950e tempest-VolumeDependencyTests-1342970489 None] Flow 'volume_create_manager' (a035ed12-969f-4921-a5e6-e59d990f40d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:58:04 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-7915f804-d2f3-448d-8c7d-59aa2e3e950e tempest-VolumeDependencyTests-1342970489 None] Created volume successfully. Apr 22 17:58:05 devstack sudo[89093]: pam_unix(sudo:session): session closed for user root Apr 22 17:58:05 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-dd0bd821-3e91-4cff-add2-0a7a56301d8d tempest-VolumesSnapshotTestJSON-1790417655 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-de7f585b-1457-43df-9fef-6a683d2f7884" returned: 0 in 0.778s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:58:05 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-dd0bd821-3e91-4cff-add2-0a7a56301d8d tempest-VolumesSnapshotTestJSON-1790417655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-de7f585b-1457-43df-9fef-6a683d2f7884.2e7e8f8d-423a-4196-b40f-1f111c00fef7 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:58:05 devstack sudo[89098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-de7f585b-1457-43df-9fef-6a683d2f7884.2e7e8f8d-423a-4196-b40f-1f111c00fef7 Apr 22 17:58:05 devstack sudo[89098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:58:06 devstack sudo[89098]: pam_unix(sudo:session): session closed for user root Apr 22 17:58:06 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-dd0bd821-3e91-4cff-add2-0a7a56301d8d tempest-VolumesSnapshotTestJSON-1790417655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-de7f585b-1457-43df-9fef-6a683d2f7884.2e7e8f8d-423a-4196-b40f-1f111c00fef7" returned: 0 in 0.908s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:58:06 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-dd0bd821-3e91-4cff-add2-0a7a56301d8d tempest-VolumesSnapshotTestJSON-1790417655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-de7f585b-1457-43df-9fef-6a683d2f7884.2e7e8f8d-423a-4196-b40f-1f111c00fef7 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:58:06 devstack sudo[89104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-de7f585b-1457-43df-9fef-6a683d2f7884.2e7e8f8d-423a-4196-b40f-1f111c00fef7 Apr 22 17:58:06 devstack sudo[89104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:58:06 devstack cinder-volume[81771]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c34b0f7-28ac-447d-be9c-3a77344bc3d8 tempest-VolumeDependencyTests-1342970489 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 17:58:06 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-3c34b0f7-28ac-447d-be9c-3a77344bc3d8 tempest-VolumeDependencyTests-1342970489 None] Flow 'volume_create_manager' (984f7565-8719-43fb-afdd-2e640d4118fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:58:06 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-3c34b0f7-28ac-447d-be9c-3a77344bc3d8 tempest-VolumeDependencyTests-1342970489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e0c57d0-39fc-4f42-a397-22eb75431d1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:58:06 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-3c34b0f7-28ac-447d-be9c-3a77344bc3d8 tempest-VolumeDependencyTests-1342970489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e0c57d0-39fc-4f42-a397-22eb75431d1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:58:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1865868208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2864d2cf-e821-4b70-b589-d05499ebafa3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d3bf696f1c14db28b5f059aabc09943',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:58:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=b5f27f97-ac85-4453-b8d7-ed21791d840a,status='creating',terminated_at=None,updated_at=2026-04-22T15:58:06Z,use_quota=True,user_id='422aa3fabef34bd591f6367bd7cbfa6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:58:06 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-3c34b0f7-28ac-447d-be9c-3a77344bc3d8 tempest-VolumeDependencyTests-1342970489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f543b95-e000-4ea6-ab69-369b52029800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:58:06 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-3c34b0f7-28ac-447d-be9c-3a77344bc3d8 tempest-VolumeDependencyTests-1342970489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f543b95-e000-4ea6-ab69-369b52029800) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:58:06 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-3c34b0f7-28ac-447d-be9c-3a77344bc3d8 tempest-VolumeDependencyTests-1342970489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d104daa2-635e-4601-beb2-10ad641385c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:58:06 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-3c34b0f7-28ac-447d-be9c-3a77344bc3d8 tempest-VolumeDependencyTests-1342970489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d104daa2-635e-4601-beb2-10ad641385c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '2864d2cf-e821-4b70-b589-d05499ebafa3', 'volume_name': 'volume-2864d2cf-e821-4b70-b589-d05499ebafa3', 'volume_size': 1, 'source_volid': 'b5f27f97-ac85-4453-b8d7-ed21791d840a', 'source_volstatus': 'available'}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:58:06 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-3c34b0f7-28ac-447d-be9c-3a77344bc3d8 tempest-VolumeDependencyTests-1342970489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d33fcc55-f559-4c8b-a884-9f7f275cc939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:58:06 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-3c34b0f7-28ac-447d-be9c-3a77344bc3d8 tempest-VolumeDependencyTests-1342970489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d33fcc55-f559-4c8b-a884-9f7f275cc939) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:58:06 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-3c34b0f7-28ac-447d-be9c-3a77344bc3d8 tempest-VolumeDependencyTests-1342970489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9120d9c-12cb-4d46-bcb7-46122f6803d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:58:06 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-3c34b0f7-28ac-447d-be9c-3a77344bc3d8 tempest-VolumeDependencyTests-1342970489 None] Volume 2864d2cf-e821-4b70-b589-d05499ebafa3: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-2864d2cf-e821-4b70-b589-d05499ebafa3', 'volume_size': 1, 'source_volid': 'b5f27f97-ac85-4453-b8d7-ed21791d840a', 'source_volstatus': 'available'} Apr 22 17:58:06 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-3c34b0f7-28ac-447d-be9c-3a77344bc3d8 tempest-VolumeDependencyTests-1342970489 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:58:06 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-3c34b0f7-28ac-447d-be9c-3a77344bc3d8 tempest-VolumeDependencyTests-1342970489 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:58:06 devstack cinder-volume[81771]: INFO cinder.volume.drivers.remotefs [None req-3c34b0f7-28ac-447d-be9c-3a77344bc3d8 tempest-VolumeDependencyTests-1342970489 None] Cloning volume b5f27f97-ac85-4453-b8d7-ed21791d840a to volume 2864d2cf-e821-4b70-b589-d05499ebafa3 Apr 22 17:58:06 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-3c34b0f7-28ac-447d-be9c-3a77344bc3d8 tempest-VolumeDependencyTests-1342970489 None] Creating offline snapshot a694190d-635a-421d-96b4-99a9fe530e8e of volume b5f27f97-ac85-4453-b8d7-ed21791d840a {{(pid=81771) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 22 17:58:06 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[10f9848f-9d73-456d-9024-8aed69dd2bc1]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:58:06 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-3c34b0f7-28ac-447d-be9c-3a77344bc3d8 tempest-VolumeDependencyTests-1342970489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b5f27f97-ac85-4453-b8d7-ed21791d840a {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:58:06 devstack sudo[89106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b5f27f97-ac85-4453-b8d7-ed21791d840a Apr 22 17:58:06 devstack sudo[89106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:58:06 devstack cinder-volume[81771]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0fccc21-a364-40dd-ad78-0cce0f4404ad tempest-VolumesActionsTest-678062019 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 17:58:07 devstack sudo[89104]: pam_unix(sudo:session): session closed for user root Apr 22 17:58:07 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-c0fccc21-a364-40dd-ad78-0cce0f4404ad tempest-VolumesActionsTest-678062019 None] Flow 'volume_create_manager' (bc598e96-8d01-4505-96a7-1a4a0dda6cca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:58:07 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-c0fccc21-a364-40dd-ad78-0cce0f4404ad tempest-VolumesActionsTest-678062019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (262f182f-cf33-46c3-a887-062cd2d1d88d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:58:07 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-dd0bd821-3e91-4cff-add2-0a7a56301d8d tempest-VolumesSnapshotTestJSON-1790417655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-de7f585b-1457-43df-9fef-6a683d2f7884.2e7e8f8d-423a-4196-b40f-1f111c00fef7" returned: 0 in 0.885s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:58:07 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-c0fccc21-a364-40dd-ad78-0cce0f4404ad tempest-VolumesActionsTest-678062019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (262f182f-cf33-46c3-a887-062cd2d1d88d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:58:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1540584483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d833ec9-4529-4e71-931e-32c62898e75e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd5ed77be0ee418cb4f7816bd70e7b2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:58:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:58:07Z,use_quota=True,user_id='fa7c9a3bff17449bb4b6fcd3fa13fb1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:58:07 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-c0fccc21-a364-40dd-ad78-0cce0f4404ad tempest-VolumesActionsTest-678062019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0069675f-3f71-4294-a3f6-22ea7a137317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:58:07 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-c0fccc21-a364-40dd-ad78-0cce0f4404ad tempest-VolumesActionsTest-678062019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0069675f-3f71-4294-a3f6-22ea7a137317) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:58:07 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-c0fccc21-a364-40dd-ad78-0cce0f4404ad tempest-VolumesActionsTest-678062019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (205adeaa-38ef-46a0-829c-afd3f6dc1cf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:58:07 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-c0fccc21-a364-40dd-ad78-0cce0f4404ad tempest-VolumesActionsTest-678062019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (205adeaa-38ef-46a0-829c-afd3f6dc1cf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d833ec9-4529-4e71-931e-32c62898e75e', 'volume_name': 'volume-5d833ec9-4529-4e71-931e-32c62898e75e', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:58:07 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-c0fccc21-a364-40dd-ad78-0cce0f4404ad tempest-VolumesActionsTest-678062019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9375b6de-97d6-4fc9-bb60-38681ed506a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:58:07 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-c0fccc21-a364-40dd-ad78-0cce0f4404ad tempest-VolumesActionsTest-678062019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9375b6de-97d6-4fc9-bb60-38681ed506a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:58:07 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-c0fccc21-a364-40dd-ad78-0cce0f4404ad tempest-VolumesActionsTest-678062019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9c32919-639c-44a7-8873-77b414db0dec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:58:07 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-c0fccc21-a364-40dd-ad78-0cce0f4404ad tempest-VolumesActionsTest-678062019 None] Volume 5d833ec9-4529-4e71-931e-32c62898e75e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d833ec9-4529-4e71-931e-32c62898e75e', 'volume_size': 1} Apr 22 17:58:07 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-c0fccc21-a364-40dd-ad78-0cce0f4404ad tempest-VolumesActionsTest-678062019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:58:07 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-dd0bd821-3e91-4cff-add2-0a7a56301d8d tempest-VolumesSnapshotTestJSON-1790417655 None] Lock "cinder-quobyte-2e7e8f8d-423a-4196-b40f-1f111c00fef7" released by "_delete_snapshot" :: held 3.723s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:58:07 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-dd0bd821-3e91-4cff-add2-0a7a56301d8d tempest-VolumesSnapshotTestJSON-1790417655 None] Lock "cinder-quobyte-de7f585b-1457-43df-9fef-6a683d2f7884" released by "delete_snapshot" :: held 3.766s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:58:07 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-dd0bd821-3e91-4cff-add2-0a7a56301d8d tempest-VolumesSnapshotTestJSON-1790417655 None] Created reservations ['74ff2ffc-a8bd-4fb4-9dcd-8a13721ad9be', 'a093ed55-7d30-45cc-ad2a-04fe85519d36', 'f48ef3f6-e31b-49b3-a18e-afa5c01174f0', 'c6745435-f448-4ffd-b66a-e0f626aa140b'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 17:58:07 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-dd0bd821-3e91-4cff-add2-0a7a56301d8d tempest-VolumesSnapshotTestJSON-1790417655 None] Delete snapshot completed successfully. Apr 22 17:58:07 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-dd0bd821-3e91-4cff-add2-0a7a56301d8d tempest-VolumesSnapshotTestJSON-1790417655 None] Lock "cinder-2e7e8f8d-423a-4196-b40f-1f111c00fef7-delete_snapshot" released by "delete_snapshot" :: held 4.038s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:58:07 devstack sudo[89106]: pam_unix(sudo:session): session closed for user root Apr 22 17:58:07 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-3c34b0f7-28ac-447d-be9c-3a77344bc3d8 tempest-VolumeDependencyTests-1342970489 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b5f27f97-ac85-4453-b8d7-ed21791d840a" returned: 0 in 0.778s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:58:07 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-3c34b0f7-28ac-447d-be9c-3a77344bc3d8 tempest-VolumeDependencyTests-1342970489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b5f27f97-ac85-4453-b8d7-ed21791d840a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b5f27f97-ac85-4453-b8d7-ed21791d840a.a694190d-635a-421d-96b4-99a9fe530e8e 1G {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:58:07 devstack sudo[89114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b5f27f97-ac85-4453-b8d7-ed21791d840a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b5f27f97-ac85-4453-b8d7-ed21791d840a.a694190d-635a-421d-96b4-99a9fe530e8e 1G Apr 22 17:58:07 devstack sudo[89114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:58:08 devstack sudo[89114]: pam_unix(sudo:session): session closed for user root Apr 22 17:58:08 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-3c34b0f7-28ac-447d-be9c-3a77344bc3d8 tempest-VolumeDependencyTests-1342970489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b5f27f97-ac85-4453-b8d7-ed21791d840a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b5f27f97-ac85-4453-b8d7-ed21791d840a.a694190d-635a-421d-96b4-99a9fe530e8e 1G" returned: 0 in 0.903s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:58:08 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-3c34b0f7-28ac-447d-be9c-3a77344bc3d8 tempest-VolumeDependencyTests-1342970489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5f27f97-ac85-4453-b8d7-ed21791d840a -F qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b5f27f97-ac85-4453-b8d7-ed21791d840a.a694190d-635a-421d-96b4-99a9fe530e8e {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:58:08 devstack sudo[89119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5f27f97-ac85-4453-b8d7-ed21791d840a -F qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b5f27f97-ac85-4453-b8d7-ed21791d840a.a694190d-635a-421d-96b4-99a9fe530e8e Apr 22 17:58:08 devstack sudo[89119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:58:08 devstack cinder-volume[81771]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9f8e14c-df88-4cdb-8871-c83855964019 tempest-VolumesSnapshotTestJSON-1790417655 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 17:58:08 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-f9f8e14c-df88-4cdb-8871-c83855964019 tempest-VolumesSnapshotTestJSON-1790417655 None] Flow 'volume_create_manager' (09c3e184-6874-4bf3-becc-b1e88f93b1b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:58:08 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-f9f8e14c-df88-4cdb-8871-c83855964019 tempest-VolumesSnapshotTestJSON-1790417655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7724f54-31a8-4cea-96c7-0501ec6fc943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:58:08 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-f9f8e14c-df88-4cdb-8871-c83855964019 tempest-VolumesSnapshotTestJSON-1790417655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7724f54-31a8-4cea-96c7-0501ec6fc943) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:58:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2042238491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d097496-766b-4bc2-9799-7ffc87065451,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afd9a86ddfc94168aaf00fc1e9b425f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:58:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:58:08Z,use_quota=True,user_id='e1b4ff9f921345ce968b249e8ba0c04b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:58:08 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-f9f8e14c-df88-4cdb-8871-c83855964019 tempest-VolumesSnapshotTestJSON-1790417655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c1968d1-5b23-4a86-9ed2-f9bd98b5bd34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:58:08 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-f9f8e14c-df88-4cdb-8871-c83855964019 tempest-VolumesSnapshotTestJSON-1790417655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c1968d1-5b23-4a86-9ed2-f9bd98b5bd34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:58:08 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-f9f8e14c-df88-4cdb-8871-c83855964019 tempest-VolumesSnapshotTestJSON-1790417655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d0c23fc-340b-4339-b49c-975df79de03c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:58:08 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-f9f8e14c-df88-4cdb-8871-c83855964019 tempest-VolumesSnapshotTestJSON-1790417655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d0c23fc-340b-4339-b49c-975df79de03c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d097496-766b-4bc2-9799-7ffc87065451', 'volume_name': 'volume-7d097496-766b-4bc2-9799-7ffc87065451', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:58:08 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-f9f8e14c-df88-4cdb-8871-c83855964019 tempest-VolumesSnapshotTestJSON-1790417655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcd0652e-9c2a-46c5-aa52-51157655119b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:58:08 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-f9f8e14c-df88-4cdb-8871-c83855964019 tempest-VolumesSnapshotTestJSON-1790417655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcd0652e-9c2a-46c5-aa52-51157655119b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:58:08 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-f9f8e14c-df88-4cdb-8871-c83855964019 tempest-VolumesSnapshotTestJSON-1790417655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96ffd491-63e8-405c-9058-b3a23ccf0d95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:58:08 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-f9f8e14c-df88-4cdb-8871-c83855964019 tempest-VolumesSnapshotTestJSON-1790417655 None] Volume 7d097496-766b-4bc2-9799-7ffc87065451: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d097496-766b-4bc2-9799-7ffc87065451', 'volume_size': 1} Apr 22 17:58:08 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-f9f8e14c-df88-4cdb-8871-c83855964019 tempest-VolumesSnapshotTestJSON-1790417655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:58:09 devstack sudo[89119]: pam_unix(sudo:session): session closed for user root Apr 22 17:58:09 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-3c34b0f7-28ac-447d-be9c-3a77344bc3d8 tempest-VolumeDependencyTests-1342970489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5f27f97-ac85-4453-b8d7-ed21791d840a -F qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b5f27f97-ac85-4453-b8d7-ed21791d840a.a694190d-635a-421d-96b4-99a9fe530e8e" returned: 0 in 0.788s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:58:09 devstack cinder-volume[81771]: WARNING cinder.volume.drivers.remotefs [None req-3c34b0f7-28ac-447d-be9c-3a77344bc3d8 tempest-VolumeDependencyTests-1342970489 None] /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b5f27f97-ac85-4453-b8d7-ed21791d840a.a694190d-635a-421d-96b4-99a9fe530e8e is being set with open permissions: ugo+rw Apr 22 17:58:09 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-3c34b0f7-28ac-447d-be9c-3a77344bc3d8 tempest-VolumeDependencyTests-1342970489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b5f27f97-ac85-4453-b8d7-ed21791d840a.a694190d-635a-421d-96b4-99a9fe530e8e {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:58:09 devstack sudo[89124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b5f27f97-ac85-4453-b8d7-ed21791d840a.a694190d-635a-421d-96b4-99a9fe530e8e Apr 22 17:58:09 devstack sudo[89124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:58:09 devstack sudo[89124]: pam_unix(sudo:session): session closed for user root Apr 22 17:58:09 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-3c34b0f7-28ac-447d-be9c-3a77344bc3d8 tempest-VolumeDependencyTests-1342970489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b5f27f97-ac85-4453-b8d7-ed21791d840a.a694190d-635a-421d-96b4-99a9fe530e8e" returned: 0 in 0.594s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:58:09 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-3c34b0f7-28ac-447d-be9c-3a77344bc3d8 tempest-VolumeDependencyTests-1342970489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b5f27f97-ac85-4453-b8d7-ed21791d840a.info {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:58:09 devstack sudo[89127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b5f27f97-ac85-4453-b8d7-ed21791d840a.info Apr 22 17:58:09 devstack sudo[89127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:58:10 devstack sudo[89127]: pam_unix(sudo:session): session closed for user root Apr 22 17:58:10 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-3c34b0f7-28ac-447d-be9c-3a77344bc3d8 tempest-VolumeDependencyTests-1342970489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b5f27f97-ac85-4453-b8d7-ed21791d840a.info" returned: 0 in 0.564s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:58:10 devstack cinder-volume[81771]: WARNING cinder.volume.drivers.remotefs [None req-3c34b0f7-28ac-447d-be9c-3a77344bc3d8 tempest-VolumeDependencyTests-1342970489 None] /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b5f27f97-ac85-4453-b8d7-ed21791d840a.info is being set with open permissions: ugo+rw Apr 22 17:58:10 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-3c34b0f7-28ac-447d-be9c-3a77344bc3d8 tempest-VolumeDependencyTests-1342970489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b5f27f97-ac85-4453-b8d7-ed21791d840a.info {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:58:10 devstack sudo[89130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b5f27f97-ac85-4453-b8d7-ed21791d840a.info Apr 22 17:58:10 devstack sudo[89130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:58:10 devstack sudo[89130]: pam_unix(sudo:session): session closed for user root Apr 22 17:58:10 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-3c34b0f7-28ac-447d-be9c-3a77344bc3d8 tempest-VolumeDependencyTests-1342970489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b5f27f97-ac85-4453-b8d7-ed21791d840a.info" returned: 0 in 0.595s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:58:11 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-3c34b0f7-28ac-447d-be9c-3a77344bc3d8 tempest-VolumeDependencyTests-1342970489 None] Acquiring lock "cinder-quobyte-2864d2cf-e821-4b70-b589-d05499ebafa3" by "_copy_volume_from_snapshot" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:58:11 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-3c34b0f7-28ac-447d-be9c-3a77344bc3d8 tempest-VolumeDependencyTests-1342970489 None] Lock "cinder-quobyte-2864d2cf-e821-4b70-b589-d05499ebafa3" acquired by "_copy_volume_from_snapshot" :: waited 0.036s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:58:11 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-3c34b0f7-28ac-447d-be9c-3a77344bc3d8 tempest-VolumeDependencyTests-1342970489 None] snapshot: a694190d-635a-421d-96b4-99a9fe530e8e, volume: 2864d2cf-e821-4b70-b589-d05499ebafa3, {{(pid=81771) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 22 17:58:11 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-3c34b0f7-28ac-447d-be9c-3a77344bc3d8 tempest-VolumeDependencyTests-1342970489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:58:11 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-3c34b0f7-28ac-447d-be9c-3a77344bc3d8 tempest-VolumeDependencyTests-1342970489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:58:11 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-3c34b0f7-28ac-447d-be9c-3a77344bc3d8 tempest-VolumeDependencyTests-1342970489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:58:11 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-3c34b0f7-28ac-447d-be9c-3a77344bc3d8 tempest-VolumeDependencyTests-1342970489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:58:11 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-3c34b0f7-28ac-447d-be9c-3a77344bc3d8 tempest-VolumeDependencyTests-1342970489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:58:11 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-fe29f51d-e2c6-485a-97a1-3f0d95fbf39c tempest-VolumesNegativeTest-739465406 None] Acquiring lock "cinder-6054ab2f-ba89-48c4-b6b8-f52e729f6c6e-delete_volume" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:58:11 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-fe29f51d-e2c6-485a-97a1-3f0d95fbf39c tempest-VolumesNegativeTest-739465406 None] Lock "cinder-6054ab2f-ba89-48c4-b6b8-f52e729f6c6e-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:58:11 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[52bfb908-6bd4-4d74-9f0d-e80b7a15f896]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:58:11 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-3c34b0f7-28ac-447d-be9c-3a77344bc3d8 tempest-VolumeDependencyTests-1342970489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b5f27f97-ac85-4453-b8d7-ed21791d840a.a694190d-635a-421d-96b4-99a9fe530e8e {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:58:11 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-fe29f51d-e2c6-485a-97a1-3f0d95fbf39c tempest-VolumesNegativeTest-739465406 None] Acquiring lock "cinder-quobyte-6054ab2f-ba89-48c4-b6b8-f52e729f6c6e" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:58:11 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-fe29f51d-e2c6-485a-97a1-3f0d95fbf39c tempest-VolumesNegativeTest-739465406 None] Lock "cinder-quobyte-6054ab2f-ba89-48c4-b6b8-f52e729f6c6e" acquired by "delete_volume" :: waited 0.025s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:58:11 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[13098c90-5831-4b56-a4dc-d5e0c4d80cc0]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:58:11 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-fe29f51d-e2c6-485a-97a1-3f0d95fbf39c tempest-VolumesNegativeTest-739465406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-6054ab2f-ba89-48c4-b6b8-f52e729f6c6e {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:58:11 devstack sudo[89133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b5f27f97-ac85-4453-b8d7-ed21791d840a.a694190d-635a-421d-96b4-99a9fe530e8e Apr 22 17:58:11 devstack sudo[89133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:58:11 devstack sudo[89134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-6054ab2f-ba89-48c4-b6b8-f52e729f6c6e Apr 22 17:58:11 devstack sudo[89134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:58:11 devstack sudo[89133]: pam_unix(sudo:session): session closed for user root Apr 22 17:58:11 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-3c34b0f7-28ac-447d-be9c-3a77344bc3d8 tempest-VolumeDependencyTests-1342970489 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b5f27f97-ac85-4453-b8d7-ed21791d840a.a694190d-635a-421d-96b4-99a9fe530e8e" returned: 0 in 0.632s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:58:11 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-3c34b0f7-28ac-447d-be9c-3a77344bc3d8 tempest-VolumeDependencyTests-1342970489 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b5f27f97-ac85-4453-b8d7-ed21791d840a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81771) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 22 17:58:11 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-3c34b0f7-28ac-447d-be9c-3a77344bc3d8 tempest-VolumeDependencyTests-1342970489 None] will copy from snapshot at /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b5f27f97-ac85-4453-b8d7-ed21791d840a {{(pid=81771) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 22 17:58:11 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-3c34b0f7-28ac-447d-be9c-3a77344bc3d8 tempest-VolumeDependencyTests-1342970489 None] Creating direct copy from snapshot {{(pid=81771) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 22 17:58:11 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[50cdeaa3-c1d6-4ef3-88b7-51cd807cd91d]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:58:11 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-3c34b0f7-28ac-447d-be9c-3a77344bc3d8 tempest-VolumeDependencyTests-1342970489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b5f27f97-ac85-4453-b8d7-ed21791d840a {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:58:11 devstack sudo[89143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b5f27f97-ac85-4453-b8d7-ed21791d840a Apr 22 17:58:11 devstack sudo[89143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:58:11 devstack sudo[89134]: pam_unix(sudo:session): session closed for user root Apr 22 17:58:11 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-fe29f51d-e2c6-485a-97a1-3f0d95fbf39c tempest-VolumesNegativeTest-739465406 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-6054ab2f-ba89-48c4-b6b8-f52e729f6c6e" returned: 0 in 0.685s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:58:11 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-fe29f51d-e2c6-485a-97a1-3f0d95fbf39c tempest-VolumesNegativeTest-739465406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-6054ab2f-ba89-48c4-b6b8-f52e729f6c6e {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:58:11 devstack sudo[89145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-6054ab2f-ba89-48c4-b6b8-f52e729f6c6e Apr 22 17:58:11 devstack sudo[89145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:58:12 devstack sudo[89143]: pam_unix(sudo:session): session closed for user root Apr 22 17:58:12 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-3c34b0f7-28ac-447d-be9c-3a77344bc3d8 tempest-VolumeDependencyTests-1342970489 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b5f27f97-ac85-4453-b8d7-ed21791d840a" returned: 0 in 0.595s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:58:12 devstack cinder-volume[81771]: DEBUG cinder.utils [None req-3c34b0f7-28ac-447d-be9c-3a77344bc3d8 tempest-VolumeDependencyTests-1342970489 None] Path /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-2864d2cf-e821-4b70-b589-d05499ebafa3 not found in is_blk_device check {{(pid=81771) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 22 17:58:12 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-3c34b0f7-28ac-447d-be9c-3a77344bc3d8 tempest-VolumeDependencyTests-1342970489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b5f27f97-ac85-4453-b8d7-ed21791d840a /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-2864d2cf-e821-4b70-b589-d05499ebafa3 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:58:12 devstack sudo[89151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b5f27f97-ac85-4453-b8d7-ed21791d840a /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-2864d2cf-e821-4b70-b589-d05499ebafa3 Apr 22 17:58:12 devstack sudo[89151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:58:12 devstack sudo[89145]: pam_unix(sudo:session): session closed for user root Apr 22 17:58:12 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-fe29f51d-e2c6-485a-97a1-3f0d95fbf39c tempest-VolumesNegativeTest-739465406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-6054ab2f-ba89-48c4-b6b8-f52e729f6c6e" returned: 0 in 0.565s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:58:12 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-fe29f51d-e2c6-485a-97a1-3f0d95fbf39c tempest-VolumesNegativeTest-739465406 None] Lock "cinder-quobyte-6054ab2f-ba89-48c4-b6b8-f52e729f6c6e" released by "delete_volume" :: held 1.299s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:58:12 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-fe29f51d-e2c6-485a-97a1-3f0d95fbf39c tempest-VolumesNegativeTest-739465406 None] Created reservations ['0feaeab8-c767-4bed-983b-5547f9725100', '07d01d15-b754-4b84-a14c-e9d932069096', '1b9d0fbe-8914-4c19-9374-81f89b9c9a74', '235f6e73-98e2-447e-ba6f-48e797152e85'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 17:58:12 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-fe29f51d-e2c6-485a-97a1-3f0d95fbf39c tempest-VolumesNegativeTest-739465406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:58:12 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-fe29f51d-e2c6-485a-97a1-3f0d95fbf39c tempest-VolumesNegativeTest-739465406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:58:12 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-fe29f51d-e2c6-485a-97a1-3f0d95fbf39c tempest-VolumesNegativeTest-739465406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:58:12 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-fe29f51d-e2c6-485a-97a1-3f0d95fbf39c tempest-VolumesNegativeTest-739465406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:58:12 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-fe29f51d-e2c6-485a-97a1-3f0d95fbf39c tempest-VolumesNegativeTest-739465406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:58:12 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-fe29f51d-e2c6-485a-97a1-3f0d95fbf39c tempest-VolumesNegativeTest-739465406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:58:12 devstack sudo[89153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 Apr 22 17:58:12 devstack sudo[89153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:58:13 devstack sudo[89153]: pam_unix(sudo:session): session closed for user root Apr 22 17:58:13 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-fe29f51d-e2c6-485a-97a1-3f0d95fbf39c tempest-VolumesNegativeTest-739465406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33" returned: 0 in 1.117s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:58:13 devstack cinder-volume[81771]: DEBUG cinder.manager [None req-fe29f51d-e2c6-485a-97a1-3f0d95fbf39c tempest-VolumesNegativeTest-739465406 None] Notifying Schedulers of capabilities ... {{(pid=81771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 17:58:13 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-fe29f51d-e2c6-485a-97a1-3f0d95fbf39c tempest-VolumesNegativeTest-739465406 None] Deleted volume successfully. Apr 22 17:58:13 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-fe29f51d-e2c6-485a-97a1-3f0d95fbf39c tempest-VolumesNegativeTest-739465406 None] Lock "cinder-6054ab2f-ba89-48c4-b6b8-f52e729f6c6e-delete_volume" released by "delete_volume" :: held 2.772s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:58:18 devstack cinder-volume[81771]: DEBUG cinder.volume.flows.manager.create_volume [None req-e284c73e-7504-453a-a37c-9668ca315bb8 tempest-CinderUnicodeTest-626251776 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 17:58:18 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-e284c73e-7504-453a-a37c-9668ca315bb8 tempest-CinderUnicodeTest-626251776 None] Flow 'volume_create_manager' (240d104a-4f0a-4420-ada8-261fa0f777de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:58:18 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-e284c73e-7504-453a-a37c-9668ca315bb8 tempest-CinderUnicodeTest-626251776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0378266b-c354-4ddd-902f-54877ff4f979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:58:18 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-e284c73e-7504-453a-a37c-9668ca315bb8 tempest-CinderUnicodeTest-626251776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0378266b-c354-4ddd-902f-54877ff4f979) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:58:18Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d0c8786-b392-476c-899a-cbb91593b726,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='477860a62d48440f92bc21582783041a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:58:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:58:18Z,use_quota=True,user_id='172197bf582b4067bca7cb6b92f9641b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:58:18 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-e284c73e-7504-453a-a37c-9668ca315bb8 tempest-CinderUnicodeTest-626251776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08509745-1529-4178-a2a2-f70bf6e38be7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:58:18 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-e284c73e-7504-453a-a37c-9668ca315bb8 tempest-CinderUnicodeTest-626251776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08509745-1529-4178-a2a2-f70bf6e38be7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:58:18 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-e284c73e-7504-453a-a37c-9668ca315bb8 tempest-CinderUnicodeTest-626251776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0303aa34-3864-44e9-9937-2b5de3a8c1d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:58:18 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-e284c73e-7504-453a-a37c-9668ca315bb8 tempest-CinderUnicodeTest-626251776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0303aa34-3864-44e9-9937-2b5de3a8c1d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d0c8786-b392-476c-899a-cbb91593b726', 'volume_name': 'volume-7d0c8786-b392-476c-899a-cbb91593b726', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:58:18 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-e284c73e-7504-453a-a37c-9668ca315bb8 tempest-CinderUnicodeTest-626251776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9b53a77-0b48-4c93-9771-30d170196881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:58:18 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-e284c73e-7504-453a-a37c-9668ca315bb8 tempest-CinderUnicodeTest-626251776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9b53a77-0b48-4c93-9771-30d170196881) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:58:18 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-e284c73e-7504-453a-a37c-9668ca315bb8 tempest-CinderUnicodeTest-626251776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc7939c6-ae6d-4fe6-93c9-9344ae1d6b12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:58:18 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-e284c73e-7504-453a-a37c-9668ca315bb8 tempest-CinderUnicodeTest-626251776 None] Volume 7d0c8786-b392-476c-899a-cbb91593b726: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d0c8786-b392-476c-899a-cbb91593b726', 'volume_size': 1} Apr 22 17:58:18 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-e284c73e-7504-453a-a37c-9668ca315bb8 tempest-CinderUnicodeTest-626251776 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:58:19 devstack sudo[89151]: pam_unix(sudo:session): session closed for user root Apr 22 17:58:19 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-3c34b0f7-28ac-447d-be9c-3a77344bc3d8 tempest-VolumeDependencyTests-1342970489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b5f27f97-ac85-4453-b8d7-ed21791d840a /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-2864d2cf-e821-4b70-b589-d05499ebafa3" returned: 0 in 6.630s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:58:19 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae78c189-6377-412a-969d-0d9f2a69d2a3]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:58:19 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-3c34b0f7-28ac-447d-be9c-3a77344bc3d8 tempest-VolumeDependencyTests-1342970489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b5f27f97-ac85-4453-b8d7-ed21791d840a {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:58:19 devstack sudo[89187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b5f27f97-ac85-4453-b8d7-ed21791d840a Apr 22 17:58:19 devstack sudo[89187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:58:19 devstack sudo[89187]: pam_unix(sudo:session): session closed for user root Apr 22 17:58:19 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-3c34b0f7-28ac-447d-be9c-3a77344bc3d8 tempest-VolumeDependencyTests-1342970489 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b5f27f97-ac85-4453-b8d7-ed21791d840a" returned: 0 in 0.658s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:58:19 devstack cinder-volume[81771]: DEBUG cinder.image.image_utils [None req-3c34b0f7-28ac-447d-be9c-3a77344bc3d8 tempest-VolumeDependencyTests-1342970489 None] Image conversion details: src /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b5f27f97-ac85-4453-b8d7-ed21791d840a, size 1024.00 MB, duration 6.63 sec, destination /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-2864d2cf-e821-4b70-b589-d05499ebafa3 {{(pid=81771) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 22 17:58:19 devstack cinder-volume[81771]: INFO cinder.image.image_utils [None req-3c34b0f7-28ac-447d-be9c-3a77344bc3d8 tempest-VolumeDependencyTests-1342970489 None] Converted 1024.00 MB image at 154.41 MB/s Apr 22 17:58:19 devstack cinder-volume[81771]: WARNING cinder.volume.drivers.remotefs [None req-3c34b0f7-28ac-447d-be9c-3a77344bc3d8 tempest-VolumeDependencyTests-1342970489 None] /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-2864d2cf-e821-4b70-b589-d05499ebafa3 is being set with open permissions: ugo+rw Apr 22 17:58:19 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-3c34b0f7-28ac-447d-be9c-3a77344bc3d8 tempest-VolumeDependencyTests-1342970489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-2864d2cf-e821-4b70-b589-d05499ebafa3 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:58:19 devstack sudo[89192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-2864d2cf-e821-4b70-b589-d05499ebafa3 Apr 22 17:58:19 devstack sudo[89192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:58:20 devstack sudo[89192]: pam_unix(sudo:session): session closed for user root Apr 22 17:58:20 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-3c34b0f7-28ac-447d-be9c-3a77344bc3d8 tempest-VolumeDependencyTests-1342970489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-2864d2cf-e821-4b70-b589-d05499ebafa3" returned: 0 in 0.441s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:58:20 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-3c34b0f7-28ac-447d-be9c-3a77344bc3d8 tempest-VolumeDependencyTests-1342970489 None] Lock "cinder-quobyte-2864d2cf-e821-4b70-b589-d05499ebafa3" released by "_copy_volume_from_snapshot" :: held 9.135s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:58:20 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-3c34b0f7-28ac-447d-be9c-3a77344bc3d8 tempest-VolumeDependencyTests-1342970489 None] Acquiring lock "cinder-quobyte-a694190d-635a-421d-96b4-99a9fe530e8e" by "_delete_snapshot" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:58:20 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-3c34b0f7-28ac-447d-be9c-3a77344bc3d8 tempest-VolumeDependencyTests-1342970489 None] Lock "cinder-quobyte-a694190d-635a-421d-96b4-99a9fe530e8e" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:58:20 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-3c34b0f7-28ac-447d-be9c-3a77344bc3d8 tempest-VolumeDependencyTests-1342970489 None] Deleting offline snapshot a694190d-635a-421d-96b4-99a9fe530e8e of volume b5f27f97-ac85-4453-b8d7-ed21791d840a {{(pid=81771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 22 17:58:20 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-3c34b0f7-28ac-447d-be9c-3a77344bc3d8 tempest-VolumeDependencyTests-1342970489 None] snapshot_file for this snap is: volume-b5f27f97-ac85-4453-b8d7-ed21791d840a.a694190d-635a-421d-96b4-99a9fe530e8e {{(pid=81771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 22 17:58:20 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[889803c5-772f-4ffe-a726-03b560fe0273]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:58:20 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-3c34b0f7-28ac-447d-be9c-3a77344bc3d8 tempest-VolumeDependencyTests-1342970489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b5f27f97-ac85-4453-b8d7-ed21791d840a.a694190d-635a-421d-96b4-99a9fe530e8e {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:58:20 devstack sudo[89195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b5f27f97-ac85-4453-b8d7-ed21791d840a.a694190d-635a-421d-96b4-99a9fe530e8e Apr 22 17:58:20 devstack sudo[89195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:58:20 devstack sudo[89195]: pam_unix(sudo:session): session closed for user root Apr 22 17:58:20 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-3c34b0f7-28ac-447d-be9c-3a77344bc3d8 tempest-VolumeDependencyTests-1342970489 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b5f27f97-ac85-4453-b8d7-ed21791d840a.a694190d-635a-421d-96b4-99a9fe530e8e" returned: 0 in 0.562s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:58:20 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-3c34b0f7-28ac-447d-be9c-3a77344bc3d8 tempest-VolumeDependencyTests-1342970489 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b5f27f97-ac85-4453-b8d7-ed21791d840a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81771) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 22 17:58:20 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[c04c538e-ec95-4ce0-8b8d-3bc2d071476e]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:58:20 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-3c34b0f7-28ac-447d-be9c-3a77344bc3d8 tempest-VolumeDependencyTests-1342970489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b5f27f97-ac85-4453-b8d7-ed21791d840a {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:58:20 devstack sudo[89200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b5f27f97-ac85-4453-b8d7-ed21791d840a Apr 22 17:58:20 devstack sudo[89200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:58:21 devstack sudo[89200]: pam_unix(sudo:session): session closed for user root Apr 22 17:58:21 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-3c34b0f7-28ac-447d-be9c-3a77344bc3d8 tempest-VolumeDependencyTests-1342970489 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b5f27f97-ac85-4453-b8d7-ed21791d840a" returned: 0 in 0.509s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:58:21 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-3c34b0f7-28ac-447d-be9c-3a77344bc3d8 tempest-VolumeDependencyTests-1342970489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b5f27f97-ac85-4453-b8d7-ed21791d840a.a694190d-635a-421d-96b4-99a9fe530e8e {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:58:21 devstack sudo[89205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b5f27f97-ac85-4453-b8d7-ed21791d840a.a694190d-635a-421d-96b4-99a9fe530e8e Apr 22 17:58:21 devstack sudo[89205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:58:21 devstack sudo[89205]: pam_unix(sudo:session): session closed for user root Apr 22 17:58:21 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-3c34b0f7-28ac-447d-be9c-3a77344bc3d8 tempest-VolumeDependencyTests-1342970489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b5f27f97-ac85-4453-b8d7-ed21791d840a.a694190d-635a-421d-96b4-99a9fe530e8e" returned: 0 in 0.554s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:58:21 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-3c34b0f7-28ac-447d-be9c-3a77344bc3d8 tempest-VolumeDependencyTests-1342970489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b5f27f97-ac85-4453-b8d7-ed21791d840a.a694190d-635a-421d-96b4-99a9fe530e8e {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:58:21 devstack sudo[89210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b5f27f97-ac85-4453-b8d7-ed21791d840a.a694190d-635a-421d-96b4-99a9fe530e8e Apr 22 17:58:21 devstack sudo[89210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:58:22 devstack sudo[89210]: pam_unix(sudo:session): session closed for user root Apr 22 17:58:22 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-3c34b0f7-28ac-447d-be9c-3a77344bc3d8 tempest-VolumeDependencyTests-1342970489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b5f27f97-ac85-4453-b8d7-ed21791d840a.a694190d-635a-421d-96b4-99a9fe530e8e" returned: 0 in 0.417s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:58:22 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-3c34b0f7-28ac-447d-be9c-3a77344bc3d8 tempest-VolumeDependencyTests-1342970489 None] Lock "cinder-quobyte-a694190d-635a-421d-96b4-99a9fe530e8e" released by "_delete_snapshot" :: held 2.133s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:58:22 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-3c34b0f7-28ac-447d-be9c-3a77344bc3d8 tempest-VolumeDependencyTests-1342970489 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.817s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:58:22 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-c0fccc21-a364-40dd-ad78-0cce0f4404ad tempest-VolumesActionsTest-678062019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.302s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:58:22 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-c0fccc21-a364-40dd-ad78-0cce0f4404ad tempest-VolumesActionsTest-678062019 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:58:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1540584483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d833ec9-4529-4e71-931e-32c62898e75e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd5ed77be0ee418cb4f7816bd70e7b2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:58:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:58:07Z,use_quota=True,user_id='fa7c9a3bff17449bb4b6fcd3fa13fb1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)}" {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 17:58:22 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-c0fccc21-a364-40dd-ad78-0cce0f4404ad tempest-VolumesActionsTest-678062019 None] Creating volume 5d833ec9-4529-4e71-931e-32c62898e75e {{(pid=81771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 17:58:22 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-c0fccc21-a364-40dd-ad78-0cce0f4404ad tempest-VolumesActionsTest-678062019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:58:22 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-c0fccc21-a364-40dd-ad78-0cce0f4404ad tempest-VolumesActionsTest-678062019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:58:22 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-c0fccc21-a364-40dd-ad78-0cce0f4404ad tempest-VolumesActionsTest-678062019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:58:22 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-c0fccc21-a364-40dd-ad78-0cce0f4404ad tempest-VolumesActionsTest-678062019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:58:22 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-c0fccc21-a364-40dd-ad78-0cce0f4404ad tempest-VolumesActionsTest-678062019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:58:22 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-c0fccc21-a364-40dd-ad78-0cce0f4404ad tempest-VolumesActionsTest-678062019 None] Selected osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 as target Quobyte volume. {{(pid=81771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 17:58:22 devstack cinder-volume[81771]: INFO cinder.volume.drivers.remotefs [None req-c0fccc21-a364-40dd-ad78-0cce0f4404ad tempest-VolumesActionsTest-678062019 None] casted to osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 Apr 22 17:58:22 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-c0fccc21-a364-40dd-ad78-0cce0f4404ad tempest-VolumesActionsTest-678062019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-5d833ec9-4529-4e71-931e-32c62898e75e 1073741824 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:58:22 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-3c34b0f7-28ac-447d-be9c-3a77344bc3d8 tempest-VolumeDependencyTests-1342970489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9120d9c-12cb-4d46-bcb7-46122f6803d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2864d2cf-e821-4b70-b589-d05499ebafa3', 'volume_size': 1, 'source_volid': 'b5f27f97-ac85-4453-b8d7-ed21791d840a', 'source_volstatus': 'available'}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:58:22 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-3c34b0f7-28ac-447d-be9c-3a77344bc3d8 tempest-VolumeDependencyTests-1342970489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cfc5943-48c9-40ef-a2cc-826893d604c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:58:22 devstack sudo[89213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-5d833ec9-4529-4e71-931e-32c62898e75e 1073741824 Apr 22 17:58:22 devstack sudo[89213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:58:22 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-3c34b0f7-28ac-447d-be9c-3a77344bc3d8 tempest-VolumeDependencyTests-1342970489 None] Volume volume-2864d2cf-e821-4b70-b589-d05499ebafa3 (2864d2cf-e821-4b70-b589-d05499ebafa3): created successfully Apr 22 17:58:22 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-3c34b0f7-28ac-447d-be9c-3a77344bc3d8 tempest-VolumeDependencyTests-1342970489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cfc5943-48c9-40ef-a2cc-826893d604c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:58:22 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-3c34b0f7-28ac-447d-be9c-3a77344bc3d8 tempest-VolumeDependencyTests-1342970489 None] Flow 'volume_create_manager' (984f7565-8719-43fb-afdd-2e640d4118fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:58:22 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-3c34b0f7-28ac-447d-be9c-3a77344bc3d8 tempest-VolumeDependencyTests-1342970489 None] Created volume successfully. Apr 22 17:58:23 devstack sudo[89213]: pam_unix(sudo:session): session closed for user root Apr 22 17:58:23 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-c0fccc21-a364-40dd-ad78-0cce0f4404ad tempest-VolumesActionsTest-678062019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-5d833ec9-4529-4e71-931e-32c62898e75e 1073741824" returned: 0 in 0.675s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:58:23 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-c0fccc21-a364-40dd-ad78-0cce0f4404ad tempest-VolumesActionsTest-678062019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-5d833ec9-4529-4e71-931e-32c62898e75e {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:58:23 devstack sudo[89218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-5d833ec9-4529-4e71-931e-32c62898e75e Apr 22 17:58:23 devstack sudo[89218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:58:23 devstack sudo[89218]: pam_unix(sudo:session): session closed for user root Apr 22 17:58:23 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-c0fccc21-a364-40dd-ad78-0cce0f4404ad tempest-VolumesActionsTest-678062019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-5d833ec9-4529-4e71-931e-32c62898e75e" returned: 0 in 0.437s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:58:23 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-c0fccc21-a364-40dd-ad78-0cce0f4404ad tempest-VolumesActionsTest-678062019 None] <== create_volume: return (1149ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'} {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 17:58:23 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-c0fccc21-a364-40dd-ad78-0cce0f4404ad tempest-VolumesActionsTest-678062019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.151s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:58:23 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-f9f8e14c-df88-4cdb-8871-c83855964019 tempest-VolumesSnapshotTestJSON-1790417655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.823s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:58:23 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-f9f8e14c-df88-4cdb-8871-c83855964019 tempest-VolumesSnapshotTestJSON-1790417655 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:58:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2042238491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d097496-766b-4bc2-9799-7ffc87065451,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afd9a86ddfc94168aaf00fc1e9b425f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:58:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:58:08Z,use_quota=True,user_id='e1b4ff9f921345ce968b249e8ba0c04b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)}" {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 17:58:23 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-f9f8e14c-df88-4cdb-8871-c83855964019 tempest-VolumesSnapshotTestJSON-1790417655 None] Creating volume 7d097496-766b-4bc2-9799-7ffc87065451 {{(pid=81771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 17:58:23 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-f9f8e14c-df88-4cdb-8871-c83855964019 tempest-VolumesSnapshotTestJSON-1790417655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:58:23 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-f9f8e14c-df88-4cdb-8871-c83855964019 tempest-VolumesSnapshotTestJSON-1790417655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:58:23 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-f9f8e14c-df88-4cdb-8871-c83855964019 tempest-VolumesSnapshotTestJSON-1790417655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:58:23 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-f9f8e14c-df88-4cdb-8871-c83855964019 tempest-VolumesSnapshotTestJSON-1790417655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:58:23 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-f9f8e14c-df88-4cdb-8871-c83855964019 tempest-VolumesSnapshotTestJSON-1790417655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:58:23 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-f9f8e14c-df88-4cdb-8871-c83855964019 tempest-VolumesSnapshotTestJSON-1790417655 None] Selected osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 as target Quobyte volume. {{(pid=81771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 17:58:23 devstack cinder-volume[81771]: INFO cinder.volume.drivers.remotefs [None req-f9f8e14c-df88-4cdb-8871-c83855964019 tempest-VolumesSnapshotTestJSON-1790417655 None] casted to osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 Apr 22 17:58:23 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-f9f8e14c-df88-4cdb-8871-c83855964019 tempest-VolumesSnapshotTestJSON-1790417655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7d097496-766b-4bc2-9799-7ffc87065451 1073741824 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:58:23 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-6340bb1c-1302-41fb-9d52-bf2a9eb73807 tempest-VolumeDependencyTests-1342970489 None] Acquiring lock "cinder-b5f27f97-ac85-4453-b8d7-ed21791d840a-delete_volume" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:58:23 devstack sudo[89221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7d097496-766b-4bc2-9799-7ffc87065451 1073741824 Apr 22 17:58:23 devstack sudo[89221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:58:23 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-c0fccc21-a364-40dd-ad78-0cce0f4404ad tempest-VolumesActionsTest-678062019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9c32919-639c-44a7-8873-77b414db0dec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d833ec9-4529-4e71-931e-32c62898e75e', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:58:23 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-c0fccc21-a364-40dd-ad78-0cce0f4404ad tempest-VolumesActionsTest-678062019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ced03048-46fb-4518-8a3c-595c855bf1bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:58:23 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-6340bb1c-1302-41fb-9d52-bf2a9eb73807 tempest-VolumeDependencyTests-1342970489 None] Lock "cinder-b5f27f97-ac85-4453-b8d7-ed21791d840a-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:58:23 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-c0fccc21-a364-40dd-ad78-0cce0f4404ad tempest-VolumesActionsTest-678062019 None] Volume volume-5d833ec9-4529-4e71-931e-32c62898e75e (5d833ec9-4529-4e71-931e-32c62898e75e): created successfully Apr 22 17:58:23 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-c0fccc21-a364-40dd-ad78-0cce0f4404ad tempest-VolumesActionsTest-678062019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ced03048-46fb-4518-8a3c-595c855bf1bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:58:23 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-c0fccc21-a364-40dd-ad78-0cce0f4404ad tempest-VolumesActionsTest-678062019 None] Flow 'volume_create_manager' (bc598e96-8d01-4505-96a7-1a4a0dda6cca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:58:23 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-c0fccc21-a364-40dd-ad78-0cce0f4404ad tempest-VolumesActionsTest-678062019 None] Created volume successfully. Apr 22 17:58:23 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-6340bb1c-1302-41fb-9d52-bf2a9eb73807 tempest-VolumeDependencyTests-1342970489 None] Acquiring lock "cinder-quobyte-b5f27f97-ac85-4453-b8d7-ed21791d840a" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:58:23 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-6340bb1c-1302-41fb-9d52-bf2a9eb73807 tempest-VolumeDependencyTests-1342970489 None] Lock "cinder-quobyte-b5f27f97-ac85-4453-b8d7-ed21791d840a" acquired by "delete_volume" :: waited 0.016s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:58:23 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a7689d6-cdd2-4ae4-a9f5-f7450ef34735]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:58:23 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-6340bb1c-1302-41fb-9d52-bf2a9eb73807 tempest-VolumeDependencyTests-1342970489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b5f27f97-ac85-4453-b8d7-ed21791d840a {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:58:23 devstack sudo[89223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b5f27f97-ac85-4453-b8d7-ed21791d840a Apr 22 17:58:23 devstack sudo[89223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:58:24 devstack sudo[89221]: pam_unix(sudo:session): session closed for user root Apr 22 17:58:24 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-f9f8e14c-df88-4cdb-8871-c83855964019 tempest-VolumesSnapshotTestJSON-1790417655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7d097496-766b-4bc2-9799-7ffc87065451 1073741824" returned: 0 in 0.715s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:58:24 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-f9f8e14c-df88-4cdb-8871-c83855964019 tempest-VolumesSnapshotTestJSON-1790417655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7d097496-766b-4bc2-9799-7ffc87065451 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:58:24 devstack sudo[89231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7d097496-766b-4bc2-9799-7ffc87065451 Apr 22 17:58:24 devstack sudo[89231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:58:24 devstack sudo[89223]: pam_unix(sudo:session): session closed for user root Apr 22 17:58:24 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-6340bb1c-1302-41fb-9d52-bf2a9eb73807 tempest-VolumeDependencyTests-1342970489 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b5f27f97-ac85-4453-b8d7-ed21791d840a" returned: 0 in 0.572s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:58:24 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-6340bb1c-1302-41fb-9d52-bf2a9eb73807 tempest-VolumeDependencyTests-1342970489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b5f27f97-ac85-4453-b8d7-ed21791d840a {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:58:24 devstack sudo[89233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b5f27f97-ac85-4453-b8d7-ed21791d840a Apr 22 17:58:24 devstack sudo[89233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:58:24 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-c368de0a-d0eb-4ecf-9de2-9fdd1e47a0be tempest-VolumesActionsTest-678062019 None] Acquiring lock "cinder-5d833ec9-4529-4e71-931e-32c62898e75e" by "attach_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:58:24 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-c368de0a-d0eb-4ecf-9de2-9fdd1e47a0be tempest-VolumesActionsTest-678062019 None] Lock "cinder-5d833ec9-4529-4e71-931e-32c62898e75e" acquired by "attach_volume" :: waited 0.019s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:58:24 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-c368de0a-d0eb-4ecf-9de2-9fdd1e47a0be tempest-VolumesActionsTest-678062019 None] Attaching volume 5d833ec9-4529-4e71-931e-32c62898e75e to instance 868b8d07-e965-4b5e-9a5c-ecd0a1356471 at mountpoint /dev/vdb on host None. Apr 22 17:58:24 devstack sudo[89231]: pam_unix(sudo:session): session closed for user root Apr 22 17:58:24 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-f9f8e14c-df88-4cdb-8871-c83855964019 tempest-VolumesSnapshotTestJSON-1790417655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7d097496-766b-4bc2-9799-7ffc87065451" returned: 0 in 0.509s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:58:24 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-f9f8e14c-df88-4cdb-8871-c83855964019 tempest-VolumesSnapshotTestJSON-1790417655 None] <== create_volume: return (1270ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'} {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 17:58:24 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-f9f8e14c-df88-4cdb-8871-c83855964019 tempest-VolumesSnapshotTestJSON-1790417655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.273s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:58:24 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-e284c73e-7504-453a-a37c-9668ca315bb8 tempest-CinderUnicodeTest-626251776 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.248s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:58:24 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-e284c73e-7504-453a-a37c-9668ca315bb8 tempest-CinderUnicodeTest-626251776 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:58:18Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d0c8786-b392-476c-899a-cbb91593b726,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='477860a62d48440f92bc21582783041a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:58:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:58:18Z,use_quota=True,user_id='172197bf582b4067bca7cb6b92f9641b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)}" {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 17:58:24 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-e284c73e-7504-453a-a37c-9668ca315bb8 tempest-CinderUnicodeTest-626251776 None] Creating volume 7d0c8786-b392-476c-899a-cbb91593b726 {{(pid=81771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 17:58:24 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-e284c73e-7504-453a-a37c-9668ca315bb8 tempest-CinderUnicodeTest-626251776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:58:24 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-e284c73e-7504-453a-a37c-9668ca315bb8 tempest-CinderUnicodeTest-626251776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:58:24 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-e284c73e-7504-453a-a37c-9668ca315bb8 tempest-CinderUnicodeTest-626251776 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:58:24 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-e284c73e-7504-453a-a37c-9668ca315bb8 tempest-CinderUnicodeTest-626251776 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:58:24 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-e284c73e-7504-453a-a37c-9668ca315bb8 tempest-CinderUnicodeTest-626251776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:58:24 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-e284c73e-7504-453a-a37c-9668ca315bb8 tempest-CinderUnicodeTest-626251776 None] Selected osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 as target Quobyte volume. {{(pid=81771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 17:58:24 devstack cinder-volume[81771]: INFO cinder.volume.drivers.remotefs [None req-e284c73e-7504-453a-a37c-9668ca315bb8 tempest-CinderUnicodeTest-626251776 None] casted to osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 Apr 22 17:58:24 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-e284c73e-7504-453a-a37c-9668ca315bb8 tempest-CinderUnicodeTest-626251776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7d0c8786-b392-476c-899a-cbb91593b726 1073741824 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:58:24 devstack sudo[89237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7d0c8786-b392-476c-899a-cbb91593b726 1073741824 Apr 22 17:58:24 devstack sudo[89237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:58:24 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-f9f8e14c-df88-4cdb-8871-c83855964019 tempest-VolumesSnapshotTestJSON-1790417655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96ffd491-63e8-405c-9058-b3a23ccf0d95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d097496-766b-4bc2-9799-7ffc87065451', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:58:24 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-f9f8e14c-df88-4cdb-8871-c83855964019 tempest-VolumesSnapshotTestJSON-1790417655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc1dff4a-cb6b-4adf-a8db-15094578fc5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:58:24 devstack sudo[89233]: pam_unix(sudo:session): session closed for user root Apr 22 17:58:24 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-c368de0a-d0eb-4ecf-9de2-9fdd1e47a0be tempest-VolumesActionsTest-678062019 None] Attach volume completed successfully. Apr 22 17:58:24 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-6340bb1c-1302-41fb-9d52-bf2a9eb73807 tempest-VolumeDependencyTests-1342970489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b5f27f97-ac85-4453-b8d7-ed21791d840a" returned: 0 in 0.544s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:58:24 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-f9f8e14c-df88-4cdb-8871-c83855964019 tempest-VolumesSnapshotTestJSON-1790417655 None] Volume volume-7d097496-766b-4bc2-9799-7ffc87065451 (7d097496-766b-4bc2-9799-7ffc87065451): created successfully Apr 22 17:58:24 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-f9f8e14c-df88-4cdb-8871-c83855964019 tempest-VolumesSnapshotTestJSON-1790417655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc1dff4a-cb6b-4adf-a8db-15094578fc5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:58:24 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-f9f8e14c-df88-4cdb-8871-c83855964019 tempest-VolumesSnapshotTestJSON-1790417655 None] Flow 'volume_create_manager' (09c3e184-6874-4bf3-becc-b1e88f93b1b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:58:24 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-6340bb1c-1302-41fb-9d52-bf2a9eb73807 tempest-VolumeDependencyTests-1342970489 None] Lock "cinder-quobyte-b5f27f97-ac85-4453-b8d7-ed21791d840a" released by "delete_volume" :: held 1.196s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:58:24 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-c368de0a-d0eb-4ecf-9de2-9fdd1e47a0be tempest-VolumesActionsTest-678062019 None] Lock "cinder-5d833ec9-4529-4e71-931e-32c62898e75e" released by "attach_volume" :: held 0.185s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:58:24 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-f9f8e14c-df88-4cdb-8871-c83855964019 tempest-VolumesSnapshotTestJSON-1790417655 None] Created volume successfully. Apr 22 17:58:24 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-6340bb1c-1302-41fb-9d52-bf2a9eb73807 tempest-VolumeDependencyTests-1342970489 None] Created reservations ['1dd687f1-9567-48d1-b3db-c487c67b2868', '339e73e6-3062-4ab8-b8ab-7fb8a2686659', 'cb2254cf-c41f-460f-8129-096184bfa16f', 'eccb5b1c-f737-4120-a4a1-74e1c242ee20'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 17:58:25 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-6340bb1c-1302-41fb-9d52-bf2a9eb73807 tempest-VolumeDependencyTests-1342970489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:58:25 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-6340bb1c-1302-41fb-9d52-bf2a9eb73807 tempest-VolumeDependencyTests-1342970489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:58:25 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-6340bb1c-1302-41fb-9d52-bf2a9eb73807 tempest-VolumeDependencyTests-1342970489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:58:25 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-6340bb1c-1302-41fb-9d52-bf2a9eb73807 tempest-VolumeDependencyTests-1342970489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:58:25 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-6340bb1c-1302-41fb-9d52-bf2a9eb73807 tempest-VolumeDependencyTests-1342970489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:58:25 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-6340bb1c-1302-41fb-9d52-bf2a9eb73807 tempest-VolumeDependencyTests-1342970489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:58:25 devstack sudo[89239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 Apr 22 17:58:25 devstack sudo[89239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:58:25 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-a2a9be31-c5d0-462f-b751-f7b89b220ac9 tempest-VolumesSnapshotTestJSON-1790417655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:58:25 devstack sudo[89237]: pam_unix(sudo:session): session closed for user root Apr 22 17:58:25 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-e284c73e-7504-453a-a37c-9668ca315bb8 tempest-CinderUnicodeTest-626251776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7d0c8786-b392-476c-899a-cbb91593b726 1073741824" returned: 0 in 0.748s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:58:25 devstack sudo[89239]: pam_unix(sudo:session): session closed for user root Apr 22 17:58:25 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-e284c73e-7504-453a-a37c-9668ca315bb8 tempest-CinderUnicodeTest-626251776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7d0c8786-b392-476c-899a-cbb91593b726 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:58:25 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-6340bb1c-1302-41fb-9d52-bf2a9eb73807 tempest-VolumeDependencyTests-1342970489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33" returned: 0 in 0.551s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:58:25 devstack cinder-volume[81771]: DEBUG cinder.manager [None req-6340bb1c-1302-41fb-9d52-bf2a9eb73807 tempest-VolumeDependencyTests-1342970489 None] Notifying Schedulers of capabilities ... {{(pid=81771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 17:58:25 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-6340bb1c-1302-41fb-9d52-bf2a9eb73807 tempest-VolumeDependencyTests-1342970489 None] Deleted volume successfully. Apr 22 17:58:25 devstack sudo[89245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7d0c8786-b392-476c-899a-cbb91593b726 Apr 22 17:58:25 devstack sudo[89245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:58:25 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-6340bb1c-1302-41fb-9d52-bf2a9eb73807 tempest-VolumeDependencyTests-1342970489 None] Lock "cinder-b5f27f97-ac85-4453-b8d7-ed21791d840a-delete_volume" released by "delete_volume" :: held 2.007s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:58:25 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-bea93008-35ad-4e1e-9281-0dd7bab90b21 tempest-VolumeDependencyTests-1342970489 None] Acquiring lock "cinder-2864d2cf-e821-4b70-b589-d05499ebafa3-delete_volume" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:58:25 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-bea93008-35ad-4e1e-9281-0dd7bab90b21 tempest-VolumeDependencyTests-1342970489 None] Lock "cinder-2864d2cf-e821-4b70-b589-d05499ebafa3-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:58:25 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-bea93008-35ad-4e1e-9281-0dd7bab90b21 tempest-VolumeDependencyTests-1342970489 None] Acquiring lock "cinder-quobyte-2864d2cf-e821-4b70-b589-d05499ebafa3" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:58:25 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-bea93008-35ad-4e1e-9281-0dd7bab90b21 tempest-VolumeDependencyTests-1342970489 None] Lock "cinder-quobyte-2864d2cf-e821-4b70-b589-d05499ebafa3" acquired by "delete_volume" :: waited 0.019s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:58:25 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea82df51-3c0e-428e-9e3f-f902c416b5c0]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:58:25 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-bea93008-35ad-4e1e-9281-0dd7bab90b21 tempest-VolumeDependencyTests-1342970489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-2864d2cf-e821-4b70-b589-d05499ebafa3 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:58:26 devstack sudo[89247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-2864d2cf-e821-4b70-b589-d05499ebafa3 Apr 22 17:58:26 devstack sudo[89247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:58:26 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-977599d1-69f2-4e79-90fb-7c0c6ae7885b tempest-VolumesActionsTest-1312180831 None] Terminate volume connection completed successfully. Apr 22 17:58:26 devstack sudo[89245]: pam_unix(sudo:session): session closed for user root Apr 22 17:58:26 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-e284c73e-7504-453a-a37c-9668ca315bb8 tempest-CinderUnicodeTest-626251776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7d0c8786-b392-476c-899a-cbb91593b726" returned: 0 in 0.492s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:58:26 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-e284c73e-7504-453a-a37c-9668ca315bb8 tempest-CinderUnicodeTest-626251776 None] <== create_volume: return (1280ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'} {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 17:58:26 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-e284c73e-7504-453a-a37c-9668ca315bb8 tempest-CinderUnicodeTest-626251776 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.283s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:58:26 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-a2a9be31-c5d0-462f-b751-f7b89b220ac9 tempest-VolumesSnapshotTestJSON-1790417655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.886s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:58:26 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-e284c73e-7504-453a-a37c-9668ca315bb8 tempest-CinderUnicodeTest-626251776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc7939c6-ae6d-4fe6-93c9-9344ae1d6b12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d0c8786-b392-476c-899a-cbb91593b726', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:58:26 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-e284c73e-7504-453a-a37c-9668ca315bb8 tempest-CinderUnicodeTest-626251776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d122e65-1121-4b74-a516-46cfdb25bc3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:58:26 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-a2a9be31-c5d0-462f-b751-f7b89b220ac9 tempest-VolumesSnapshotTestJSON-1790417655 None] Creating offline snapshot 005372be-ca52-4c43-984a-ae914f9c6a5c of volume 7d097496-766b-4bc2-9799-7ffc87065451 {{(pid=81771) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 22 17:58:26 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-e284c73e-7504-453a-a37c-9668ca315bb8 tempest-CinderUnicodeTest-626251776 None] Volume volume-7d0c8786-b392-476c-899a-cbb91593b726 (7d0c8786-b392-476c-899a-cbb91593b726): created successfully Apr 22 17:58:26 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-e284c73e-7504-453a-a37c-9668ca315bb8 tempest-CinderUnicodeTest-626251776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d122e65-1121-4b74-a516-46cfdb25bc3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:58:26 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-e284c73e-7504-453a-a37c-9668ca315bb8 tempest-CinderUnicodeTest-626251776 None] Flow 'volume_create_manager' (240d104a-4f0a-4420-ada8-261fa0f777de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:58:26 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[97d659dd-1f71-4c16-9cc3-184c560ed85c]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:58:26 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-a2a9be31-c5d0-462f-b751-f7b89b220ac9 tempest-VolumesSnapshotTestJSON-1790417655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7d097496-766b-4bc2-9799-7ffc87065451 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:58:26 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-e284c73e-7504-453a-a37c-9668ca315bb8 tempest-CinderUnicodeTest-626251776 None] Created volume successfully. Apr 22 17:58:26 devstack sudo[89250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7d097496-766b-4bc2-9799-7ffc87065451 Apr 22 17:58:26 devstack sudo[89250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:58:26 devstack sudo[89247]: pam_unix(sudo:session): session closed for user root Apr 22 17:58:26 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-bea93008-35ad-4e1e-9281-0dd7bab90b21 tempest-VolumeDependencyTests-1342970489 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-2864d2cf-e821-4b70-b589-d05499ebafa3" returned: 0 in 0.569s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:58:26 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-bea93008-35ad-4e1e-9281-0dd7bab90b21 tempest-VolumeDependencyTests-1342970489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-2864d2cf-e821-4b70-b589-d05499ebafa3 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:58:26 devstack sudo[89255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-2864d2cf-e821-4b70-b589-d05499ebafa3 Apr 22 17:58:26 devstack sudo[89255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:58:26 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-977599d1-69f2-4e79-90fb-7c0c6ae7885b tempest-VolumesActionsTest-1312180831 None] Acquiring lock "cinder-5d833ec9-4529-4e71-931e-32c62898e75e-detach_volume" by "detach_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:58:26 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-977599d1-69f2-4e79-90fb-7c0c6ae7885b tempest-VolumesActionsTest-1312180831 None] Lock "cinder-5d833ec9-4529-4e71-931e-32c62898e75e-detach_volume" acquired by "detach_volume" :: waited 0.022s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:58:26 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-977599d1-69f2-4e79-90fb-7c0c6ae7885b tempest-VolumesActionsTest-1312180831 None] Detaching volume 5d833ec9-4529-4e71-931e-32c62898e75e from instance 868b8d07-e965-4b5e-9a5c-ecd0a1356471. Apr 22 17:58:26 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-977599d1-69f2-4e79-90fb-7c0c6ae7885b tempest-VolumesActionsTest-1312180831 None] Detach volume completed successfully. Apr 22 17:58:26 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-977599d1-69f2-4e79-90fb-7c0c6ae7885b tempest-VolumesActionsTest-1312180831 None] Lock "cinder-5d833ec9-4529-4e71-931e-32c62898e75e-detach_volume" released by "detach_volume" :: held 0.067s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:58:26 devstack sudo[89250]: pam_unix(sudo:session): session closed for user root Apr 22 17:58:26 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-a2a9be31-c5d0-462f-b751-f7b89b220ac9 tempest-VolumesSnapshotTestJSON-1790417655 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7d097496-766b-4bc2-9799-7ffc87065451" returned: 0 in 0.557s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:58:26 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-a2a9be31-c5d0-462f-b751-f7b89b220ac9 tempest-VolumesSnapshotTestJSON-1790417655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7d097496-766b-4bc2-9799-7ffc87065451,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7d097496-766b-4bc2-9799-7ffc87065451.005372be-ca52-4c43-984a-ae914f9c6a5c 1G {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:58:26 devstack sudo[89260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7d097496-766b-4bc2-9799-7ffc87065451,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7d097496-766b-4bc2-9799-7ffc87065451.005372be-ca52-4c43-984a-ae914f9c6a5c 1G Apr 22 17:58:26 devstack sudo[89260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:58:26 devstack sudo[89255]: pam_unix(sudo:session): session closed for user root Apr 22 17:58:26 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-bea93008-35ad-4e1e-9281-0dd7bab90b21 tempest-VolumeDependencyTests-1342970489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-2864d2cf-e821-4b70-b589-d05499ebafa3" returned: 0 in 0.490s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:58:27 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-bea93008-35ad-4e1e-9281-0dd7bab90b21 tempest-VolumeDependencyTests-1342970489 None] Lock "cinder-quobyte-2864d2cf-e821-4b70-b589-d05499ebafa3" released by "delete_volume" :: held 1.116s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:58:27 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-bea93008-35ad-4e1e-9281-0dd7bab90b21 tempest-VolumeDependencyTests-1342970489 None] Created reservations ['2964325a-6667-4dc6-95ce-5f8e5c7a84b0', '8343f819-4fcb-4024-9bb7-0c7e230d5fd0', 'b54bd6fc-3b4c-4c10-ba6a-de4047e54365', 'aed20245-ce54-4f7f-b3f2-26b1658777fd'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 17:58:27 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-bea93008-35ad-4e1e-9281-0dd7bab90b21 tempest-VolumeDependencyTests-1342970489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:58:27 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-bea93008-35ad-4e1e-9281-0dd7bab90b21 tempest-VolumeDependencyTests-1342970489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:58:27 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-bea93008-35ad-4e1e-9281-0dd7bab90b21 tempest-VolumeDependencyTests-1342970489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:58:27 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-bea93008-35ad-4e1e-9281-0dd7bab90b21 tempest-VolumeDependencyTests-1342970489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:58:27 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-bea93008-35ad-4e1e-9281-0dd7bab90b21 tempest-VolumeDependencyTests-1342970489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:58:27 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-bea93008-35ad-4e1e-9281-0dd7bab90b21 tempest-VolumeDependencyTests-1342970489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:58:27 devstack sudo[89266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 Apr 22 17:58:27 devstack sudo[89266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:58:27 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-281b8cdb-ecb7-4512-8bfc-c188e6eda6d3 tempest-VolumesActionsTest-678062019 None] Acquiring lock "cinder-5d833ec9-4529-4e71-931e-32c62898e75e-detach_volume" by "detach_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:58:27 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-281b8cdb-ecb7-4512-8bfc-c188e6eda6d3 tempest-VolumesActionsTest-678062019 None] Lock "cinder-5d833ec9-4529-4e71-931e-32c62898e75e-detach_volume" acquired by "detach_volume" :: waited 0.025s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:58:27 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-281b8cdb-ecb7-4512-8bfc-c188e6eda6d3 tempest-VolumesActionsTest-678062019 None] Volume detach called, but volume not attached. Apr 22 17:58:27 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-281b8cdb-ecb7-4512-8bfc-c188e6eda6d3 tempest-VolumesActionsTest-678062019 None] Lock "cinder-5d833ec9-4529-4e71-931e-32c62898e75e-detach_volume" released by "detach_volume" :: held 0.029s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:58:27 devstack sudo[89260]: pam_unix(sudo:session): session closed for user root Apr 22 17:58:27 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-a2a9be31-c5d0-462f-b751-f7b89b220ac9 tempest-VolumesSnapshotTestJSON-1790417655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7d097496-766b-4bc2-9799-7ffc87065451,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7d097496-766b-4bc2-9799-7ffc87065451.005372be-ca52-4c43-984a-ae914f9c6a5c 1G" returned: 0 in 0.689s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:58:27 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-a2a9be31-c5d0-462f-b751-f7b89b220ac9 tempest-VolumesSnapshotTestJSON-1790417655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d097496-766b-4bc2-9799-7ffc87065451 -F qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7d097496-766b-4bc2-9799-7ffc87065451.005372be-ca52-4c43-984a-ae914f9c6a5c {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:58:27 devstack sudo[89269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d097496-766b-4bc2-9799-7ffc87065451 -F qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7d097496-766b-4bc2-9799-7ffc87065451.005372be-ca52-4c43-984a-ae914f9c6a5c Apr 22 17:58:27 devstack sudo[89269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:58:27 devstack cinder-volume[81771]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e9145e4-dc8c-437f-9ffd-9cf618751d86 tempest-CinderUnicodeTest-626251776 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 17:58:27 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-0e9145e4-dc8c-437f-9ffd-9cf618751d86 tempest-CinderUnicodeTest-626251776 None] Flow 'volume_create_manager' (a7f77177-911e-40a7-8dcc-de50725d82a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:58:27 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-0e9145e4-dc8c-437f-9ffd-9cf618751d86 tempest-CinderUnicodeTest-626251776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d5acf1d-3be8-4fc2-9ccb-e3dec6ca10de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:58:27 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-0e9145e4-dc8c-437f-9ffd-9cf618751d86 tempest-CinderUnicodeTest-626251776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d5acf1d-3be8-4fc2-9ccb-e3dec6ca10de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:58:27Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-91418178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79f00ff4-090f-48f0-a81a-9434108c51d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='477860a62d48440f92bc21582783041a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:58:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:58:27Z,use_quota=True,user_id='172197bf582b4067bca7cb6b92f9641b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:58:27 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-0e9145e4-dc8c-437f-9ffd-9cf618751d86 tempest-CinderUnicodeTest-626251776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddd50400-f662-437a-b582-6537411e8cb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:58:27 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-0e9145e4-dc8c-437f-9ffd-9cf618751d86 tempest-CinderUnicodeTest-626251776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddd50400-f662-437a-b582-6537411e8cb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:58:27 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-0e9145e4-dc8c-437f-9ffd-9cf618751d86 tempest-CinderUnicodeTest-626251776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b60beda-38d7-425d-90d9-4abf3d81fd48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:58:27 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-0e9145e4-dc8c-437f-9ffd-9cf618751d86 tempest-CinderUnicodeTest-626251776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b60beda-38d7-425d-90d9-4abf3d81fd48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79f00ff4-090f-48f0-a81a-9434108c51d3', 'volume_name': 'volume-79f00ff4-090f-48f0-a81a-9434108c51d3', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:58:27 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-0e9145e4-dc8c-437f-9ffd-9cf618751d86 tempest-CinderUnicodeTest-626251776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32ed6ffb-ad46-46a0-a9f7-49347388fee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:58:27 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-0e9145e4-dc8c-437f-9ffd-9cf618751d86 tempest-CinderUnicodeTest-626251776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32ed6ffb-ad46-46a0-a9f7-49347388fee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:58:27 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-0e9145e4-dc8c-437f-9ffd-9cf618751d86 tempest-CinderUnicodeTest-626251776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e714057c-63b4-44be-8eb2-cf246fc94253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:58:27 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-0e9145e4-dc8c-437f-9ffd-9cf618751d86 tempest-CinderUnicodeTest-626251776 None] Volume 79f00ff4-090f-48f0-a81a-9434108c51d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79f00ff4-090f-48f0-a81a-9434108c51d3', 'volume_size': 1} Apr 22 17:58:27 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-0e9145e4-dc8c-437f-9ffd-9cf618751d86 tempest-CinderUnicodeTest-626251776 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:58:27 devstack sudo[89266]: pam_unix(sudo:session): session closed for user root Apr 22 17:58:27 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-bea93008-35ad-4e1e-9281-0dd7bab90b21 tempest-VolumeDependencyTests-1342970489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33" returned: 0 in 0.570s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:58:27 devstack cinder-volume[81771]: DEBUG cinder.manager [None req-bea93008-35ad-4e1e-9281-0dd7bab90b21 tempest-VolumeDependencyTests-1342970489 None] Notifying Schedulers of capabilities ... {{(pid=81771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 17:58:27 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-bea93008-35ad-4e1e-9281-0dd7bab90b21 tempest-VolumeDependencyTests-1342970489 None] Deleted volume successfully. Apr 22 17:58:27 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-bea93008-35ad-4e1e-9281-0dd7bab90b21 tempest-VolumeDependencyTests-1342970489 None] Lock "cinder-2864d2cf-e821-4b70-b589-d05499ebafa3-delete_volume" released by "delete_volume" :: held 1.939s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:58:27 devstack sudo[89269]: pam_unix(sudo:session): session closed for user root Apr 22 17:58:27 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-a2a9be31-c5d0-462f-b751-f7b89b220ac9 tempest-VolumesSnapshotTestJSON-1790417655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d097496-766b-4bc2-9799-7ffc87065451 -F qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7d097496-766b-4bc2-9799-7ffc87065451.005372be-ca52-4c43-984a-ae914f9c6a5c" returned: 0 in 0.541s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:58:27 devstack cinder-volume[81771]: WARNING cinder.volume.drivers.remotefs [None req-a2a9be31-c5d0-462f-b751-f7b89b220ac9 tempest-VolumesSnapshotTestJSON-1790417655 None] /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7d097496-766b-4bc2-9799-7ffc87065451.005372be-ca52-4c43-984a-ae914f9c6a5c is being set with open permissions: ugo+rw Apr 22 17:58:27 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-a2a9be31-c5d0-462f-b751-f7b89b220ac9 tempest-VolumesSnapshotTestJSON-1790417655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7d097496-766b-4bc2-9799-7ffc87065451.005372be-ca52-4c43-984a-ae914f9c6a5c {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:58:27 devstack sudo[89275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7d097496-766b-4bc2-9799-7ffc87065451.005372be-ca52-4c43-984a-ae914f9c6a5c Apr 22 17:58:27 devstack sudo[89275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:58:28 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-94835a35-bc35-4cbd-b8eb-30ad65f04b03 tempest-VolumesActionsTest-678062019 None] Acquiring lock "cinder-5d833ec9-4529-4e71-931e-32c62898e75e-delete_volume" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:58:28 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-94835a35-bc35-4cbd-b8eb-30ad65f04b03 tempest-VolumesActionsTest-678062019 None] Lock "cinder-5d833ec9-4529-4e71-931e-32c62898e75e-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:58:28 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-94835a35-bc35-4cbd-b8eb-30ad65f04b03 tempest-VolumesActionsTest-678062019 None] Acquiring lock "cinder-quobyte-5d833ec9-4529-4e71-931e-32c62898e75e" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:58:28 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-94835a35-bc35-4cbd-b8eb-30ad65f04b03 tempest-VolumesActionsTest-678062019 None] Lock "cinder-quobyte-5d833ec9-4529-4e71-931e-32c62898e75e" acquired by "delete_volume" :: waited 0.020s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:58:28 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[78e3dd7e-841c-43b2-b087-ea19068cc201]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:58:28 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-94835a35-bc35-4cbd-b8eb-30ad65f04b03 tempest-VolumesActionsTest-678062019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-5d833ec9-4529-4e71-931e-32c62898e75e {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:58:28 devstack sudo[89277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-5d833ec9-4529-4e71-931e-32c62898e75e Apr 22 17:58:28 devstack sudo[89277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:58:28 devstack sudo[89275]: pam_unix(sudo:session): session closed for user root Apr 22 17:58:28 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-6d45debe-999a-4eaa-b8bf-ea4cf0ee9b22 tempest-VolumeDependencyTests-1342970489 None] Acquiring lock "cinder-6d24c540-8f0d-423b-aede-5c629f057998-delete_volume" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:58:28 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-a2a9be31-c5d0-462f-b751-f7b89b220ac9 tempest-VolumesSnapshotTestJSON-1790417655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7d097496-766b-4bc2-9799-7ffc87065451.005372be-ca52-4c43-984a-ae914f9c6a5c" returned: 0 in 0.476s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:58:28 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-6d45debe-999a-4eaa-b8bf-ea4cf0ee9b22 tempest-VolumeDependencyTests-1342970489 None] Lock "cinder-6d24c540-8f0d-423b-aede-5c629f057998-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:58:28 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-a2a9be31-c5d0-462f-b751-f7b89b220ac9 tempest-VolumesSnapshotTestJSON-1790417655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7d097496-766b-4bc2-9799-7ffc87065451.info {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:58:28 devstack sudo[89280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7d097496-766b-4bc2-9799-7ffc87065451.info Apr 22 17:58:28 devstack sudo[89280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:58:28 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-6d45debe-999a-4eaa-b8bf-ea4cf0ee9b22 tempest-VolumeDependencyTests-1342970489 None] Acquiring lock "cinder-quobyte-6d24c540-8f0d-423b-aede-5c629f057998" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:58:28 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-6d45debe-999a-4eaa-b8bf-ea4cf0ee9b22 tempest-VolumeDependencyTests-1342970489 None] Lock "cinder-quobyte-6d24c540-8f0d-423b-aede-5c629f057998" acquired by "delete_volume" :: waited 0.018s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:58:28 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[a05141d7-2448-4305-9deb-dbf985ac45a9]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:58:28 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-6d45debe-999a-4eaa-b8bf-ea4cf0ee9b22 tempest-VolumeDependencyTests-1342970489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-6d24c540-8f0d-423b-aede-5c629f057998 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:58:28 devstack sudo[89277]: pam_unix(sudo:session): session closed for user root Apr 22 17:58:28 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-94835a35-bc35-4cbd-b8eb-30ad65f04b03 tempest-VolumesActionsTest-678062019 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-5d833ec9-4529-4e71-931e-32c62898e75e" returned: 0 in 0.603s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:58:28 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-94835a35-bc35-4cbd-b8eb-30ad65f04b03 tempest-VolumesActionsTest-678062019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-5d833ec9-4529-4e71-931e-32c62898e75e {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:58:28 devstack sudo[89285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-6d24c540-8f0d-423b-aede-5c629f057998 Apr 22 17:58:28 devstack sudo[89285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:58:28 devstack sudo[89286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-5d833ec9-4529-4e71-931e-32c62898e75e Apr 22 17:58:28 devstack sudo[89286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:58:28 devstack sudo[89280]: pam_unix(sudo:session): session closed for user root Apr 22 17:58:28 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-a2a9be31-c5d0-462f-b751-f7b89b220ac9 tempest-VolumesSnapshotTestJSON-1790417655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7d097496-766b-4bc2-9799-7ffc87065451.info" returned: 0 in 0.468s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:58:28 devstack cinder-volume[81771]: WARNING cinder.volume.drivers.remotefs [None req-a2a9be31-c5d0-462f-b751-f7b89b220ac9 tempest-VolumesSnapshotTestJSON-1790417655 None] /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7d097496-766b-4bc2-9799-7ffc87065451.info is being set with open permissions: ugo+rw Apr 22 17:58:28 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-a2a9be31-c5d0-462f-b751-f7b89b220ac9 tempest-VolumesSnapshotTestJSON-1790417655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7d097496-766b-4bc2-9799-7ffc87065451.info {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:58:29 devstack sudo[89290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7d097496-766b-4bc2-9799-7ffc87065451.info Apr 22 17:58:29 devstack sudo[89290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:58:29 devstack sudo[89286]: pam_unix(sudo:session): session closed for user root Apr 22 17:58:29 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-94835a35-bc35-4cbd-b8eb-30ad65f04b03 tempest-VolumesActionsTest-678062019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-5d833ec9-4529-4e71-931e-32c62898e75e" returned: 0 in 0.487s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:58:29 devstack sudo[89285]: pam_unix(sudo:session): session closed for user root Apr 22 17:58:29 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-94835a35-bc35-4cbd-b8eb-30ad65f04b03 tempest-VolumesActionsTest-678062019 None] Lock "cinder-quobyte-5d833ec9-4529-4e71-931e-32c62898e75e" released by "delete_volume" :: held 1.133s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:58:29 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-6d45debe-999a-4eaa-b8bf-ea4cf0ee9b22 tempest-VolumeDependencyTests-1342970489 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-6d24c540-8f0d-423b-aede-5c629f057998" returned: 0 in 0.574s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:58:29 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-6d45debe-999a-4eaa-b8bf-ea4cf0ee9b22 tempest-VolumeDependencyTests-1342970489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-6d24c540-8f0d-423b-aede-5c629f057998 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:58:29 devstack sudo[89296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-6d24c540-8f0d-423b-aede-5c629f057998 Apr 22 17:58:29 devstack sudo[89296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:58:29 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-94835a35-bc35-4cbd-b8eb-30ad65f04b03 tempest-VolumesActionsTest-678062019 None] Created reservations ['7e6b0507-4265-4ff7-9958-fafdbb72aeb4', '0d57636f-55a3-4176-a0cb-0d9658e0553d', 'e1f5a429-d040-4d2d-b32c-be3ad40fd763', '8ca1dbf6-4b25-40aa-b3fd-cc820b8cbe55'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 17:58:29 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-94835a35-bc35-4cbd-b8eb-30ad65f04b03 tempest-VolumesActionsTest-678062019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:58:29 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-94835a35-bc35-4cbd-b8eb-30ad65f04b03 tempest-VolumesActionsTest-678062019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:58:29 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-94835a35-bc35-4cbd-b8eb-30ad65f04b03 tempest-VolumesActionsTest-678062019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:58:29 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-94835a35-bc35-4cbd-b8eb-30ad65f04b03 tempest-VolumesActionsTest-678062019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:58:29 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-94835a35-bc35-4cbd-b8eb-30ad65f04b03 tempest-VolumesActionsTest-678062019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:58:29 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-94835a35-bc35-4cbd-b8eb-30ad65f04b03 tempest-VolumesActionsTest-678062019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:58:29 devstack sudo[89298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 Apr 22 17:58:29 devstack sudo[89298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:58:29 devstack sudo[89290]: pam_unix(sudo:session): session closed for user root Apr 22 17:58:29 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-a2a9be31-c5d0-462f-b751-f7b89b220ac9 tempest-VolumesSnapshotTestJSON-1790417655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7d097496-766b-4bc2-9799-7ffc87065451.info" returned: 0 in 0.458s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:58:29 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-a2a9be31-c5d0-462f-b751-f7b89b220ac9 tempest-VolumesSnapshotTestJSON-1790417655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.343s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:58:29 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-0e9145e4-dc8c-437f-9ffd-9cf618751d86 tempest-CinderUnicodeTest-626251776 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.866s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:58:29 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-0e9145e4-dc8c-437f-9ffd-9cf618751d86 tempest-CinderUnicodeTest-626251776 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:58:27Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-91418178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79f00ff4-090f-48f0-a81a-9434108c51d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='477860a62d48440f92bc21582783041a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:58:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:58:27Z,use_quota=True,user_id='172197bf582b4067bca7cb6b92f9641b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)}" {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 17:58:29 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-0e9145e4-dc8c-437f-9ffd-9cf618751d86 tempest-CinderUnicodeTest-626251776 None] Creating volume 79f00ff4-090f-48f0-a81a-9434108c51d3 {{(pid=81771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 17:58:29 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-0e9145e4-dc8c-437f-9ffd-9cf618751d86 tempest-CinderUnicodeTest-626251776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:58:29 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-0e9145e4-dc8c-437f-9ffd-9cf618751d86 tempest-CinderUnicodeTest-626251776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:58:29 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-0e9145e4-dc8c-437f-9ffd-9cf618751d86 tempest-CinderUnicodeTest-626251776 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:58:29 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-0e9145e4-dc8c-437f-9ffd-9cf618751d86 tempest-CinderUnicodeTest-626251776 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:58:29 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-0e9145e4-dc8c-437f-9ffd-9cf618751d86 tempest-CinderUnicodeTest-626251776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:58:29 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-0e9145e4-dc8c-437f-9ffd-9cf618751d86 tempest-CinderUnicodeTest-626251776 None] Selected osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 as target Quobyte volume. {{(pid=81771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 17:58:29 devstack cinder-volume[81771]: INFO cinder.volume.drivers.remotefs [None req-0e9145e4-dc8c-437f-9ffd-9cf618751d86 tempest-CinderUnicodeTest-626251776 None] casted to osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 Apr 22 17:58:29 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-0e9145e4-dc8c-437f-9ffd-9cf618751d86 tempest-CinderUnicodeTest-626251776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-79f00ff4-090f-48f0-a81a-9434108c51d3 1073741824 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:58:29 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-a2a9be31-c5d0-462f-b751-f7b89b220ac9 tempest-VolumesSnapshotTestJSON-1790417655 None] Create snapshot completed successfully Apr 22 17:58:29 devstack sudo[89307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-79f00ff4-090f-48f0-a81a-9434108c51d3 1073741824 Apr 22 17:58:29 devstack sudo[89307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:58:29 devstack sudo[89296]: pam_unix(sudo:session): session closed for user root Apr 22 17:58:29 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-6d45debe-999a-4eaa-b8bf-ea4cf0ee9b22 tempest-VolumeDependencyTests-1342970489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-6d24c540-8f0d-423b-aede-5c629f057998" returned: 0 in 0.527s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:58:29 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-6d45debe-999a-4eaa-b8bf-ea4cf0ee9b22 tempest-VolumeDependencyTests-1342970489 None] Lock "cinder-quobyte-6d24c540-8f0d-423b-aede-5c629f057998" released by "delete_volume" :: held 1.139s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:58:29 devstack sudo[89298]: pam_unix(sudo:session): session closed for user root Apr 22 17:58:29 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-94835a35-bc35-4cbd-b8eb-30ad65f04b03 tempest-VolumesActionsTest-678062019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33" returned: 0 in 0.449s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:58:29 devstack cinder-volume[81771]: DEBUG cinder.manager [None req-94835a35-bc35-4cbd-b8eb-30ad65f04b03 tempest-VolumesActionsTest-678062019 None] Notifying Schedulers of capabilities ... {{(pid=81771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 17:58:29 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-94835a35-bc35-4cbd-b8eb-30ad65f04b03 tempest-VolumesActionsTest-678062019 None] Deleted volume successfully. Apr 22 17:58:29 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-6d45debe-999a-4eaa-b8bf-ea4cf0ee9b22 tempest-VolumeDependencyTests-1342970489 None] Created reservations ['d0ecc8e7-ab84-4603-9eb9-404d1cfc88cd', 'd33b2ecd-bfb5-4ca8-af20-28aae1825eb7', 'd546c43f-b9de-4640-9d5a-37bfe8525d8e', 'e108ae34-7d2b-4474-b551-b46649aeb742'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 17:58:29 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-94835a35-bc35-4cbd-b8eb-30ad65f04b03 tempest-VolumesActionsTest-678062019 None] Lock "cinder-5d833ec9-4529-4e71-931e-32c62898e75e-delete_volume" released by "delete_volume" :: held 1.830s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:58:29 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-6d45debe-999a-4eaa-b8bf-ea4cf0ee9b22 tempest-VolumeDependencyTests-1342970489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:58:29 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-6d45debe-999a-4eaa-b8bf-ea4cf0ee9b22 tempest-VolumeDependencyTests-1342970489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:58:29 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-6d45debe-999a-4eaa-b8bf-ea4cf0ee9b22 tempest-VolumeDependencyTests-1342970489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:58:29 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-6d45debe-999a-4eaa-b8bf-ea4cf0ee9b22 tempest-VolumeDependencyTests-1342970489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:58:29 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-6d45debe-999a-4eaa-b8bf-ea4cf0ee9b22 tempest-VolumeDependencyTests-1342970489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:58:29 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-6d45debe-999a-4eaa-b8bf-ea4cf0ee9b22 tempest-VolumeDependencyTests-1342970489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:58:29 devstack cinder-volume[81771]: DEBUG oslo_service.periodic_task [None req-1a7bdab5-8190-4e00-a2e2-843e5894ab49 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81771) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 22 17:58:29 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-1a7bdab5-8190-4e00-a2e2-843e5894ab49 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:58:29 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-1a7bdab5-8190-4e00-a2e2-843e5894ab49 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:58:29 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-1a7bdab5-8190-4e00-a2e2-843e5894ab49 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:58:29 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-1a7bdab5-8190-4e00-a2e2-843e5894ab49 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:58:29 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-1a7bdab5-8190-4e00-a2e2-843e5894ab49 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:58:29 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-1a7bdab5-8190-4e00-a2e2-843e5894ab49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:58:29 devstack sudo[89311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 Apr 22 17:58:29 devstack sudo[89311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:58:29 devstack sudo[89314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 Apr 22 17:58:29 devstack sudo[89314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:58:30 devstack sudo[89307]: pam_unix(sudo:session): session closed for user root Apr 22 17:58:30 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-0e9145e4-dc8c-437f-9ffd-9cf618751d86 tempest-CinderUnicodeTest-626251776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-79f00ff4-090f-48f0-a81a-9434108c51d3 1073741824" returned: 0 in 0.710s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:58:30 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-0e9145e4-dc8c-437f-9ffd-9cf618751d86 tempest-CinderUnicodeTest-626251776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-79f00ff4-090f-48f0-a81a-9434108c51d3 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:58:30 devstack sudo[89318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-79f00ff4-090f-48f0-a81a-9434108c51d3 Apr 22 17:58:30 devstack sudo[89318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:58:30 devstack sudo[89311]: pam_unix(sudo:session): session closed for user root Apr 22 17:58:30 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-6d45debe-999a-4eaa-b8bf-ea4cf0ee9b22 tempest-VolumeDependencyTests-1342970489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33" returned: 0 in 0.563s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:58:30 devstack cinder-volume[81771]: DEBUG cinder.manager [None req-6d45debe-999a-4eaa-b8bf-ea4cf0ee9b22 tempest-VolumeDependencyTests-1342970489 None] Notifying Schedulers of capabilities ... {{(pid=81771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 17:58:30 devstack sudo[89314]: pam_unix(sudo:session): session closed for user root Apr 22 17:58:30 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-6d45debe-999a-4eaa-b8bf-ea4cf0ee9b22 tempest-VolumeDependencyTests-1342970489 None] Deleted volume successfully. Apr 22 17:58:30 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-1a7bdab5-8190-4e00-a2e2-843e5894ab49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33" returned: 0 in 0.569s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:58:30 devstack cinder-volume[81771]: DEBUG cinder.manager [None req-1a7bdab5-8190-4e00-a2e2-843e5894ab49 None None] Notifying Schedulers of capabilities ... {{(pid=81771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 17:58:30 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-6d45debe-999a-4eaa-b8bf-ea4cf0ee9b22 tempest-VolumeDependencyTests-1342970489 None] Lock "cinder-6d24c540-8f0d-423b-aede-5c629f057998-delete_volume" released by "delete_volume" :: held 2.040s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:58:30 devstack sudo[89318]: pam_unix(sudo:session): session closed for user root Apr 22 17:58:30 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-0e9145e4-dc8c-437f-9ffd-9cf618751d86 tempest-CinderUnicodeTest-626251776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-79f00ff4-090f-48f0-a81a-9434108c51d3" returned: 0 in 0.605s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:58:30 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-0e9145e4-dc8c-437f-9ffd-9cf618751d86 tempest-CinderUnicodeTest-626251776 None] <== create_volume: return (1363ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'} {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 17:58:30 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-0e9145e4-dc8c-437f-9ffd-9cf618751d86 tempest-CinderUnicodeTest-626251776 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.368s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:58:30 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-0e9145e4-dc8c-437f-9ffd-9cf618751d86 tempest-CinderUnicodeTest-626251776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e714057c-63b4-44be-8eb2-cf246fc94253) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79f00ff4-090f-48f0-a81a-9434108c51d3', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:58:30 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-0e9145e4-dc8c-437f-9ffd-9cf618751d86 tempest-CinderUnicodeTest-626251776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe6525a7-d09c-41c9-b8bc-5ffe383856e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:58:30 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-0e9145e4-dc8c-437f-9ffd-9cf618751d86 tempest-CinderUnicodeTest-626251776 None] Volume volume-79f00ff4-090f-48f0-a81a-9434108c51d3 (79f00ff4-090f-48f0-a81a-9434108c51d3): created successfully Apr 22 17:58:30 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-0e9145e4-dc8c-437f-9ffd-9cf618751d86 tempest-CinderUnicodeTest-626251776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe6525a7-d09c-41c9-b8bc-5ffe383856e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:58:30 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-0e9145e4-dc8c-437f-9ffd-9cf618751d86 tempest-CinderUnicodeTest-626251776 None] Flow 'volume_create_manager' (a7f77177-911e-40a7-8dcc-de50725d82a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:58:30 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-0e9145e4-dc8c-437f-9ffd-9cf618751d86 tempest-CinderUnicodeTest-626251776 None] Created volume successfully. Apr 22 17:58:31 devstack cinder-volume[81771]: DEBUG cinder.volume.flows.manager.create_volume [None req-970d1a23-a9fa-444d-8fe6-fe7c90c96cde tempest-VolumesSnapshotTestJSON-1790417655 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 17:58:31 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-970d1a23-a9fa-444d-8fe6-fe7c90c96cde tempest-VolumesSnapshotTestJSON-1790417655 None] Flow 'volume_create_manager' (dae8e87c-0cc5-40f7-888d-f7297fbba7df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:58:31 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-970d1a23-a9fa-444d-8fe6-fe7c90c96cde tempest-VolumesSnapshotTestJSON-1790417655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c4a08d3-fc46-406f-9a42-e7e35a6caf5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:58:31 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-970d1a23-a9fa-444d-8fe6-fe7c90c96cde tempest-VolumesSnapshotTestJSON-1790417655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c4a08d3-fc46-406f-9a42-e7e35a6caf5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:58:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1351499231',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8b3b8a7-e0a6-4eea-8e44-cea705672eb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afd9a86ddfc94168aaf00fc1e9b425f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:58:31Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=005372be-ca52-4c43-984a-ae914f9c6a5c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:58:31Z,use_quota=True,user_id='e1b4ff9f921345ce968b249e8ba0c04b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:58:31 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-970d1a23-a9fa-444d-8fe6-fe7c90c96cde tempest-VolumesSnapshotTestJSON-1790417655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d52aa55-572d-43a9-b201-c3fb7c2b53b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:58:31 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-970d1a23-a9fa-444d-8fe6-fe7c90c96cde tempest-VolumesSnapshotTestJSON-1790417655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d52aa55-572d-43a9-b201-c3fb7c2b53b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:58:31 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-970d1a23-a9fa-444d-8fe6-fe7c90c96cde tempest-VolumesSnapshotTestJSON-1790417655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c0b22bf-cfef-4fec-bda6-eb069d56aa3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:58:31 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-970d1a23-a9fa-444d-8fe6-fe7c90c96cde tempest-VolumesSnapshotTestJSON-1790417655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c0b22bf-cfef-4fec-bda6-eb069d56aa3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b8b3b8a7-e0a6-4eea-8e44-cea705672eb0', 'volume_name': 'volume-b8b3b8a7-e0a6-4eea-8e44-cea705672eb0', 'volume_size': 2, 'snapshot_id': '005372be-ca52-4c43-984a-ae914f9c6a5c'}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:58:31 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-970d1a23-a9fa-444d-8fe6-fe7c90c96cde tempest-VolumesSnapshotTestJSON-1790417655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2e3673b-aef8-4c41-9cac-dbd6105c728b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:58:31 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-970d1a23-a9fa-444d-8fe6-fe7c90c96cde tempest-VolumesSnapshotTestJSON-1790417655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2e3673b-aef8-4c41-9cac-dbd6105c728b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:58:31 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-970d1a23-a9fa-444d-8fe6-fe7c90c96cde tempest-VolumesSnapshotTestJSON-1790417655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c97f3905-4ea2-414a-bf89-d14c04cbae09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:58:31 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-970d1a23-a9fa-444d-8fe6-fe7c90c96cde tempest-VolumesSnapshotTestJSON-1790417655 None] Volume b8b3b8a7-e0a6-4eea-8e44-cea705672eb0: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b8b3b8a7-e0a6-4eea-8e44-cea705672eb0', 'volume_size': 2, 'snapshot_id': '005372be-ca52-4c43-984a-ae914f9c6a5c'} Apr 22 17:58:31 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-970d1a23-a9fa-444d-8fe6-fe7c90c96cde tempest-VolumesSnapshotTestJSON-1790417655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:58:31 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-970d1a23-a9fa-444d-8fe6-fe7c90c96cde tempest-VolumesSnapshotTestJSON-1790417655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:58:31 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-970d1a23-a9fa-444d-8fe6-fe7c90c96cde tempest-VolumesSnapshotTestJSON-1790417655 None] Acquiring lock "cinder-quobyte-005372be-ca52-4c43-984a-ae914f9c6a5c-b8b3b8a7-e0a6-4eea-8e44-cea705672eb0" by "_create_volume_from_snapshot" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:58:31 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-970d1a23-a9fa-444d-8fe6-fe7c90c96cde tempest-VolumesSnapshotTestJSON-1790417655 None] Lock "cinder-quobyte-005372be-ca52-4c43-984a-ae914f9c6a5c-b8b3b8a7-e0a6-4eea-8e44-cea705672eb0" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:58:31 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-970d1a23-a9fa-444d-8fe6-fe7c90c96cde tempest-VolumesSnapshotTestJSON-1790417655 None] Creating volume b8b3b8a7-e0a6-4eea-8e44-cea705672eb0 from snapshot 005372be-ca52-4c43-984a-ae914f9c6a5c {{(pid=81771) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 22 17:58:31 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-970d1a23-a9fa-444d-8fe6-fe7c90c96cde tempest-VolumesSnapshotTestJSON-1790417655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:58:31 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-970d1a23-a9fa-444d-8fe6-fe7c90c96cde tempest-VolumesSnapshotTestJSON-1790417655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:58:31 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-970d1a23-a9fa-444d-8fe6-fe7c90c96cde tempest-VolumesSnapshotTestJSON-1790417655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:58:31 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-970d1a23-a9fa-444d-8fe6-fe7c90c96cde tempest-VolumesSnapshotTestJSON-1790417655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:58:31 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-970d1a23-a9fa-444d-8fe6-fe7c90c96cde tempest-VolumesSnapshotTestJSON-1790417655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:58:31 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-970d1a23-a9fa-444d-8fe6-fe7c90c96cde tempest-VolumesSnapshotTestJSON-1790417655 None] Selected osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 as target Quobyte volume. {{(pid=81771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 17:58:31 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-970d1a23-a9fa-444d-8fe6-fe7c90c96cde tempest-VolumesSnapshotTestJSON-1790417655 None] Acquiring lock "cinder-quobyte-b8b3b8a7-e0a6-4eea-8e44-cea705672eb0" by "_copy_volume_from_snapshot" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:58:31 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-970d1a23-a9fa-444d-8fe6-fe7c90c96cde tempest-VolumesSnapshotTestJSON-1790417655 None] Lock "cinder-quobyte-b8b3b8a7-e0a6-4eea-8e44-cea705672eb0" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:58:31 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-970d1a23-a9fa-444d-8fe6-fe7c90c96cde tempest-VolumesSnapshotTestJSON-1790417655 None] snapshot: 005372be-ca52-4c43-984a-ae914f9c6a5c, volume: b8b3b8a7-e0a6-4eea-8e44-cea705672eb0, {{(pid=81771) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 22 17:58:31 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-970d1a23-a9fa-444d-8fe6-fe7c90c96cde tempest-VolumesSnapshotTestJSON-1790417655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:58:31 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-970d1a23-a9fa-444d-8fe6-fe7c90c96cde tempest-VolumesSnapshotTestJSON-1790417655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:58:31 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-970d1a23-a9fa-444d-8fe6-fe7c90c96cde tempest-VolumesSnapshotTestJSON-1790417655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:58:31 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-970d1a23-a9fa-444d-8fe6-fe7c90c96cde tempest-VolumesSnapshotTestJSON-1790417655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:58:31 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-970d1a23-a9fa-444d-8fe6-fe7c90c96cde tempest-VolumesSnapshotTestJSON-1790417655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:58:31 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff6fcb94-d81e-492a-8620-9d5c5022fbee]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:58:31 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-970d1a23-a9fa-444d-8fe6-fe7c90c96cde tempest-VolumesSnapshotTestJSON-1790417655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7d097496-766b-4bc2-9799-7ffc87065451.005372be-ca52-4c43-984a-ae914f9c6a5c {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:58:31 devstack sudo[89324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7d097496-766b-4bc2-9799-7ffc87065451.005372be-ca52-4c43-984a-ae914f9c6a5c Apr 22 17:58:31 devstack sudo[89324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:58:32 devstack sudo[89324]: pam_unix(sudo:session): session closed for user root Apr 22 17:58:32 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-970d1a23-a9fa-444d-8fe6-fe7c90c96cde tempest-VolumesSnapshotTestJSON-1790417655 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7d097496-766b-4bc2-9799-7ffc87065451.005372be-ca52-4c43-984a-ae914f9c6a5c" returned: 0 in 0.816s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:58:32 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-970d1a23-a9fa-444d-8fe6-fe7c90c96cde tempest-VolumesSnapshotTestJSON-1790417655 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7d097496-766b-4bc2-9799-7ffc87065451(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81771) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 22 17:58:32 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-970d1a23-a9fa-444d-8fe6-fe7c90c96cde tempest-VolumesSnapshotTestJSON-1790417655 None] will copy from snapshot at /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7d097496-766b-4bc2-9799-7ffc87065451 {{(pid=81771) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 22 17:58:32 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-970d1a23-a9fa-444d-8fe6-fe7c90c96cde tempest-VolumesSnapshotTestJSON-1790417655 None] Creating direct copy from snapshot {{(pid=81771) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 22 17:58:32 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c5dd12e-269c-4bd6-aacc-f4979116b341]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:58:32 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-970d1a23-a9fa-444d-8fe6-fe7c90c96cde tempest-VolumesSnapshotTestJSON-1790417655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7d097496-766b-4bc2-9799-7ffc87065451 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:58:32 devstack sudo[89357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7d097496-766b-4bc2-9799-7ffc87065451 Apr 22 17:58:32 devstack sudo[89357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:58:32 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-5ba4214e-4b51-4478-8c38-202c2f642368 tempest-CinderUnicodeTest-626251776 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:58:32 devstack sudo[89357]: pam_unix(sudo:session): session closed for user root Apr 22 17:58:32 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-970d1a23-a9fa-444d-8fe6-fe7c90c96cde tempest-VolumesSnapshotTestJSON-1790417655 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7d097496-766b-4bc2-9799-7ffc87065451" returned: 0 in 0.817s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:58:32 devstack cinder-volume[81771]: DEBUG cinder.utils [None req-970d1a23-a9fa-444d-8fe6-fe7c90c96cde tempest-VolumesSnapshotTestJSON-1790417655 None] Path /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b8b3b8a7-e0a6-4eea-8e44-cea705672eb0 not found in is_blk_device check {{(pid=81771) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 22 17:58:32 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-970d1a23-a9fa-444d-8fe6-fe7c90c96cde tempest-VolumesSnapshotTestJSON-1790417655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7d097496-766b-4bc2-9799-7ffc87065451 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b8b3b8a7-e0a6-4eea-8e44-cea705672eb0 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:58:32 devstack sudo[89363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7d097496-766b-4bc2-9799-7ffc87065451 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b8b3b8a7-e0a6-4eea-8e44-cea705672eb0 Apr 22 17:58:32 devstack sudo[89363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:58:38 devstack cinder-volume[81771]: DEBUG cinder.volume.flows.manager.create_volume [None req-1888c957-9974-40ba-8fc7-65b53ebba15e tempest-VolumesActionsTest-678062019 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 17:58:38 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-1888c957-9974-40ba-8fc7-65b53ebba15e tempest-VolumesActionsTest-678062019 None] Flow 'volume_create_manager' (5ecbf390-ae6e-4a04-8472-0b7cd92dd9ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:58:38 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-1888c957-9974-40ba-8fc7-65b53ebba15e tempest-VolumesActionsTest-678062019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0baaef57-27be-42df-842e-48a2a0ff1873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:58:38 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-1888c957-9974-40ba-8fc7-65b53ebba15e tempest-VolumesActionsTest-678062019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0baaef57-27be-42df-842e-48a2a0ff1873) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:58:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1783253691',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aea77b80-6a61-45d6-80ff-9a6fb5190ded,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd5ed77be0ee418cb4f7816bd70e7b2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:58:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:58:39Z,use_quota=True,user_id='fa7c9a3bff17449bb4b6fcd3fa13fb1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:58:38 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-1888c957-9974-40ba-8fc7-65b53ebba15e tempest-VolumesActionsTest-678062019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6fc1175-42c1-4428-96a9-9a98fa9092e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:58:38 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-1888c957-9974-40ba-8fc7-65b53ebba15e tempest-VolumesActionsTest-678062019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6fc1175-42c1-4428-96a9-9a98fa9092e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:58:38 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-1888c957-9974-40ba-8fc7-65b53ebba15e tempest-VolumesActionsTest-678062019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (472cdab3-48eb-48be-ae41-b6ee058342cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:58:39 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-1888c957-9974-40ba-8fc7-65b53ebba15e tempest-VolumesActionsTest-678062019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (472cdab3-48eb-48be-ae41-b6ee058342cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aea77b80-6a61-45d6-80ff-9a6fb5190ded', 'volume_name': 'volume-aea77b80-6a61-45d6-80ff-9a6fb5190ded', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:58:39 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-1888c957-9974-40ba-8fc7-65b53ebba15e tempest-VolumesActionsTest-678062019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22c22f66-faec-452a-b683-895db21fe5b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:58:39 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-1888c957-9974-40ba-8fc7-65b53ebba15e tempest-VolumesActionsTest-678062019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22c22f66-faec-452a-b683-895db21fe5b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:58:39 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-1888c957-9974-40ba-8fc7-65b53ebba15e tempest-VolumesActionsTest-678062019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2f56fe9-5480-4a39-b54b-1b04a533c420) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:58:39 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-1888c957-9974-40ba-8fc7-65b53ebba15e tempest-VolumesActionsTest-678062019 None] Volume aea77b80-6a61-45d6-80ff-9a6fb5190ded: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aea77b80-6a61-45d6-80ff-9a6fb5190ded', 'volume_size': 1} Apr 22 17:58:39 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-1888c957-9974-40ba-8fc7-65b53ebba15e tempest-VolumesActionsTest-678062019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:58:39 devstack sudo[89363]: pam_unix(sudo:session): session closed for user root Apr 22 17:58:39 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-970d1a23-a9fa-444d-8fe6-fe7c90c96cde tempest-VolumesSnapshotTestJSON-1790417655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7d097496-766b-4bc2-9799-7ffc87065451 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b8b3b8a7-e0a6-4eea-8e44-cea705672eb0" returned: 0 in 6.519s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:58:39 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[476c8ed9-c4c1-4cb3-ab61-88fdb56847fd]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:58:39 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-970d1a23-a9fa-444d-8fe6-fe7c90c96cde tempest-VolumesSnapshotTestJSON-1790417655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7d097496-766b-4bc2-9799-7ffc87065451 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:58:39 devstack sudo[89378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7d097496-766b-4bc2-9799-7ffc87065451 Apr 22 17:58:39 devstack sudo[89378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:58:40 devstack sudo[89378]: pam_unix(sudo:session): session closed for user root Apr 22 17:58:40 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-970d1a23-a9fa-444d-8fe6-fe7c90c96cde tempest-VolumesSnapshotTestJSON-1790417655 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7d097496-766b-4bc2-9799-7ffc87065451" returned: 0 in 0.774s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:58:40 devstack cinder-volume[81771]: DEBUG cinder.image.image_utils [None req-970d1a23-a9fa-444d-8fe6-fe7c90c96cde tempest-VolumesSnapshotTestJSON-1790417655 None] Image conversion details: src /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7d097496-766b-4bc2-9799-7ffc87065451, size 1024.00 MB, duration 6.52 sec, destination /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b8b3b8a7-e0a6-4eea-8e44-cea705672eb0 {{(pid=81771) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 22 17:58:40 devstack cinder-volume[81771]: INFO cinder.image.image_utils [None req-970d1a23-a9fa-444d-8fe6-fe7c90c96cde tempest-VolumesSnapshotTestJSON-1790417655 None] Converted 1024.00 MB image at 157.05 MB/s Apr 22 17:58:40 devstack cinder-volume[81771]: WARNING cinder.volume.drivers.remotefs [None req-970d1a23-a9fa-444d-8fe6-fe7c90c96cde tempest-VolumesSnapshotTestJSON-1790417655 None] /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b8b3b8a7-e0a6-4eea-8e44-cea705672eb0 is being set with open permissions: ugo+rw Apr 22 17:58:40 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-970d1a23-a9fa-444d-8fe6-fe7c90c96cde tempest-VolumesSnapshotTestJSON-1790417655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b8b3b8a7-e0a6-4eea-8e44-cea705672eb0 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:58:40 devstack sudo[89383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b8b3b8a7-e0a6-4eea-8e44-cea705672eb0 Apr 22 17:58:40 devstack sudo[89383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:58:40 devstack sudo[89383]: pam_unix(sudo:session): session closed for user root Apr 22 17:58:40 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-970d1a23-a9fa-444d-8fe6-fe7c90c96cde tempest-VolumesSnapshotTestJSON-1790417655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b8b3b8a7-e0a6-4eea-8e44-cea705672eb0" returned: 0 in 0.488s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:58:40 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-970d1a23-a9fa-444d-8fe6-fe7c90c96cde tempest-VolumesSnapshotTestJSON-1790417655 None] Lock "cinder-quobyte-b8b3b8a7-e0a6-4eea-8e44-cea705672eb0" released by "_copy_volume_from_snapshot" :: held 9.548s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:58:40 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-970d1a23-a9fa-444d-8fe6-fe7c90c96cde tempest-VolumesSnapshotTestJSON-1790417655 None] Lock "cinder-quobyte-005372be-ca52-4c43-984a-ae914f9c6a5c-b8b3b8a7-e0a6-4eea-8e44-cea705672eb0" released by "_create_volume_from_snapshot" :: held 9.590s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:58:40 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-970d1a23-a9fa-444d-8fe6-fe7c90c96cde tempest-VolumesSnapshotTestJSON-1790417655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.611s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:58:40 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-5ba4214e-4b51-4478-8c38-202c2f642368 tempest-CinderUnicodeTest-626251776 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.417s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:58:40 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-5ba4214e-4b51-4478-8c38-202c2f642368 tempest-CinderUnicodeTest-626251776 None] Creating offline snapshot 6aab30ac-0194-4d38-9fc0-1ab9ca89531e of volume 79f00ff4-090f-48f0-a81a-9434108c51d3 {{(pid=81771) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 22 17:58:40 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-970d1a23-a9fa-444d-8fe6-fe7c90c96cde tempest-VolumesSnapshotTestJSON-1790417655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c97f3905-4ea2-414a-bf89-d14c04cbae09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8b3b8a7-e0a6-4eea-8e44-cea705672eb0', 'volume_size': 2, 'snapshot_id': '005372be-ca52-4c43-984a-ae914f9c6a5c'}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:58:40 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-970d1a23-a9fa-444d-8fe6-fe7c90c96cde tempest-VolumesSnapshotTestJSON-1790417655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4bd6171-3d82-432e-800b-2d9abd09cd34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:58:40 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[77327e2e-4680-452a-bc9d-dc54b214c00d]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:58:40 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-5ba4214e-4b51-4478-8c38-202c2f642368 tempest-CinderUnicodeTest-626251776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-79f00ff4-090f-48f0-a81a-9434108c51d3 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:58:40 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-970d1a23-a9fa-444d-8fe6-fe7c90c96cde tempest-VolumesSnapshotTestJSON-1790417655 None] Volume volume-b8b3b8a7-e0a6-4eea-8e44-cea705672eb0 (b8b3b8a7-e0a6-4eea-8e44-cea705672eb0): created successfully Apr 22 17:58:40 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-970d1a23-a9fa-444d-8fe6-fe7c90c96cde tempest-VolumesSnapshotTestJSON-1790417655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4bd6171-3d82-432e-800b-2d9abd09cd34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:58:40 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-970d1a23-a9fa-444d-8fe6-fe7c90c96cde tempest-VolumesSnapshotTestJSON-1790417655 None] Flow 'volume_create_manager' (dae8e87c-0cc5-40f7-888d-f7297fbba7df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:58:40 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-970d1a23-a9fa-444d-8fe6-fe7c90c96cde tempest-VolumesSnapshotTestJSON-1790417655 None] Created volume successfully. Apr 22 17:58:40 devstack sudo[89386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-79f00ff4-090f-48f0-a81a-9434108c51d3 Apr 22 17:58:40 devstack sudo[89386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:58:41 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-b10419ab-fff5-4359-8dd8-b0e5ef28c161 tempest-VolumesSnapshotTestJSON-1790417655 None] Acquiring lock "cinder-b8b3b8a7-e0a6-4eea-8e44-cea705672eb0-delete_volume" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:58:41 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-b10419ab-fff5-4359-8dd8-b0e5ef28c161 tempest-VolumesSnapshotTestJSON-1790417655 None] Lock "cinder-b8b3b8a7-e0a6-4eea-8e44-cea705672eb0-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:58:41 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-b10419ab-fff5-4359-8dd8-b0e5ef28c161 tempest-VolumesSnapshotTestJSON-1790417655 None] Acquiring lock "cinder-quobyte-b8b3b8a7-e0a6-4eea-8e44-cea705672eb0" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:58:41 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-b10419ab-fff5-4359-8dd8-b0e5ef28c161 tempest-VolumesSnapshotTestJSON-1790417655 None] Lock "cinder-quobyte-b8b3b8a7-e0a6-4eea-8e44-cea705672eb0" acquired by "delete_volume" :: waited 0.030s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:58:41 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bf16d76-af68-4c24-9845-eac47eeb5870]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:58:41 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-b10419ab-fff5-4359-8dd8-b0e5ef28c161 tempest-VolumesSnapshotTestJSON-1790417655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b8b3b8a7-e0a6-4eea-8e44-cea705672eb0 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:58:41 devstack sudo[89389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b8b3b8a7-e0a6-4eea-8e44-cea705672eb0 Apr 22 17:58:41 devstack sudo[89389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:58:41 devstack sudo[89386]: pam_unix(sudo:session): session closed for user root Apr 22 17:58:41 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-5ba4214e-4b51-4478-8c38-202c2f642368 tempest-CinderUnicodeTest-626251776 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-79f00ff4-090f-48f0-a81a-9434108c51d3" returned: 0 in 0.779s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:58:41 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-5ba4214e-4b51-4478-8c38-202c2f642368 tempest-CinderUnicodeTest-626251776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-79f00ff4-090f-48f0-a81a-9434108c51d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-79f00ff4-090f-48f0-a81a-9434108c51d3.6aab30ac-0194-4d38-9fc0-1ab9ca89531e 1G {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:58:41 devstack sudo[89393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-79f00ff4-090f-48f0-a81a-9434108c51d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-79f00ff4-090f-48f0-a81a-9434108c51d3.6aab30ac-0194-4d38-9fc0-1ab9ca89531e 1G Apr 22 17:58:41 devstack sudo[89393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:58:42 devstack sudo[89389]: pam_unix(sudo:session): session closed for user root Apr 22 17:58:42 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-b10419ab-fff5-4359-8dd8-b0e5ef28c161 tempest-VolumesSnapshotTestJSON-1790417655 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b8b3b8a7-e0a6-4eea-8e44-cea705672eb0" returned: 0 in 0.751s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:58:42 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-b10419ab-fff5-4359-8dd8-b0e5ef28c161 tempest-VolumesSnapshotTestJSON-1790417655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b8b3b8a7-e0a6-4eea-8e44-cea705672eb0 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:58:42 devstack sudo[89401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b8b3b8a7-e0a6-4eea-8e44-cea705672eb0 Apr 22 17:58:42 devstack sudo[89401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:58:42 devstack sudo[89393]: pam_unix(sudo:session): session closed for user root Apr 22 17:58:42 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-5ba4214e-4b51-4478-8c38-202c2f642368 tempest-CinderUnicodeTest-626251776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-79f00ff4-090f-48f0-a81a-9434108c51d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-79f00ff4-090f-48f0-a81a-9434108c51d3.6aab30ac-0194-4d38-9fc0-1ab9ca89531e 1G" returned: 0 in 0.768s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:58:42 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-5ba4214e-4b51-4478-8c38-202c2f642368 tempest-CinderUnicodeTest-626251776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79f00ff4-090f-48f0-a81a-9434108c51d3 -F qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-79f00ff4-090f-48f0-a81a-9434108c51d3.6aab30ac-0194-4d38-9fc0-1ab9ca89531e {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:58:42 devstack sudo[89403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79f00ff4-090f-48f0-a81a-9434108c51d3 -F qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-79f00ff4-090f-48f0-a81a-9434108c51d3.6aab30ac-0194-4d38-9fc0-1ab9ca89531e Apr 22 17:58:42 devstack sudo[89403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:58:42 devstack sudo[89401]: pam_unix(sudo:session): session closed for user root Apr 22 17:58:42 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-b10419ab-fff5-4359-8dd8-b0e5ef28c161 tempest-VolumesSnapshotTestJSON-1790417655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b8b3b8a7-e0a6-4eea-8e44-cea705672eb0" returned: 0 in 0.594s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:58:42 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-b10419ab-fff5-4359-8dd8-b0e5ef28c161 tempest-VolumesSnapshotTestJSON-1790417655 None] Lock "cinder-quobyte-b8b3b8a7-e0a6-4eea-8e44-cea705672eb0" released by "delete_volume" :: held 1.398s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:58:42 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-b10419ab-fff5-4359-8dd8-b0e5ef28c161 tempest-VolumesSnapshotTestJSON-1790417655 None] Created reservations ['2f4369f7-7654-4958-9bba-9d59a8e24eae', '345fdce1-e363-447c-93bf-375251587b4d', '90d00a0d-f010-4781-bd96-e9eab89c1f53', 'c11fc1ba-9221-4918-8c72-2a532bb0570b'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 17:58:42 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-b10419ab-fff5-4359-8dd8-b0e5ef28c161 tempest-VolumesSnapshotTestJSON-1790417655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:58:42 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-b10419ab-fff5-4359-8dd8-b0e5ef28c161 tempest-VolumesSnapshotTestJSON-1790417655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:58:42 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-b10419ab-fff5-4359-8dd8-b0e5ef28c161 tempest-VolumesSnapshotTestJSON-1790417655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:58:42 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-b10419ab-fff5-4359-8dd8-b0e5ef28c161 tempest-VolumesSnapshotTestJSON-1790417655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:58:42 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-b10419ab-fff5-4359-8dd8-b0e5ef28c161 tempest-VolumesSnapshotTestJSON-1790417655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:58:42 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-b10419ab-fff5-4359-8dd8-b0e5ef28c161 tempest-VolumesSnapshotTestJSON-1790417655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:58:43 devstack sudo[89408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 Apr 22 17:58:43 devstack sudo[89408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:58:43 devstack sudo[89403]: pam_unix(sudo:session): session closed for user root Apr 22 17:58:43 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-5ba4214e-4b51-4478-8c38-202c2f642368 tempest-CinderUnicodeTest-626251776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79f00ff4-090f-48f0-a81a-9434108c51d3 -F qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-79f00ff4-090f-48f0-a81a-9434108c51d3.6aab30ac-0194-4d38-9fc0-1ab9ca89531e" returned: 0 in 0.768s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:58:43 devstack cinder-volume[81771]: WARNING cinder.volume.drivers.remotefs [None req-5ba4214e-4b51-4478-8c38-202c2f642368 tempest-CinderUnicodeTest-626251776 None] /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-79f00ff4-090f-48f0-a81a-9434108c51d3.6aab30ac-0194-4d38-9fc0-1ab9ca89531e is being set with open permissions: ugo+rw Apr 22 17:58:43 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-5ba4214e-4b51-4478-8c38-202c2f642368 tempest-CinderUnicodeTest-626251776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-79f00ff4-090f-48f0-a81a-9434108c51d3.6aab30ac-0194-4d38-9fc0-1ab9ca89531e {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:58:43 devstack sudo[89411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-79f00ff4-090f-48f0-a81a-9434108c51d3.6aab30ac-0194-4d38-9fc0-1ab9ca89531e Apr 22 17:58:43 devstack sudo[89411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:58:43 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-362cffba-fea5-45ba-8c14-c8f49aacee50 tempest-VolumesSnapshotTestJSON-1790417655 None] Acquiring lock "cinder-005372be-ca52-4c43-984a-ae914f9c6a5c-delete_snapshot" by "delete_snapshot" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:58:43 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-362cffba-fea5-45ba-8c14-c8f49aacee50 tempest-VolumesSnapshotTestJSON-1790417655 None] Lock "cinder-005372be-ca52-4c43-984a-ae914f9c6a5c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:58:43 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-362cffba-fea5-45ba-8c14-c8f49aacee50 tempest-VolumesSnapshotTestJSON-1790417655 None] Acquiring lock "cinder-quobyte-7d097496-766b-4bc2-9799-7ffc87065451" by "delete_snapshot" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:58:43 devstack sudo[89408]: pam_unix(sudo:session): session closed for user root Apr 22 17:58:43 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-b10419ab-fff5-4359-8dd8-b0e5ef28c161 tempest-VolumesSnapshotTestJSON-1790417655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33" returned: 0 in 0.733s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:58:43 devstack cinder-volume[81771]: DEBUG cinder.manager [None req-b10419ab-fff5-4359-8dd8-b0e5ef28c161 tempest-VolumesSnapshotTestJSON-1790417655 None] Notifying Schedulers of capabilities ... {{(pid=81771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 17:58:43 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-b10419ab-fff5-4359-8dd8-b0e5ef28c161 tempest-VolumesSnapshotTestJSON-1790417655 None] Deleted volume successfully. Apr 22 17:58:43 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-362cffba-fea5-45ba-8c14-c8f49aacee50 tempest-VolumesSnapshotTestJSON-1790417655 None] Lock "cinder-quobyte-7d097496-766b-4bc2-9799-7ffc87065451" acquired by "delete_snapshot" :: waited 0.053s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:58:43 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-362cffba-fea5-45ba-8c14-c8f49aacee50 tempest-VolumesSnapshotTestJSON-1790417655 None] Acquiring lock "cinder-quobyte-005372be-ca52-4c43-984a-ae914f9c6a5c" by "_delete_snapshot" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:58:43 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-362cffba-fea5-45ba-8c14-c8f49aacee50 tempest-VolumesSnapshotTestJSON-1790417655 None] Lock "cinder-quobyte-005372be-ca52-4c43-984a-ae914f9c6a5c" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:58:43 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-362cffba-fea5-45ba-8c14-c8f49aacee50 tempest-VolumesSnapshotTestJSON-1790417655 None] Deleting offline snapshot 005372be-ca52-4c43-984a-ae914f9c6a5c of volume 7d097496-766b-4bc2-9799-7ffc87065451 {{(pid=81771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 22 17:58:43 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-362cffba-fea5-45ba-8c14-c8f49aacee50 tempest-VolumesSnapshotTestJSON-1790417655 None] snapshot_file for this snap is: volume-7d097496-766b-4bc2-9799-7ffc87065451.005372be-ca52-4c43-984a-ae914f9c6a5c {{(pid=81771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 22 17:58:43 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-b10419ab-fff5-4359-8dd8-b0e5ef28c161 tempest-VolumesSnapshotTestJSON-1790417655 None] Lock "cinder-b8b3b8a7-e0a6-4eea-8e44-cea705672eb0-delete_volume" released by "delete_volume" :: held 2.526s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:58:43 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[98f0a21b-7f6c-46ac-a9ec-ebef3099a702]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:58:43 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-362cffba-fea5-45ba-8c14-c8f49aacee50 tempest-VolumesSnapshotTestJSON-1790417655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7d097496-766b-4bc2-9799-7ffc87065451.005372be-ca52-4c43-984a-ae914f9c6a5c {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:58:43 devstack sudo[89411]: pam_unix(sudo:session): session closed for user root Apr 22 17:58:43 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-5ba4214e-4b51-4478-8c38-202c2f642368 tempest-CinderUnicodeTest-626251776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-79f00ff4-090f-48f0-a81a-9434108c51d3.6aab30ac-0194-4d38-9fc0-1ab9ca89531e" returned: 0 in 0.738s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:58:43 devstack sudo[89417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7d097496-766b-4bc2-9799-7ffc87065451.005372be-ca52-4c43-984a-ae914f9c6a5c Apr 22 17:58:43 devstack sudo[89417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:58:43 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-5ba4214e-4b51-4478-8c38-202c2f642368 tempest-CinderUnicodeTest-626251776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-79f00ff4-090f-48f0-a81a-9434108c51d3.info {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:58:43 devstack sudo[89419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-79f00ff4-090f-48f0-a81a-9434108c51d3.info Apr 22 17:58:43 devstack sudo[89419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:58:44 devstack sudo[89417]: pam_unix(sudo:session): session closed for user root Apr 22 17:58:44 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-362cffba-fea5-45ba-8c14-c8f49aacee50 tempest-VolumesSnapshotTestJSON-1790417655 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7d097496-766b-4bc2-9799-7ffc87065451.005372be-ca52-4c43-984a-ae914f9c6a5c" returned: 0 in 0.630s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:58:44 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-362cffba-fea5-45ba-8c14-c8f49aacee50 tempest-VolumesSnapshotTestJSON-1790417655 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7d097496-766b-4bc2-9799-7ffc87065451(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81771) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 22 17:58:44 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[11a81146-41c2-475f-a8b7-f390909ceef0]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:58:44 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-362cffba-fea5-45ba-8c14-c8f49aacee50 tempest-VolumesSnapshotTestJSON-1790417655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7d097496-766b-4bc2-9799-7ffc87065451 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:58:44 devstack sudo[89419]: pam_unix(sudo:session): session closed for user root Apr 22 17:58:44 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-5ba4214e-4b51-4478-8c38-202c2f642368 tempest-CinderUnicodeTest-626251776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-79f00ff4-090f-48f0-a81a-9434108c51d3.info" returned: 0 in 0.542s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:58:44 devstack cinder-volume[81771]: WARNING cinder.volume.drivers.remotefs [None req-5ba4214e-4b51-4478-8c38-202c2f642368 tempest-CinderUnicodeTest-626251776 None] /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-79f00ff4-090f-48f0-a81a-9434108c51d3.info is being set with open permissions: ugo+rw Apr 22 17:58:44 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-5ba4214e-4b51-4478-8c38-202c2f642368 tempest-CinderUnicodeTest-626251776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-79f00ff4-090f-48f0-a81a-9434108c51d3.info {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:58:44 devstack sudo[89426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-79f00ff4-090f-48f0-a81a-9434108c51d3.info Apr 22 17:58:44 devstack sudo[89426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:58:44 devstack sudo[89425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7d097496-766b-4bc2-9799-7ffc87065451 Apr 22 17:58:44 devstack sudo[89425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:58:45 devstack sudo[89426]: pam_unix(sudo:session): session closed for user root Apr 22 17:58:45 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-5ba4214e-4b51-4478-8c38-202c2f642368 tempest-CinderUnicodeTest-626251776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-79f00ff4-090f-48f0-a81a-9434108c51d3.info" returned: 0 in 0.575s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:58:45 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-5ba4214e-4b51-4478-8c38-202c2f642368 tempest-CinderUnicodeTest-626251776 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.317s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:58:45 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-1888c957-9974-40ba-8fc7-65b53ebba15e tempest-VolumesActionsTest-678062019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.972s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:58:45 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-1888c957-9974-40ba-8fc7-65b53ebba15e tempest-VolumesActionsTest-678062019 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:58:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1783253691',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aea77b80-6a61-45d6-80ff-9a6fb5190ded,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd5ed77be0ee418cb4f7816bd70e7b2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:58:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:58:39Z,use_quota=True,user_id='fa7c9a3bff17449bb4b6fcd3fa13fb1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)}" {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 17:58:45 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-1888c957-9974-40ba-8fc7-65b53ebba15e tempest-VolumesActionsTest-678062019 None] Creating volume aea77b80-6a61-45d6-80ff-9a6fb5190ded {{(pid=81771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 17:58:45 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-1888c957-9974-40ba-8fc7-65b53ebba15e tempest-VolumesActionsTest-678062019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:58:45 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-1888c957-9974-40ba-8fc7-65b53ebba15e tempest-VolumesActionsTest-678062019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:58:45 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-1888c957-9974-40ba-8fc7-65b53ebba15e tempest-VolumesActionsTest-678062019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:58:45 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-1888c957-9974-40ba-8fc7-65b53ebba15e tempest-VolumesActionsTest-678062019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:58:45 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-1888c957-9974-40ba-8fc7-65b53ebba15e tempest-VolumesActionsTest-678062019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:58:45 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-1888c957-9974-40ba-8fc7-65b53ebba15e tempest-VolumesActionsTest-678062019 None] Selected osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 as target Quobyte volume. {{(pid=81771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 17:58:45 devstack cinder-volume[81771]: INFO cinder.volume.drivers.remotefs [None req-1888c957-9974-40ba-8fc7-65b53ebba15e tempest-VolumesActionsTest-678062019 None] casted to osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 Apr 22 17:58:45 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-1888c957-9974-40ba-8fc7-65b53ebba15e tempest-VolumesActionsTest-678062019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-aea77b80-6a61-45d6-80ff-9a6fb5190ded 1073741824 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:58:45 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-5ba4214e-4b51-4478-8c38-202c2f642368 tempest-CinderUnicodeTest-626251776 None] Create snapshot completed successfully Apr 22 17:58:45 devstack sudo[89425]: pam_unix(sudo:session): session closed for user root Apr 22 17:58:45 devstack sudo[89433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-aea77b80-6a61-45d6-80ff-9a6fb5190ded 1073741824 Apr 22 17:58:45 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-362cffba-fea5-45ba-8c14-c8f49aacee50 tempest-VolumesSnapshotTestJSON-1790417655 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7d097496-766b-4bc2-9799-7ffc87065451" returned: 0 in 0.696s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:58:45 devstack sudo[89433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:58:45 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-362cffba-fea5-45ba-8c14-c8f49aacee50 tempest-VolumesSnapshotTestJSON-1790417655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7d097496-766b-4bc2-9799-7ffc87065451.005372be-ca52-4c43-984a-ae914f9c6a5c {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:58:45 devstack sudo[89435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7d097496-766b-4bc2-9799-7ffc87065451.005372be-ca52-4c43-984a-ae914f9c6a5c Apr 22 17:58:45 devstack sudo[89435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:58:45 devstack sudo[89435]: pam_unix(sudo:session): session closed for user root Apr 22 17:58:45 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-362cffba-fea5-45ba-8c14-c8f49aacee50 tempest-VolumesSnapshotTestJSON-1790417655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7d097496-766b-4bc2-9799-7ffc87065451.005372be-ca52-4c43-984a-ae914f9c6a5c" returned: 0 in 0.656s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:58:45 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-362cffba-fea5-45ba-8c14-c8f49aacee50 tempest-VolumesSnapshotTestJSON-1790417655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7d097496-766b-4bc2-9799-7ffc87065451.005372be-ca52-4c43-984a-ae914f9c6a5c {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:58:45 devstack sudo[89443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7d097496-766b-4bc2-9799-7ffc87065451.005372be-ca52-4c43-984a-ae914f9c6a5c Apr 22 17:58:45 devstack sudo[89443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:58:45 devstack sudo[89433]: pam_unix(sudo:session): session closed for user root Apr 22 17:58:45 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-1888c957-9974-40ba-8fc7-65b53ebba15e tempest-VolumesActionsTest-678062019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-aea77b80-6a61-45d6-80ff-9a6fb5190ded 1073741824" returned: 0 in 0.803s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:58:46 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-1888c957-9974-40ba-8fc7-65b53ebba15e tempest-VolumesActionsTest-678062019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-aea77b80-6a61-45d6-80ff-9a6fb5190ded {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:58:46 devstack sudo[89446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-aea77b80-6a61-45d6-80ff-9a6fb5190ded Apr 22 17:58:46 devstack sudo[89446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:58:46 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-d8783780-de21-45fa-912a-bc5bcf62d270 tempest-CinderUnicodeTest-626251776 None] Acquiring lock "cinder-6aab30ac-0194-4d38-9fc0-1ab9ca89531e-delete_snapshot" by "delete_snapshot" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:58:46 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-d8783780-de21-45fa-912a-bc5bcf62d270 tempest-CinderUnicodeTest-626251776 None] Lock "cinder-6aab30ac-0194-4d38-9fc0-1ab9ca89531e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:58:46 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-d8783780-de21-45fa-912a-bc5bcf62d270 tempest-CinderUnicodeTest-626251776 None] Acquiring lock "cinder-quobyte-79f00ff4-090f-48f0-a81a-9434108c51d3" by "delete_snapshot" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:58:46 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-d8783780-de21-45fa-912a-bc5bcf62d270 tempest-CinderUnicodeTest-626251776 None] Lock "cinder-quobyte-79f00ff4-090f-48f0-a81a-9434108c51d3" acquired by "delete_snapshot" :: waited 0.023s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:58:46 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-d8783780-de21-45fa-912a-bc5bcf62d270 tempest-CinderUnicodeTest-626251776 None] Acquiring lock "cinder-quobyte-6aab30ac-0194-4d38-9fc0-1ab9ca89531e" by "_delete_snapshot" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:58:46 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-d8783780-de21-45fa-912a-bc5bcf62d270 tempest-CinderUnicodeTest-626251776 None] Lock "cinder-quobyte-6aab30ac-0194-4d38-9fc0-1ab9ca89531e" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:58:46 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-d8783780-de21-45fa-912a-bc5bcf62d270 tempest-CinderUnicodeTest-626251776 None] Deleting offline snapshot 6aab30ac-0194-4d38-9fc0-1ab9ca89531e of volume 79f00ff4-090f-48f0-a81a-9434108c51d3 {{(pid=81771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 22 17:58:46 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-d8783780-de21-45fa-912a-bc5bcf62d270 tempest-CinderUnicodeTest-626251776 None] snapshot_file for this snap is: volume-79f00ff4-090f-48f0-a81a-9434108c51d3.6aab30ac-0194-4d38-9fc0-1ab9ca89531e {{(pid=81771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 22 17:58:46 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdd7ad3c-d251-4242-9458-eede11e0f029]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:58:46 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-d8783780-de21-45fa-912a-bc5bcf62d270 tempest-CinderUnicodeTest-626251776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-79f00ff4-090f-48f0-a81a-9434108c51d3.6aab30ac-0194-4d38-9fc0-1ab9ca89531e {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:58:46 devstack sudo[89449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-79f00ff4-090f-48f0-a81a-9434108c51d3.6aab30ac-0194-4d38-9fc0-1ab9ca89531e Apr 22 17:58:46 devstack sudo[89449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:58:46 devstack sudo[89443]: pam_unix(sudo:session): session closed for user root Apr 22 17:58:46 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-362cffba-fea5-45ba-8c14-c8f49aacee50 tempest-VolumesSnapshotTestJSON-1790417655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7d097496-766b-4bc2-9799-7ffc87065451.005372be-ca52-4c43-984a-ae914f9c6a5c" returned: 0 in 0.827s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:58:46 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-362cffba-fea5-45ba-8c14-c8f49aacee50 tempest-VolumesSnapshotTestJSON-1790417655 None] Lock "cinder-quobyte-005372be-ca52-4c43-984a-ae914f9c6a5c" released by "_delete_snapshot" :: held 2.924s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:58:46 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-362cffba-fea5-45ba-8c14-c8f49aacee50 tempest-VolumesSnapshotTestJSON-1790417655 None] Lock "cinder-quobyte-7d097496-766b-4bc2-9799-7ffc87065451" released by "delete_snapshot" :: held 2.961s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:58:46 devstack sudo[89446]: pam_unix(sudo:session): session closed for user root Apr 22 17:58:46 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-362cffba-fea5-45ba-8c14-c8f49aacee50 tempest-VolumesSnapshotTestJSON-1790417655 None] Created reservations ['54dc75a6-e5d3-4c2b-997a-2fa66672d9c1', 'b32f1728-53bb-422b-a9fe-b792c38ace8d', '8621965c-6fef-4ef1-bd16-e29deff426b5', '45e43271-9e75-4780-953e-154daea1e336'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 17:58:46 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-1888c957-9974-40ba-8fc7-65b53ebba15e tempest-VolumesActionsTest-678062019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-aea77b80-6a61-45d6-80ff-9a6fb5190ded" returned: 0 in 0.742s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:58:46 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-1888c957-9974-40ba-8fc7-65b53ebba15e tempest-VolumesActionsTest-678062019 None] <== create_volume: return (1689ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'} {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 17:58:46 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-1888c957-9974-40ba-8fc7-65b53ebba15e tempest-VolumesActionsTest-678062019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.693s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:58:46 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-1888c957-9974-40ba-8fc7-65b53ebba15e tempest-VolumesActionsTest-678062019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2f56fe9-5480-4a39-b54b-1b04a533c420) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aea77b80-6a61-45d6-80ff-9a6fb5190ded', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:58:46 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-1888c957-9974-40ba-8fc7-65b53ebba15e tempest-VolumesActionsTest-678062019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5227d1a-8c8e-4fed-a26c-889fd42d7d5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:58:46 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-1888c957-9974-40ba-8fc7-65b53ebba15e tempest-VolumesActionsTest-678062019 None] Volume volume-aea77b80-6a61-45d6-80ff-9a6fb5190ded (aea77b80-6a61-45d6-80ff-9a6fb5190ded): created successfully Apr 22 17:58:46 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-1888c957-9974-40ba-8fc7-65b53ebba15e tempest-VolumesActionsTest-678062019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5227d1a-8c8e-4fed-a26c-889fd42d7d5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:58:46 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-1888c957-9974-40ba-8fc7-65b53ebba15e tempest-VolumesActionsTest-678062019 None] Flow 'volume_create_manager' (5ecbf390-ae6e-4a04-8472-0b7cd92dd9ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:58:46 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-1888c957-9974-40ba-8fc7-65b53ebba15e tempest-VolumesActionsTest-678062019 None] Created volume successfully. Apr 22 17:58:46 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-362cffba-fea5-45ba-8c14-c8f49aacee50 tempest-VolumesSnapshotTestJSON-1790417655 None] Delete snapshot completed successfully. Apr 22 17:58:46 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-362cffba-fea5-45ba-8c14-c8f49aacee50 tempest-VolumesSnapshotTestJSON-1790417655 None] Lock "cinder-005372be-ca52-4c43-984a-ae914f9c6a5c-delete_snapshot" released by "delete_snapshot" :: held 3.201s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:58:47 devstack sudo[89449]: pam_unix(sudo:session): session closed for user root Apr 22 17:58:47 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-d8783780-de21-45fa-912a-bc5bcf62d270 tempest-CinderUnicodeTest-626251776 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-79f00ff4-090f-48f0-a81a-9434108c51d3.6aab30ac-0194-4d38-9fc0-1ab9ca89531e" returned: 0 in 0.650s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:58:47 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-d8783780-de21-45fa-912a-bc5bcf62d270 tempest-CinderUnicodeTest-626251776 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-79f00ff4-090f-48f0-a81a-9434108c51d3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81771) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 22 17:58:47 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[daf69041-2e7e-4b28-ae82-0337df3d12b8]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:58:47 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-d8783780-de21-45fa-912a-bc5bcf62d270 tempest-CinderUnicodeTest-626251776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-79f00ff4-090f-48f0-a81a-9434108c51d3 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:58:47 devstack sudo[89457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-79f00ff4-090f-48f0-a81a-9434108c51d3 Apr 22 17:58:47 devstack sudo[89457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:58:47 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-b993e258-ae43-4c25-aba6-0e40ded7df3e tempest-VolumesActionsTest-1312180831 None] Acquiring lock "cinder-aea77b80-6a61-45d6-80ff-9a6fb5190ded-delete_volume" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:58:47 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-b993e258-ae43-4c25-aba6-0e40ded7df3e tempest-VolumesActionsTest-1312180831 None] Lock "cinder-aea77b80-6a61-45d6-80ff-9a6fb5190ded-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:58:47 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-b993e258-ae43-4c25-aba6-0e40ded7df3e tempest-VolumesActionsTest-1312180831 None] Acquiring lock "cinder-quobyte-aea77b80-6a61-45d6-80ff-9a6fb5190ded" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:58:47 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-b993e258-ae43-4c25-aba6-0e40ded7df3e tempest-VolumesActionsTest-1312180831 None] Lock "cinder-quobyte-aea77b80-6a61-45d6-80ff-9a6fb5190ded" acquired by "delete_volume" :: waited 0.024s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:58:47 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[01787e82-a87e-4ed7-9f32-e7f24eb63d7d]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:58:47 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-b993e258-ae43-4c25-aba6-0e40ded7df3e tempest-VolumesActionsTest-1312180831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-aea77b80-6a61-45d6-80ff-9a6fb5190ded {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:58:47 devstack sudo[89459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-aea77b80-6a61-45d6-80ff-9a6fb5190ded Apr 22 17:58:47 devstack sudo[89459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:58:47 devstack sudo[89457]: pam_unix(sudo:session): session closed for user root Apr 22 17:58:47 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-d8783780-de21-45fa-912a-bc5bcf62d270 tempest-CinderUnicodeTest-626251776 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-79f00ff4-090f-48f0-a81a-9434108c51d3" returned: 0 in 0.667s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:58:47 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-d8783780-de21-45fa-912a-bc5bcf62d270 tempest-CinderUnicodeTest-626251776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-79f00ff4-090f-48f0-a81a-9434108c51d3.6aab30ac-0194-4d38-9fc0-1ab9ca89531e {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:58:47 devstack sudo[89464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-79f00ff4-090f-48f0-a81a-9434108c51d3.6aab30ac-0194-4d38-9fc0-1ab9ca89531e Apr 22 17:58:47 devstack sudo[89464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:58:48 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-73f9790d-9d1a-40f4-a63a-5fd8d98c39a8 tempest-VolumesSnapshotTestJSON-1790417655 None] Acquiring lock "cinder-7d097496-766b-4bc2-9799-7ffc87065451-delete_volume" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:58:48 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-73f9790d-9d1a-40f4-a63a-5fd8d98c39a8 tempest-VolumesSnapshotTestJSON-1790417655 None] Lock "cinder-7d097496-766b-4bc2-9799-7ffc87065451-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:58:48 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-73f9790d-9d1a-40f4-a63a-5fd8d98c39a8 tempest-VolumesSnapshotTestJSON-1790417655 None] Acquiring lock "cinder-quobyte-7d097496-766b-4bc2-9799-7ffc87065451" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:58:48 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-73f9790d-9d1a-40f4-a63a-5fd8d98c39a8 tempest-VolumesSnapshotTestJSON-1790417655 None] Lock "cinder-quobyte-7d097496-766b-4bc2-9799-7ffc87065451" acquired by "delete_volume" :: waited 0.019s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:58:48 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[4334e723-5b15-4a59-8b28-266c2485dd8a]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:58:48 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-73f9790d-9d1a-40f4-a63a-5fd8d98c39a8 tempest-VolumesSnapshotTestJSON-1790417655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7d097496-766b-4bc2-9799-7ffc87065451 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:58:48 devstack sudo[89466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7d097496-766b-4bc2-9799-7ffc87065451 Apr 22 17:58:48 devstack sudo[89466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:58:48 devstack sudo[89459]: pam_unix(sudo:session): session closed for user root Apr 22 17:58:48 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-b993e258-ae43-4c25-aba6-0e40ded7df3e tempest-VolumesActionsTest-1312180831 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-aea77b80-6a61-45d6-80ff-9a6fb5190ded" returned: 0 in 0.820s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:58:48 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-b993e258-ae43-4c25-aba6-0e40ded7df3e tempest-VolumesActionsTest-1312180831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-aea77b80-6a61-45d6-80ff-9a6fb5190ded {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:58:48 devstack sudo[89474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-aea77b80-6a61-45d6-80ff-9a6fb5190ded Apr 22 17:58:48 devstack sudo[89474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:58:48 devstack sudo[89464]: pam_unix(sudo:session): session closed for user root Apr 22 17:58:48 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-d8783780-de21-45fa-912a-bc5bcf62d270 tempest-CinderUnicodeTest-626251776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-79f00ff4-090f-48f0-a81a-9434108c51d3.6aab30ac-0194-4d38-9fc0-1ab9ca89531e" returned: 0 in 0.850s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:58:48 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-d8783780-de21-45fa-912a-bc5bcf62d270 tempest-CinderUnicodeTest-626251776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-79f00ff4-090f-48f0-a81a-9434108c51d3.6aab30ac-0194-4d38-9fc0-1ab9ca89531e {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:58:48 devstack sudo[89476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-79f00ff4-090f-48f0-a81a-9434108c51d3.6aab30ac-0194-4d38-9fc0-1ab9ca89531e Apr 22 17:58:48 devstack sudo[89476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:58:48 devstack sudo[89466]: pam_unix(sudo:session): session closed for user root Apr 22 17:58:48 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-73f9790d-9d1a-40f4-a63a-5fd8d98c39a8 tempest-VolumesSnapshotTestJSON-1790417655 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7d097496-766b-4bc2-9799-7ffc87065451" returned: 0 in 0.759s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:58:48 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-73f9790d-9d1a-40f4-a63a-5fd8d98c39a8 tempest-VolumesSnapshotTestJSON-1790417655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7d097496-766b-4bc2-9799-7ffc87065451 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:58:48 devstack sudo[89482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7d097496-766b-4bc2-9799-7ffc87065451 Apr 22 17:58:48 devstack sudo[89482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:58:49 devstack sudo[89474]: pam_unix(sudo:session): session closed for user root Apr 22 17:58:49 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-b993e258-ae43-4c25-aba6-0e40ded7df3e tempest-VolumesActionsTest-1312180831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-aea77b80-6a61-45d6-80ff-9a6fb5190ded" returned: 0 in 0.665s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:58:49 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-b993e258-ae43-4c25-aba6-0e40ded7df3e tempest-VolumesActionsTest-1312180831 None] Lock "cinder-quobyte-aea77b80-6a61-45d6-80ff-9a6fb5190ded" released by "delete_volume" :: held 1.551s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:58:49 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-b993e258-ae43-4c25-aba6-0e40ded7df3e tempest-VolumesActionsTest-1312180831 None] Created reservations ['8c7acda0-3227-4029-8ea4-54139abd6dfd', '30252ff1-12cf-418a-a654-c6551360a1ab', '1d4c2d1b-e167-4364-bee8-7f602d814be5', '6b06c22a-e426-4e3b-a4b4-9bbeab280cb9'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 17:58:49 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-b993e258-ae43-4c25-aba6-0e40ded7df3e tempest-VolumesActionsTest-1312180831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:58:49 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-b993e258-ae43-4c25-aba6-0e40ded7df3e tempest-VolumesActionsTest-1312180831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:58:49 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-b993e258-ae43-4c25-aba6-0e40ded7df3e tempest-VolumesActionsTest-1312180831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:58:49 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-b993e258-ae43-4c25-aba6-0e40ded7df3e tempest-VolumesActionsTest-1312180831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:58:49 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-b993e258-ae43-4c25-aba6-0e40ded7df3e tempest-VolumesActionsTest-1312180831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:58:49 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-b993e258-ae43-4c25-aba6-0e40ded7df3e tempest-VolumesActionsTest-1312180831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:58:49 devstack sudo[89485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 Apr 22 17:58:49 devstack sudo[89485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:58:49 devstack sudo[89476]: pam_unix(sudo:session): session closed for user root Apr 22 17:58:49 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-d8783780-de21-45fa-912a-bc5bcf62d270 tempest-CinderUnicodeTest-626251776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-79f00ff4-090f-48f0-a81a-9434108c51d3.6aab30ac-0194-4d38-9fc0-1ab9ca89531e" returned: 0 in 0.688s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:58:49 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-d8783780-de21-45fa-912a-bc5bcf62d270 tempest-CinderUnicodeTest-626251776 None] Lock "cinder-quobyte-6aab30ac-0194-4d38-9fc0-1ab9ca89531e" released by "_delete_snapshot" :: held 3.020s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:58:49 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-d8783780-de21-45fa-912a-bc5bcf62d270 tempest-CinderUnicodeTest-626251776 None] Lock "cinder-quobyte-79f00ff4-090f-48f0-a81a-9434108c51d3" released by "delete_snapshot" :: held 3.054s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:58:49 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-d8783780-de21-45fa-912a-bc5bcf62d270 tempest-CinderUnicodeTest-626251776 None] Created reservations ['b4f8fcc7-fab2-489f-890e-05ceecac2a9e', '891a57b9-90fb-492e-a287-153690183fc7', 'b62c6944-2bb8-474e-aaac-b008f78e6fda', '5cff6337-5fb5-4c86-b134-c8b668ceb883'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 17:58:49 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-d8783780-de21-45fa-912a-bc5bcf62d270 tempest-CinderUnicodeTest-626251776 None] Delete snapshot completed successfully. Apr 22 17:58:49 devstack sudo[89482]: pam_unix(sudo:session): session closed for user root Apr 22 17:58:49 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-73f9790d-9d1a-40f4-a63a-5fd8d98c39a8 tempest-VolumesSnapshotTestJSON-1790417655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7d097496-766b-4bc2-9799-7ffc87065451" returned: 0 in 0.579s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:58:49 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-d8783780-de21-45fa-912a-bc5bcf62d270 tempest-CinderUnicodeTest-626251776 None] Lock "cinder-6aab30ac-0194-4d38-9fc0-1ab9ca89531e-delete_snapshot" released by "delete_snapshot" :: held 3.236s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:58:49 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-73f9790d-9d1a-40f4-a63a-5fd8d98c39a8 tempest-VolumesSnapshotTestJSON-1790417655 None] Lock "cinder-quobyte-7d097496-766b-4bc2-9799-7ffc87065451" released by "delete_volume" :: held 1.430s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:58:49 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-73f9790d-9d1a-40f4-a63a-5fd8d98c39a8 tempest-VolumesSnapshotTestJSON-1790417655 None] Created reservations ['dd297912-12c6-4257-970d-d11fa3d16f68', 'a92fce5b-8a74-4026-84b2-e103637248ee', '8815bd46-58d9-4535-b359-396fb1de7e3a', 'cfb9d3db-f966-4fe4-8944-30f60a72cb1d'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 17:58:49 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-73f9790d-9d1a-40f4-a63a-5fd8d98c39a8 tempest-VolumesSnapshotTestJSON-1790417655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:58:49 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-73f9790d-9d1a-40f4-a63a-5fd8d98c39a8 tempest-VolumesSnapshotTestJSON-1790417655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:58:49 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-73f9790d-9d1a-40f4-a63a-5fd8d98c39a8 tempest-VolumesSnapshotTestJSON-1790417655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:58:49 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-73f9790d-9d1a-40f4-a63a-5fd8d98c39a8 tempest-VolumesSnapshotTestJSON-1790417655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:58:49 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-73f9790d-9d1a-40f4-a63a-5fd8d98c39a8 tempest-VolumesSnapshotTestJSON-1790417655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:58:49 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-73f9790d-9d1a-40f4-a63a-5fd8d98c39a8 tempest-VolumesSnapshotTestJSON-1790417655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:58:49 devstack sudo[89488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 Apr 22 17:58:49 devstack sudo[89488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:58:49 devstack sudo[89485]: pam_unix(sudo:session): session closed for user root Apr 22 17:58:49 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-b993e258-ae43-4c25-aba6-0e40ded7df3e tempest-VolumesActionsTest-1312180831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33" returned: 0 in 0.644s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:58:49 devstack cinder-volume[81771]: DEBUG cinder.manager [None req-b993e258-ae43-4c25-aba6-0e40ded7df3e tempest-VolumesActionsTest-1312180831 None] Notifying Schedulers of capabilities ... {{(pid=81771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 17:58:49 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-b993e258-ae43-4c25-aba6-0e40ded7df3e tempest-VolumesActionsTest-1312180831 None] Deleted volume successfully. Apr 22 17:58:49 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-b993e258-ae43-4c25-aba6-0e40ded7df3e tempest-VolumesActionsTest-1312180831 None] Lock "cinder-aea77b80-6a61-45d6-80ff-9a6fb5190ded-delete_volume" released by "delete_volume" :: held 2.531s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:58:50 devstack cinder-volume[81771]: DEBUG cinder.volume.flows.manager.create_volume [None req-87bfe4af-e308-48e7-ae37-6e636ed4836a tempest-VolumesActionsTest-678062019 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 17:58:50 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-87bfe4af-e308-48e7-ae37-6e636ed4836a tempest-VolumesActionsTest-678062019 None] Flow 'volume_create_manager' (d3f456cc-c678-4d45-8228-c59434890d04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:58:50 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-87bfe4af-e308-48e7-ae37-6e636ed4836a tempest-VolumesActionsTest-678062019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9564401-b581-4d4b-8044-fa7aa7f84d5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:58:50 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-87bfe4af-e308-48e7-ae37-6e636ed4836a tempest-VolumesActionsTest-678062019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9564401-b581-4d4b-8044-fa7aa7f84d5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:58:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1398783283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb25ffb4-bb91-42d9-9c2f-aa542d377713,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd5ed77be0ee418cb4f7816bd70e7b2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:58:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:58:50Z,use_quota=True,user_id='fa7c9a3bff17449bb4b6fcd3fa13fb1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:58:50 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-87bfe4af-e308-48e7-ae37-6e636ed4836a tempest-VolumesActionsTest-678062019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1e54913-b299-4f29-9897-e878139e0395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:58:50 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-87bfe4af-e308-48e7-ae37-6e636ed4836a tempest-VolumesActionsTest-678062019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1e54913-b299-4f29-9897-e878139e0395) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:58:50 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-87bfe4af-e308-48e7-ae37-6e636ed4836a tempest-VolumesActionsTest-678062019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed6f831b-06bc-4112-8d63-ec01c34ab001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:58:50 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-87bfe4af-e308-48e7-ae37-6e636ed4836a tempest-VolumesActionsTest-678062019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed6f831b-06bc-4112-8d63-ec01c34ab001) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb25ffb4-bb91-42d9-9c2f-aa542d377713', 'volume_name': 'volume-cb25ffb4-bb91-42d9-9c2f-aa542d377713', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:58:50 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-87bfe4af-e308-48e7-ae37-6e636ed4836a tempest-VolumesActionsTest-678062019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3283a3fa-d1c0-4a21-af7a-28b50217295e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:58:50 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-87bfe4af-e308-48e7-ae37-6e636ed4836a tempest-VolumesActionsTest-678062019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3283a3fa-d1c0-4a21-af7a-28b50217295e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:58:50 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-87bfe4af-e308-48e7-ae37-6e636ed4836a tempest-VolumesActionsTest-678062019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47594171-216a-44ab-ad23-65c688b4c7c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:58:50 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-87bfe4af-e308-48e7-ae37-6e636ed4836a tempest-VolumesActionsTest-678062019 None] Volume cb25ffb4-bb91-42d9-9c2f-aa542d377713: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb25ffb4-bb91-42d9-9c2f-aa542d377713', 'volume_size': 1} Apr 22 17:58:50 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-87bfe4af-e308-48e7-ae37-6e636ed4836a tempest-VolumesActionsTest-678062019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:58:50 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-87bfe4af-e308-48e7-ae37-6e636ed4836a tempest-VolumesActionsTest-678062019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:58:50 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-87bfe4af-e308-48e7-ae37-6e636ed4836a tempest-VolumesActionsTest-678062019 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:58:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1398783283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb25ffb4-bb91-42d9-9c2f-aa542d377713,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd5ed77be0ee418cb4f7816bd70e7b2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:58:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:58:50Z,use_quota=True,user_id='fa7c9a3bff17449bb4b6fcd3fa13fb1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)}" {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 17:58:50 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-87bfe4af-e308-48e7-ae37-6e636ed4836a tempest-VolumesActionsTest-678062019 None] Creating volume cb25ffb4-bb91-42d9-9c2f-aa542d377713 {{(pid=81771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 17:58:50 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-87bfe4af-e308-48e7-ae37-6e636ed4836a tempest-VolumesActionsTest-678062019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:58:50 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-87bfe4af-e308-48e7-ae37-6e636ed4836a tempest-VolumesActionsTest-678062019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:58:50 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-87bfe4af-e308-48e7-ae37-6e636ed4836a tempest-VolumesActionsTest-678062019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:58:50 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-87bfe4af-e308-48e7-ae37-6e636ed4836a tempest-VolumesActionsTest-678062019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:58:50 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-87bfe4af-e308-48e7-ae37-6e636ed4836a tempest-VolumesActionsTest-678062019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:58:50 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-87bfe4af-e308-48e7-ae37-6e636ed4836a tempest-VolumesActionsTest-678062019 None] Selected osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 as target Quobyte volume. {{(pid=81771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 17:58:50 devstack cinder-volume[81771]: INFO cinder.volume.drivers.remotefs [None req-87bfe4af-e308-48e7-ae37-6e636ed4836a tempest-VolumesActionsTest-678062019 None] casted to osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 Apr 22 17:58:50 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-87bfe4af-e308-48e7-ae37-6e636ed4836a tempest-VolumesActionsTest-678062019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-cb25ffb4-bb91-42d9-9c2f-aa542d377713 1073741824 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:58:50 devstack sudo[89491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-cb25ffb4-bb91-42d9-9c2f-aa542d377713 1073741824 Apr 22 17:58:50 devstack sudo[89491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:58:50 devstack sudo[89488]: pam_unix(sudo:session): session closed for user root Apr 22 17:58:50 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-73f9790d-9d1a-40f4-a63a-5fd8d98c39a8 tempest-VolumesSnapshotTestJSON-1790417655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33" returned: 0 in 0.588s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:58:50 devstack cinder-volume[81771]: DEBUG cinder.manager [None req-73f9790d-9d1a-40f4-a63a-5fd8d98c39a8 tempest-VolumesSnapshotTestJSON-1790417655 None] Notifying Schedulers of capabilities ... {{(pid=81771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 17:58:50 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-73f9790d-9d1a-40f4-a63a-5fd8d98c39a8 tempest-VolumesSnapshotTestJSON-1790417655 None] Deleted volume successfully. Apr 22 17:58:50 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-73f9790d-9d1a-40f4-a63a-5fd8d98c39a8 tempest-VolumesSnapshotTestJSON-1790417655 None] Lock "cinder-7d097496-766b-4bc2-9799-7ffc87065451-delete_volume" released by "delete_volume" :: held 2.340s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:58:50 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-24325fa2-6b67-4a33-96eb-128791da042f tempest-CinderUnicodeTest-626251776 None] Acquiring lock "cinder-79f00ff4-090f-48f0-a81a-9434108c51d3-delete_volume" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:58:50 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-24325fa2-6b67-4a33-96eb-128791da042f tempest-CinderUnicodeTest-626251776 None] Lock "cinder-79f00ff4-090f-48f0-a81a-9434108c51d3-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:58:50 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-24325fa2-6b67-4a33-96eb-128791da042f tempest-CinderUnicodeTest-626251776 None] Acquiring lock "cinder-quobyte-79f00ff4-090f-48f0-a81a-9434108c51d3" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:58:50 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-24325fa2-6b67-4a33-96eb-128791da042f tempest-CinderUnicodeTest-626251776 None] Lock "cinder-quobyte-79f00ff4-090f-48f0-a81a-9434108c51d3" acquired by "delete_volume" :: waited 0.018s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:58:50 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[19c3ca6c-5831-482d-bb69-7457cd65f4fd]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:58:50 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-24325fa2-6b67-4a33-96eb-128791da042f tempest-CinderUnicodeTest-626251776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-79f00ff4-090f-48f0-a81a-9434108c51d3 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:58:50 devstack cinder-volume[81771]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f3fb894-c16f-44eb-986d-2b7b9a9883f7 tempest-VolumesSnapshotTestJSON-1790417655 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 17:58:50 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-3f3fb894-c16f-44eb-986d-2b7b9a9883f7 tempest-VolumesSnapshotTestJSON-1790417655 None] Flow 'volume_create_manager' (8d65e2c2-dd09-498c-ace4-88da87b4c317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:58:50 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-3f3fb894-c16f-44eb-986d-2b7b9a9883f7 tempest-VolumesSnapshotTestJSON-1790417655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c407e370-701c-441e-abf7-69e57ac6dec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:58:50 devstack sudo[89497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-79f00ff4-090f-48f0-a81a-9434108c51d3 Apr 22 17:58:50 devstack sudo[89497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:58:50 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-3f3fb894-c16f-44eb-986d-2b7b9a9883f7 tempest-VolumesSnapshotTestJSON-1790417655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c407e370-701c-441e-abf7-69e57ac6dec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:58:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1971901615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73da30b2-98a3-4291-8cdb-ed2406200414,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afd9a86ddfc94168aaf00fc1e9b425f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:58:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:58:51Z,use_quota=True,user_id='e1b4ff9f921345ce968b249e8ba0c04b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:58:50 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-3f3fb894-c16f-44eb-986d-2b7b9a9883f7 tempest-VolumesSnapshotTestJSON-1790417655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a98439b-2075-4aeb-90fc-d5fff46be276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:58:50 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-3f3fb894-c16f-44eb-986d-2b7b9a9883f7 tempest-VolumesSnapshotTestJSON-1790417655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a98439b-2075-4aeb-90fc-d5fff46be276) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:58:50 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-3f3fb894-c16f-44eb-986d-2b7b9a9883f7 tempest-VolumesSnapshotTestJSON-1790417655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05335a2f-4d9d-42ca-8aad-02a5a636b574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:58:50 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-3f3fb894-c16f-44eb-986d-2b7b9a9883f7 tempest-VolumesSnapshotTestJSON-1790417655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05335a2f-4d9d-42ca-8aad-02a5a636b574) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73da30b2-98a3-4291-8cdb-ed2406200414', 'volume_name': 'volume-73da30b2-98a3-4291-8cdb-ed2406200414', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:58:50 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-3f3fb894-c16f-44eb-986d-2b7b9a9883f7 tempest-VolumesSnapshotTestJSON-1790417655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dae38ef2-51c9-4d58-aa36-c63cb6c21bd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:58:50 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-3f3fb894-c16f-44eb-986d-2b7b9a9883f7 tempest-VolumesSnapshotTestJSON-1790417655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dae38ef2-51c9-4d58-aa36-c63cb6c21bd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:58:50 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-3f3fb894-c16f-44eb-986d-2b7b9a9883f7 tempest-VolumesSnapshotTestJSON-1790417655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cd69e98-bba1-494a-85b8-a41a577a2274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:58:50 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-3f3fb894-c16f-44eb-986d-2b7b9a9883f7 tempest-VolumesSnapshotTestJSON-1790417655 None] Volume 73da30b2-98a3-4291-8cdb-ed2406200414: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73da30b2-98a3-4291-8cdb-ed2406200414', 'volume_size': 1} Apr 22 17:58:50 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-3f3fb894-c16f-44eb-986d-2b7b9a9883f7 tempest-VolumesSnapshotTestJSON-1790417655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:58:51 devstack sudo[89491]: pam_unix(sudo:session): session closed for user root Apr 22 17:58:51 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-87bfe4af-e308-48e7-ae37-6e636ed4836a tempest-VolumesActionsTest-678062019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-cb25ffb4-bb91-42d9-9c2f-aa542d377713 1073741824" returned: 0 in 0.909s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:58:51 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-87bfe4af-e308-48e7-ae37-6e636ed4836a tempest-VolumesActionsTest-678062019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-cb25ffb4-bb91-42d9-9c2f-aa542d377713 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:58:51 devstack sudo[89499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-cb25ffb4-bb91-42d9-9c2f-aa542d377713 Apr 22 17:58:51 devstack sudo[89499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:58:51 devstack sudo[89497]: pam_unix(sudo:session): session closed for user root Apr 22 17:58:51 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-24325fa2-6b67-4a33-96eb-128791da042f tempest-CinderUnicodeTest-626251776 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-79f00ff4-090f-48f0-a81a-9434108c51d3" returned: 0 in 0.728s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:58:51 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-24325fa2-6b67-4a33-96eb-128791da042f tempest-CinderUnicodeTest-626251776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-79f00ff4-090f-48f0-a81a-9434108c51d3 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:58:51 devstack sudo[89504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-79f00ff4-090f-48f0-a81a-9434108c51d3 Apr 22 17:58:51 devstack sudo[89504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:58:51 devstack sudo[89499]: pam_unix(sudo:session): session closed for user root Apr 22 17:58:51 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-87bfe4af-e308-48e7-ae37-6e636ed4836a tempest-VolumesActionsTest-678062019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-cb25ffb4-bb91-42d9-9c2f-aa542d377713" returned: 0 in 0.583s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:58:51 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-87bfe4af-e308-48e7-ae37-6e636ed4836a tempest-VolumesActionsTest-678062019 None] <== create_volume: return (1542ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'} {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 17:58:51 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-87bfe4af-e308-48e7-ae37-6e636ed4836a tempest-VolumesActionsTest-678062019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.546s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:58:51 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-3f3fb894-c16f-44eb-986d-2b7b9a9883f7 tempest-VolumesSnapshotTestJSON-1790417655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.752s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:58:51 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-3f3fb894-c16f-44eb-986d-2b7b9a9883f7 tempest-VolumesSnapshotTestJSON-1790417655 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:58:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1971901615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73da30b2-98a3-4291-8cdb-ed2406200414,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afd9a86ddfc94168aaf00fc1e9b425f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:58:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:58:51Z,use_quota=True,user_id='e1b4ff9f921345ce968b249e8ba0c04b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)}" {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 17:58:51 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-3f3fb894-c16f-44eb-986d-2b7b9a9883f7 tempest-VolumesSnapshotTestJSON-1790417655 None] Creating volume 73da30b2-98a3-4291-8cdb-ed2406200414 {{(pid=81771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 17:58:51 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-3f3fb894-c16f-44eb-986d-2b7b9a9883f7 tempest-VolumesSnapshotTestJSON-1790417655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:58:51 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-3f3fb894-c16f-44eb-986d-2b7b9a9883f7 tempest-VolumesSnapshotTestJSON-1790417655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:58:51 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-3f3fb894-c16f-44eb-986d-2b7b9a9883f7 tempest-VolumesSnapshotTestJSON-1790417655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:58:51 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-3f3fb894-c16f-44eb-986d-2b7b9a9883f7 tempest-VolumesSnapshotTestJSON-1790417655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:58:51 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-3f3fb894-c16f-44eb-986d-2b7b9a9883f7 tempest-VolumesSnapshotTestJSON-1790417655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:58:51 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-3f3fb894-c16f-44eb-986d-2b7b9a9883f7 tempest-VolumesSnapshotTestJSON-1790417655 None] Selected osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 as target Quobyte volume. {{(pid=81771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 17:58:51 devstack cinder-volume[81771]: INFO cinder.volume.drivers.remotefs [None req-3f3fb894-c16f-44eb-986d-2b7b9a9883f7 tempest-VolumesSnapshotTestJSON-1790417655 None] casted to osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 Apr 22 17:58:51 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-3f3fb894-c16f-44eb-986d-2b7b9a9883f7 tempest-VolumesSnapshotTestJSON-1790417655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-73da30b2-98a3-4291-8cdb-ed2406200414 1073741824 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:58:51 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-87bfe4af-e308-48e7-ae37-6e636ed4836a tempest-VolumesActionsTest-678062019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47594171-216a-44ab-ad23-65c688b4c7c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb25ffb4-bb91-42d9-9c2f-aa542d377713', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:58:51 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-87bfe4af-e308-48e7-ae37-6e636ed4836a tempest-VolumesActionsTest-678062019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a06e0e3d-397a-45f2-9aed-b20098fed9db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:58:51 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-87bfe4af-e308-48e7-ae37-6e636ed4836a tempest-VolumesActionsTest-678062019 None] Volume volume-cb25ffb4-bb91-42d9-9c2f-aa542d377713 (cb25ffb4-bb91-42d9-9c2f-aa542d377713): created successfully Apr 22 17:58:51 devstack sudo[89507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-73da30b2-98a3-4291-8cdb-ed2406200414 1073741824 Apr 22 17:58:51 devstack sudo[89507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:58:51 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-87bfe4af-e308-48e7-ae37-6e636ed4836a tempest-VolumesActionsTest-678062019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a06e0e3d-397a-45f2-9aed-b20098fed9db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:58:51 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-87bfe4af-e308-48e7-ae37-6e636ed4836a tempest-VolumesActionsTest-678062019 None] Flow 'volume_create_manager' (d3f456cc-c678-4d45-8228-c59434890d04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:58:51 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-87bfe4af-e308-48e7-ae37-6e636ed4836a tempest-VolumesActionsTest-678062019 None] Created volume successfully. Apr 22 17:58:51 devstack sudo[89504]: pam_unix(sudo:session): session closed for user root Apr 22 17:58:51 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-24325fa2-6b67-4a33-96eb-128791da042f tempest-CinderUnicodeTest-626251776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-79f00ff4-090f-48f0-a81a-9434108c51d3" returned: 0 in 0.462s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:58:51 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-24325fa2-6b67-4a33-96eb-128791da042f tempest-CinderUnicodeTest-626251776 None] Lock "cinder-quobyte-79f00ff4-090f-48f0-a81a-9434108c51d3" released by "delete_volume" :: held 1.263s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:58:52 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-24325fa2-6b67-4a33-96eb-128791da042f tempest-CinderUnicodeTest-626251776 None] Created reservations ['b52e06d5-37d2-4926-9a7b-e96877019349', '8194645c-eb1b-45b4-8629-e6263bcbd6be', '0913e5dd-1fbf-4336-9e27-5658a0be252c', 'd8a3c828-2ef9-41e2-8319-f67fbd4f5548'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 17:58:52 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-24325fa2-6b67-4a33-96eb-128791da042f tempest-CinderUnicodeTest-626251776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:58:52 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-24325fa2-6b67-4a33-96eb-128791da042f tempest-CinderUnicodeTest-626251776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:58:52 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-24325fa2-6b67-4a33-96eb-128791da042f tempest-CinderUnicodeTest-626251776 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:58:52 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-24325fa2-6b67-4a33-96eb-128791da042f tempest-CinderUnicodeTest-626251776 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:58:52 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-24325fa2-6b67-4a33-96eb-128791da042f tempest-CinderUnicodeTest-626251776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:58:52 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-24325fa2-6b67-4a33-96eb-128791da042f tempest-CinderUnicodeTest-626251776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:58:52 devstack sudo[89510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 Apr 22 17:58:52 devstack sudo[89510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:58:52 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-1cfb5746-23d9-4455-8db7-f0521e79ca52 tempest-VolumesActionsTest-1312180831 None] Acquiring lock "cinder-cb25ffb4-bb91-42d9-9c2f-aa542d377713-delete_volume" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:58:52 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-1cfb5746-23d9-4455-8db7-f0521e79ca52 tempest-VolumesActionsTest-1312180831 None] Lock "cinder-cb25ffb4-bb91-42d9-9c2f-aa542d377713-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:58:52 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-1cfb5746-23d9-4455-8db7-f0521e79ca52 tempest-VolumesActionsTest-1312180831 None] Acquiring lock "cinder-quobyte-cb25ffb4-bb91-42d9-9c2f-aa542d377713" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:58:52 devstack sudo[89507]: pam_unix(sudo:session): session closed for user root Apr 22 17:58:52 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-3f3fb894-c16f-44eb-986d-2b7b9a9883f7 tempest-VolumesSnapshotTestJSON-1790417655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-73da30b2-98a3-4291-8cdb-ed2406200414 1073741824" returned: 0 in 0.953s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:58:52 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-1cfb5746-23d9-4455-8db7-f0521e79ca52 tempest-VolumesActionsTest-1312180831 None] Lock "cinder-quobyte-cb25ffb4-bb91-42d9-9c2f-aa542d377713" acquired by "delete_volume" :: waited 0.030s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:58:52 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca2271dc-f81b-4749-829b-2f75a73fe4f6]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:58:52 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-1cfb5746-23d9-4455-8db7-f0521e79ca52 tempest-VolumesActionsTest-1312180831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-cb25ffb4-bb91-42d9-9c2f-aa542d377713 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:58:52 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-3f3fb894-c16f-44eb-986d-2b7b9a9883f7 tempest-VolumesSnapshotTestJSON-1790417655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-73da30b2-98a3-4291-8cdb-ed2406200414 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:58:52 devstack sudo[89517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-73da30b2-98a3-4291-8cdb-ed2406200414 Apr 22 17:58:52 devstack sudo[89517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:58:52 devstack sudo[89515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-cb25ffb4-bb91-42d9-9c2f-aa542d377713 Apr 22 17:58:52 devstack sudo[89515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:58:52 devstack sudo[89510]: pam_unix(sudo:session): session closed for user root Apr 22 17:58:52 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-24325fa2-6b67-4a33-96eb-128791da042f tempest-CinderUnicodeTest-626251776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33" returned: 0 in 0.854s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:58:52 devstack cinder-volume[81771]: DEBUG cinder.manager [None req-24325fa2-6b67-4a33-96eb-128791da042f tempest-CinderUnicodeTest-626251776 None] Notifying Schedulers of capabilities ... {{(pid=81771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 17:58:52 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-24325fa2-6b67-4a33-96eb-128791da042f tempest-CinderUnicodeTest-626251776 None] Deleted volume successfully. Apr 22 17:58:53 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-e3acb11c-738e-4fe3-8257-31dcbfdf9ac7 tempest-CinderUnicodeTest-626251776 None] Acquiring lock "cinder-7d0c8786-b392-476c-899a-cbb91593b726-delete_volume" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:58:53 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-24325fa2-6b67-4a33-96eb-128791da042f tempest-CinderUnicodeTest-626251776 None] Lock "cinder-79f00ff4-090f-48f0-a81a-9434108c51d3-delete_volume" released by "delete_volume" :: held 2.367s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:58:53 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-e3acb11c-738e-4fe3-8257-31dcbfdf9ac7 tempest-CinderUnicodeTest-626251776 None] Lock "cinder-7d0c8786-b392-476c-899a-cbb91593b726-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:58:53 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-e3acb11c-738e-4fe3-8257-31dcbfdf9ac7 tempest-CinderUnicodeTest-626251776 None] Acquiring lock "cinder-quobyte-7d0c8786-b392-476c-899a-cbb91593b726" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:58:53 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-e3acb11c-738e-4fe3-8257-31dcbfdf9ac7 tempest-CinderUnicodeTest-626251776 None] Lock "cinder-quobyte-7d0c8786-b392-476c-899a-cbb91593b726" acquired by "delete_volume" :: waited 0.016s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:58:53 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[4de220d2-58b1-43d2-9edb-4b2d0efdcd52]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:58:53 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-e3acb11c-738e-4fe3-8257-31dcbfdf9ac7 tempest-CinderUnicodeTest-626251776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7d0c8786-b392-476c-899a-cbb91593b726 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:58:53 devstack sudo[89520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7d0c8786-b392-476c-899a-cbb91593b726 Apr 22 17:58:53 devstack sudo[89520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:58:53 devstack sudo[89517]: pam_unix(sudo:session): session closed for user root Apr 22 17:58:53 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-3f3fb894-c16f-44eb-986d-2b7b9a9883f7 tempest-VolumesSnapshotTestJSON-1790417655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-73da30b2-98a3-4291-8cdb-ed2406200414" returned: 0 in 0.665s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:58:53 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-3f3fb894-c16f-44eb-986d-2b7b9a9883f7 tempest-VolumesSnapshotTestJSON-1790417655 None] <== create_volume: return (1725ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'} {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 17:58:53 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-3f3fb894-c16f-44eb-986d-2b7b9a9883f7 tempest-VolumesSnapshotTestJSON-1790417655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.735s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:58:53 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-3f3fb894-c16f-44eb-986d-2b7b9a9883f7 tempest-VolumesSnapshotTestJSON-1790417655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cd69e98-bba1-494a-85b8-a41a577a2274) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73da30b2-98a3-4291-8cdb-ed2406200414', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:58:53 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-3f3fb894-c16f-44eb-986d-2b7b9a9883f7 tempest-VolumesSnapshotTestJSON-1790417655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f7b1cd0-becc-4101-9baf-61a729862c8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:58:53 devstack sudo[89515]: pam_unix(sudo:session): session closed for user root Apr 22 17:58:53 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-3f3fb894-c16f-44eb-986d-2b7b9a9883f7 tempest-VolumesSnapshotTestJSON-1790417655 None] Volume volume-73da30b2-98a3-4291-8cdb-ed2406200414 (73da30b2-98a3-4291-8cdb-ed2406200414): created successfully Apr 22 17:58:53 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-3f3fb894-c16f-44eb-986d-2b7b9a9883f7 tempest-VolumesSnapshotTestJSON-1790417655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f7b1cd0-becc-4101-9baf-61a729862c8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:58:53 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-3f3fb894-c16f-44eb-986d-2b7b9a9883f7 tempest-VolumesSnapshotTestJSON-1790417655 None] Flow 'volume_create_manager' (8d65e2c2-dd09-498c-ace4-88da87b4c317) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:58:53 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-1cfb5746-23d9-4455-8db7-f0521e79ca52 tempest-VolumesActionsTest-1312180831 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-cb25ffb4-bb91-42d9-9c2f-aa542d377713" returned: 0 in 0.783s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:58:53 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-1cfb5746-23d9-4455-8db7-f0521e79ca52 tempest-VolumesActionsTest-1312180831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-cb25ffb4-bb91-42d9-9c2f-aa542d377713 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:58:53 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-3f3fb894-c16f-44eb-986d-2b7b9a9883f7 tempest-VolumesSnapshotTestJSON-1790417655 None] Created volume successfully. Apr 22 17:58:53 devstack sudo[89526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-cb25ffb4-bb91-42d9-9c2f-aa542d377713 Apr 22 17:58:53 devstack sudo[89526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:58:53 devstack sudo[89520]: pam_unix(sudo:session): session closed for user root Apr 22 17:58:53 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-e3acb11c-738e-4fe3-8257-31dcbfdf9ac7 tempest-CinderUnicodeTest-626251776 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7d0c8786-b392-476c-899a-cbb91593b726" returned: 0 in 0.632s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:58:53 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-e3acb11c-738e-4fe3-8257-31dcbfdf9ac7 tempest-CinderUnicodeTest-626251776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7d0c8786-b392-476c-899a-cbb91593b726 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:58:53 devstack sudo[89531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7d0c8786-b392-476c-899a-cbb91593b726 Apr 22 17:58:53 devstack sudo[89531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:58:54 devstack sudo[89526]: pam_unix(sudo:session): session closed for user root Apr 22 17:58:54 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-1cfb5746-23d9-4455-8db7-f0521e79ca52 tempest-VolumesActionsTest-1312180831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-cb25ffb4-bb91-42d9-9c2f-aa542d377713" returned: 0 in 0.562s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:58:54 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-1cfb5746-23d9-4455-8db7-f0521e79ca52 tempest-VolumesActionsTest-1312180831 None] Lock "cinder-quobyte-cb25ffb4-bb91-42d9-9c2f-aa542d377713" released by "delete_volume" :: held 1.408s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:58:54 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-1cfb5746-23d9-4455-8db7-f0521e79ca52 tempest-VolumesActionsTest-1312180831 None] Created reservations ['4f3103c7-b457-4680-a25c-c795cb4c47f3', '30be3fdd-68b7-4663-a1fd-62a13832bd96', 'e088a4fb-7416-4560-a409-e7d602b2c4eb', 'd4f55e61-6af7-43f9-ae24-945422fcc08e'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 17:58:54 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-7604afa6-cfd2-47fc-a5d0-2a13dfc7bfa3 tempest-VolumesSnapshotTestJSON-1790417655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:58:54 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-7604afa6-cfd2-47fc-a5d0-2a13dfc7bfa3 tempest-VolumesSnapshotTestJSON-1790417655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:58:54 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-7604afa6-cfd2-47fc-a5d0-2a13dfc7bfa3 tempest-VolumesSnapshotTestJSON-1790417655 None] Creating offline snapshot bca44290-3254-4e40-a3b7-26b94912e195 of volume 73da30b2-98a3-4291-8cdb-ed2406200414 {{(pid=81771) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 22 17:58:54 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[5585dbd8-c0ff-4832-9f72-c942e1d8fd65]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:58:54 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-7604afa6-cfd2-47fc-a5d0-2a13dfc7bfa3 tempest-VolumesSnapshotTestJSON-1790417655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-73da30b2-98a3-4291-8cdb-ed2406200414 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:58:54 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-1cfb5746-23d9-4455-8db7-f0521e79ca52 tempest-VolumesActionsTest-1312180831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:58:54 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-1cfb5746-23d9-4455-8db7-f0521e79ca52 tempest-VolumesActionsTest-1312180831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:58:54 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-1cfb5746-23d9-4455-8db7-f0521e79ca52 tempest-VolumesActionsTest-1312180831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:58:54 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-1cfb5746-23d9-4455-8db7-f0521e79ca52 tempest-VolumesActionsTest-1312180831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:58:54 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-1cfb5746-23d9-4455-8db7-f0521e79ca52 tempest-VolumesActionsTest-1312180831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:58:54 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-1cfb5746-23d9-4455-8db7-f0521e79ca52 tempest-VolumesActionsTest-1312180831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:58:54 devstack sudo[89531]: pam_unix(sudo:session): session closed for user root Apr 22 17:58:54 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-e3acb11c-738e-4fe3-8257-31dcbfdf9ac7 tempest-CinderUnicodeTest-626251776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7d0c8786-b392-476c-899a-cbb91593b726" returned: 0 in 0.657s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:58:54 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-e3acb11c-738e-4fe3-8257-31dcbfdf9ac7 tempest-CinderUnicodeTest-626251776 None] Lock "cinder-quobyte-7d0c8786-b392-476c-899a-cbb91593b726" released by "delete_volume" :: held 1.342s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:58:54 devstack sudo[89536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 Apr 22 17:58:54 devstack sudo[89536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:58:54 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-e3acb11c-738e-4fe3-8257-31dcbfdf9ac7 tempest-CinderUnicodeTest-626251776 None] Created reservations ['047f16e9-cd9e-4059-ae38-8acf6cb045ee', '33001678-7cf9-4b45-8d93-6de6887034ba', 'f6b1b3fc-b41d-4f63-bc3c-b8d2e4ef5108', '715b6b1b-7a78-4555-9642-a133647cacac'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 17:58:54 devstack sudo[89535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-73da30b2-98a3-4291-8cdb-ed2406200414 Apr 22 17:58:54 devstack sudo[89535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:58:54 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-e3acb11c-738e-4fe3-8257-31dcbfdf9ac7 tempest-CinderUnicodeTest-626251776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:58:54 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-e3acb11c-738e-4fe3-8257-31dcbfdf9ac7 tempest-CinderUnicodeTest-626251776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:58:54 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-e3acb11c-738e-4fe3-8257-31dcbfdf9ac7 tempest-CinderUnicodeTest-626251776 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:58:54 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-e3acb11c-738e-4fe3-8257-31dcbfdf9ac7 tempest-CinderUnicodeTest-626251776 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:58:54 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-e3acb11c-738e-4fe3-8257-31dcbfdf9ac7 tempest-CinderUnicodeTest-626251776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:58:54 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-e3acb11c-738e-4fe3-8257-31dcbfdf9ac7 tempest-CinderUnicodeTest-626251776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:58:54 devstack sudo[89539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 Apr 22 17:58:54 devstack sudo[89539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:58:55 devstack sudo[89536]: pam_unix(sudo:session): session closed for user root Apr 22 17:58:55 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-1cfb5746-23d9-4455-8db7-f0521e79ca52 tempest-VolumesActionsTest-1312180831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33" returned: 0 in 0.622s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:58:55 devstack cinder-volume[81771]: DEBUG cinder.manager [None req-1cfb5746-23d9-4455-8db7-f0521e79ca52 tempest-VolumesActionsTest-1312180831 None] Notifying Schedulers of capabilities ... {{(pid=81771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 17:58:55 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-1cfb5746-23d9-4455-8db7-f0521e79ca52 tempest-VolumesActionsTest-1312180831 None] Deleted volume successfully. Apr 22 17:58:55 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-1cfb5746-23d9-4455-8db7-f0521e79ca52 tempest-VolumesActionsTest-1312180831 None] Lock "cinder-cb25ffb4-bb91-42d9-9c2f-aa542d377713-delete_volume" released by "delete_volume" :: held 2.498s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:58:55 devstack sudo[89535]: pam_unix(sudo:session): session closed for user root Apr 22 17:58:55 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-7604afa6-cfd2-47fc-a5d0-2a13dfc7bfa3 tempest-VolumesSnapshotTestJSON-1790417655 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-73da30b2-98a3-4291-8cdb-ed2406200414" returned: 0 in 0.905s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:58:55 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-7604afa6-cfd2-47fc-a5d0-2a13dfc7bfa3 tempest-VolumesSnapshotTestJSON-1790417655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-73da30b2-98a3-4291-8cdb-ed2406200414,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-73da30b2-98a3-4291-8cdb-ed2406200414.bca44290-3254-4e40-a3b7-26b94912e195 1G {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:58:55 devstack sudo[89545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-73da30b2-98a3-4291-8cdb-ed2406200414,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-73da30b2-98a3-4291-8cdb-ed2406200414.bca44290-3254-4e40-a3b7-26b94912e195 1G Apr 22 17:58:55 devstack sudo[89545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:58:55 devstack sudo[89539]: pam_unix(sudo:session): session closed for user root Apr 22 17:58:55 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-e3acb11c-738e-4fe3-8257-31dcbfdf9ac7 tempest-CinderUnicodeTest-626251776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33" returned: 0 in 0.983s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:58:55 devstack cinder-volume[81771]: DEBUG cinder.manager [None req-e3acb11c-738e-4fe3-8257-31dcbfdf9ac7 tempest-CinderUnicodeTest-626251776 None] Notifying Schedulers of capabilities ... {{(pid=81771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 17:58:55 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-e3acb11c-738e-4fe3-8257-31dcbfdf9ac7 tempest-CinderUnicodeTest-626251776 None] Deleted volume successfully. Apr 22 17:58:55 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-e3acb11c-738e-4fe3-8257-31dcbfdf9ac7 tempest-CinderUnicodeTest-626251776 None] Lock "cinder-7d0c8786-b392-476c-899a-cbb91593b726-delete_volume" released by "delete_volume" :: held 2.560s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:58:55 devstack cinder-volume[81771]: DEBUG cinder.volume.flows.manager.create_volume [None req-82e2d20a-58e1-460d-9167-64fd043288d6 tempest-VolumesActionsTest-678062019 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 17:58:55 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-82e2d20a-58e1-460d-9167-64fd043288d6 tempest-VolumesActionsTest-678062019 None] Flow 'volume_create_manager' (66897048-4686-454b-b4b2-b41a431793f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:58:55 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-82e2d20a-58e1-460d-9167-64fd043288d6 tempest-VolumesActionsTest-678062019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3aef163-aa7e-4cbe-81fb-b2e24aabc2f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:58:55 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-82e2d20a-58e1-460d-9167-64fd043288d6 tempest-VolumesActionsTest-678062019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3aef163-aa7e-4cbe-81fb-b2e24aabc2f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:58:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-995191049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd18dedb-3381-4a27-b33c-20f64b6166f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd5ed77be0ee418cb4f7816bd70e7b2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:58:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:58:56Z,use_quota=True,user_id='fa7c9a3bff17449bb4b6fcd3fa13fb1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:58:55 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-82e2d20a-58e1-460d-9167-64fd043288d6 tempest-VolumesActionsTest-678062019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (642df419-dfa1-4a39-a035-a2c5b67166a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:58:55 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-82e2d20a-58e1-460d-9167-64fd043288d6 tempest-VolumesActionsTest-678062019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (642df419-dfa1-4a39-a035-a2c5b67166a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:58:55 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-82e2d20a-58e1-460d-9167-64fd043288d6 tempest-VolumesActionsTest-678062019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8e03a53-82d8-4423-9c4c-b603e074f002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:58:55 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-82e2d20a-58e1-460d-9167-64fd043288d6 tempest-VolumesActionsTest-678062019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8e03a53-82d8-4423-9c4c-b603e074f002) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd18dedb-3381-4a27-b33c-20f64b6166f6', 'volume_name': 'volume-fd18dedb-3381-4a27-b33c-20f64b6166f6', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:58:55 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-82e2d20a-58e1-460d-9167-64fd043288d6 tempest-VolumesActionsTest-678062019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1d0d75e-9f33-4012-bf19-c61f2f16452c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:58:55 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-82e2d20a-58e1-460d-9167-64fd043288d6 tempest-VolumesActionsTest-678062019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1d0d75e-9f33-4012-bf19-c61f2f16452c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:58:55 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-82e2d20a-58e1-460d-9167-64fd043288d6 tempest-VolumesActionsTest-678062019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67cceaf4-56b4-4c28-aeef-0227ba72d7b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:58:55 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-82e2d20a-58e1-460d-9167-64fd043288d6 tempest-VolumesActionsTest-678062019 None] Volume fd18dedb-3381-4a27-b33c-20f64b6166f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd18dedb-3381-4a27-b33c-20f64b6166f6', 'volume_size': 1} Apr 22 17:58:55 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-82e2d20a-58e1-460d-9167-64fd043288d6 tempest-VolumesActionsTest-678062019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:58:56 devstack sudo[89545]: pam_unix(sudo:session): session closed for user root Apr 22 17:58:56 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-7604afa6-cfd2-47fc-a5d0-2a13dfc7bfa3 tempest-VolumesSnapshotTestJSON-1790417655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-73da30b2-98a3-4291-8cdb-ed2406200414,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-73da30b2-98a3-4291-8cdb-ed2406200414.bca44290-3254-4e40-a3b7-26b94912e195 1G" returned: 0 in 0.798s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:58:56 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-7604afa6-cfd2-47fc-a5d0-2a13dfc7bfa3 tempest-VolumesSnapshotTestJSON-1790417655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73da30b2-98a3-4291-8cdb-ed2406200414 -F qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-73da30b2-98a3-4291-8cdb-ed2406200414.bca44290-3254-4e40-a3b7-26b94912e195 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:58:56 devstack sudo[89551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73da30b2-98a3-4291-8cdb-ed2406200414 -F qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-73da30b2-98a3-4291-8cdb-ed2406200414.bca44290-3254-4e40-a3b7-26b94912e195 Apr 22 17:58:56 devstack sudo[89551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:58:56 devstack sudo[89551]: pam_unix(sudo:session): session closed for user root Apr 22 17:58:56 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-7604afa6-cfd2-47fc-a5d0-2a13dfc7bfa3 tempest-VolumesSnapshotTestJSON-1790417655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73da30b2-98a3-4291-8cdb-ed2406200414 -F qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-73da30b2-98a3-4291-8cdb-ed2406200414.bca44290-3254-4e40-a3b7-26b94912e195" returned: 0 in 0.627s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:58:56 devstack cinder-volume[81771]: WARNING cinder.volume.drivers.remotefs [None req-7604afa6-cfd2-47fc-a5d0-2a13dfc7bfa3 tempest-VolumesSnapshotTestJSON-1790417655 None] /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-73da30b2-98a3-4291-8cdb-ed2406200414.bca44290-3254-4e40-a3b7-26b94912e195 is being set with open permissions: ugo+rw Apr 22 17:58:56 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-7604afa6-cfd2-47fc-a5d0-2a13dfc7bfa3 tempest-VolumesSnapshotTestJSON-1790417655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-73da30b2-98a3-4291-8cdb-ed2406200414.bca44290-3254-4e40-a3b7-26b94912e195 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:58:56 devstack sudo[89556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-73da30b2-98a3-4291-8cdb-ed2406200414.bca44290-3254-4e40-a3b7-26b94912e195 Apr 22 17:58:56 devstack sudo[89556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:58:57 devstack sudo[89556]: pam_unix(sudo:session): session closed for user root Apr 22 17:58:57 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-7604afa6-cfd2-47fc-a5d0-2a13dfc7bfa3 tempest-VolumesSnapshotTestJSON-1790417655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-73da30b2-98a3-4291-8cdb-ed2406200414.bca44290-3254-4e40-a3b7-26b94912e195" returned: 0 in 0.544s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:58:57 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-7604afa6-cfd2-47fc-a5d0-2a13dfc7bfa3 tempest-VolumesSnapshotTestJSON-1790417655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-73da30b2-98a3-4291-8cdb-ed2406200414.info {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:58:57 devstack sudo[89560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-73da30b2-98a3-4291-8cdb-ed2406200414.info Apr 22 17:58:57 devstack sudo[89560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:58:57 devstack sudo[89560]: pam_unix(sudo:session): session closed for user root Apr 22 17:58:57 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-7604afa6-cfd2-47fc-a5d0-2a13dfc7bfa3 tempest-VolumesSnapshotTestJSON-1790417655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-73da30b2-98a3-4291-8cdb-ed2406200414.info" returned: 0 in 0.545s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:58:57 devstack cinder-volume[81771]: WARNING cinder.volume.drivers.remotefs [None req-7604afa6-cfd2-47fc-a5d0-2a13dfc7bfa3 tempest-VolumesSnapshotTestJSON-1790417655 None] /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-73da30b2-98a3-4291-8cdb-ed2406200414.info is being set with open permissions: ugo+rw Apr 22 17:58:57 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-7604afa6-cfd2-47fc-a5d0-2a13dfc7bfa3 tempest-VolumesSnapshotTestJSON-1790417655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-73da30b2-98a3-4291-8cdb-ed2406200414.info {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:58:57 devstack sudo[89563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-73da30b2-98a3-4291-8cdb-ed2406200414.info Apr 22 17:58:57 devstack sudo[89563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:58:58 devstack sudo[89563]: pam_unix(sudo:session): session closed for user root Apr 22 17:58:58 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-7604afa6-cfd2-47fc-a5d0-2a13dfc7bfa3 tempest-VolumesSnapshotTestJSON-1790417655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-73da30b2-98a3-4291-8cdb-ed2406200414.info" returned: 0 in 0.721s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:58:58 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-7604afa6-cfd2-47fc-a5d0-2a13dfc7bfa3 tempest-VolumesSnapshotTestJSON-1790417655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.264s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:58:58 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-82e2d20a-58e1-460d-9167-64fd043288d6 tempest-VolumesActionsTest-678062019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.836s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:58:58 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-82e2d20a-58e1-460d-9167-64fd043288d6 tempest-VolumesActionsTest-678062019 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:58:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-995191049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd18dedb-3381-4a27-b33c-20f64b6166f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd5ed77be0ee418cb4f7816bd70e7b2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:58:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:58:56Z,use_quota=True,user_id='fa7c9a3bff17449bb4b6fcd3fa13fb1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)}" {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 17:58:58 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-82e2d20a-58e1-460d-9167-64fd043288d6 tempest-VolumesActionsTest-678062019 None] Creating volume fd18dedb-3381-4a27-b33c-20f64b6166f6 {{(pid=81771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 17:58:58 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-82e2d20a-58e1-460d-9167-64fd043288d6 tempest-VolumesActionsTest-678062019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:58:58 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-82e2d20a-58e1-460d-9167-64fd043288d6 tempest-VolumesActionsTest-678062019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:58:58 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-82e2d20a-58e1-460d-9167-64fd043288d6 tempest-VolumesActionsTest-678062019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:58:58 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-82e2d20a-58e1-460d-9167-64fd043288d6 tempest-VolumesActionsTest-678062019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:58:58 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-82e2d20a-58e1-460d-9167-64fd043288d6 tempest-VolumesActionsTest-678062019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:58:58 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-82e2d20a-58e1-460d-9167-64fd043288d6 tempest-VolumesActionsTest-678062019 None] Selected osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 as target Quobyte volume. {{(pid=81771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 17:58:58 devstack cinder-volume[81771]: INFO cinder.volume.drivers.remotefs [None req-82e2d20a-58e1-460d-9167-64fd043288d6 tempest-VolumesActionsTest-678062019 None] casted to osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 Apr 22 17:58:58 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-82e2d20a-58e1-460d-9167-64fd043288d6 tempest-VolumesActionsTest-678062019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-fd18dedb-3381-4a27-b33c-20f64b6166f6 1073741824 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:58:58 devstack cinder-volume[81771]: DEBUG dbcounter [-] [81771] Writing DB stats cinder:UPDATE=159,cinder:SELECT=136,cinder:INSERT=39,cinder:DELETE=12 {{(pid=81771) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 22 17:58:58 devstack sudo[89600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-fd18dedb-3381-4a27-b33c-20f64b6166f6 1073741824 Apr 22 17:58:58 devstack sudo[89600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:58:58 devstack cinder-volume[81771]: DEBUG dbcounter [-] [81771] Writing DB stats cinder:SELECT=132,cinder:INSERT=42,cinder:UPDATE=160,cinder:DELETE=13 {{(pid=81771) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 22 17:58:58 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-7604afa6-cfd2-47fc-a5d0-2a13dfc7bfa3 tempest-VolumesSnapshotTestJSON-1790417655 None] Create snapshot completed successfully Apr 22 17:58:59 devstack cinder-volume[81771]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d733892-9d23-4293-b1e1-a42377bc2a25 tempest-SnapshotDependencyTests-1971789782 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 17:58:59 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-8d733892-9d23-4293-b1e1-a42377bc2a25 tempest-SnapshotDependencyTests-1971789782 None] Flow 'volume_create_manager' (b19f646a-6a0a-49d7-aab2-50bcc4517560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:58:59 devstack sudo[89600]: pam_unix(sudo:session): session closed for user root Apr 22 17:58:59 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-8d733892-9d23-4293-b1e1-a42377bc2a25 tempest-SnapshotDependencyTests-1971789782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebaabaa9-5600-4f21-b58e-9f1724b76078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:58:59 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-82e2d20a-58e1-460d-9167-64fd043288d6 tempest-VolumesActionsTest-678062019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-fd18dedb-3381-4a27-b33c-20f64b6166f6 1073741824" returned: 0 in 0.696s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:58:59 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-8d733892-9d23-4293-b1e1-a42377bc2a25 tempest-SnapshotDependencyTests-1971789782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebaabaa9-5600-4f21-b58e-9f1724b76078) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:58:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1574006375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45a0be4d-13a9-4fca-8c04-36014a3f3020,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c970114d0bb4a368ac5dc22ce955bcb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:58:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:58:59Z,use_quota=True,user_id='5e315d82d6f54bdab03605201c712c9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:58:59 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-8d733892-9d23-4293-b1e1-a42377bc2a25 tempest-SnapshotDependencyTests-1971789782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3d63832-8826-4947-8ba2-5896fa52d5e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:58:59 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-8d733892-9d23-4293-b1e1-a42377bc2a25 tempest-SnapshotDependencyTests-1971789782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3d63832-8826-4947-8ba2-5896fa52d5e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:58:59 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-8d733892-9d23-4293-b1e1-a42377bc2a25 tempest-SnapshotDependencyTests-1971789782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75588f4f-3646-41fe-b496-ef78dc960795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:58:59 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-8d733892-9d23-4293-b1e1-a42377bc2a25 tempest-SnapshotDependencyTests-1971789782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75588f4f-3646-41fe-b496-ef78dc960795) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45a0be4d-13a9-4fca-8c04-36014a3f3020', 'volume_name': 'volume-45a0be4d-13a9-4fca-8c04-36014a3f3020', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:58:59 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-8d733892-9d23-4293-b1e1-a42377bc2a25 tempest-SnapshotDependencyTests-1971789782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59fb7e92-9eff-4125-a8d2-a6aeeeb40ee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:58:59 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-8d733892-9d23-4293-b1e1-a42377bc2a25 tempest-SnapshotDependencyTests-1971789782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59fb7e92-9eff-4125-a8d2-a6aeeeb40ee8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:58:59 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-8d733892-9d23-4293-b1e1-a42377bc2a25 tempest-SnapshotDependencyTests-1971789782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afbd65bb-b305-4152-bd63-fd3c980589f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:58:59 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-8d733892-9d23-4293-b1e1-a42377bc2a25 tempest-SnapshotDependencyTests-1971789782 None] Volume 45a0be4d-13a9-4fca-8c04-36014a3f3020: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45a0be4d-13a9-4fca-8c04-36014a3f3020', 'volume_size': 1} Apr 22 17:58:59 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-8d733892-9d23-4293-b1e1-a42377bc2a25 tempest-SnapshotDependencyTests-1971789782 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:58:59 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-82e2d20a-58e1-460d-9167-64fd043288d6 tempest-VolumesActionsTest-678062019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-fd18dedb-3381-4a27-b33c-20f64b6166f6 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:58:59 devstack sudo[89605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-fd18dedb-3381-4a27-b33c-20f64b6166f6 Apr 22 17:58:59 devstack sudo[89605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:58:59 devstack cinder-volume[81771]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ae1f722-d56d-4026-b394-ec03991c1ed5 tempest-VolumesSnapshotTestJSON-1790417655 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 17:58:59 devstack sudo[89605]: pam_unix(sudo:session): session closed for user root Apr 22 17:58:59 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-82e2d20a-58e1-460d-9167-64fd043288d6 tempest-VolumesActionsTest-678062019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-fd18dedb-3381-4a27-b33c-20f64b6166f6" returned: 0 in 0.525s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:58:59 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-82e2d20a-58e1-460d-9167-64fd043288d6 tempest-VolumesActionsTest-678062019 None] <== create_volume: return (1292ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'} {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 17:58:59 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-82e2d20a-58e1-460d-9167-64fd043288d6 tempest-VolumesActionsTest-678062019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.296s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:58:59 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-8d733892-9d23-4293-b1e1-a42377bc2a25 tempest-SnapshotDependencyTests-1971789782 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.549s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:58:59 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-8d733892-9d23-4293-b1e1-a42377bc2a25 tempest-SnapshotDependencyTests-1971789782 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:58:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1574006375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45a0be4d-13a9-4fca-8c04-36014a3f3020,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c970114d0bb4a368ac5dc22ce955bcb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:58:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:58:59Z,use_quota=True,user_id='5e315d82d6f54bdab03605201c712c9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)}" {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 17:58:59 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-8d733892-9d23-4293-b1e1-a42377bc2a25 tempest-SnapshotDependencyTests-1971789782 None] Creating volume 45a0be4d-13a9-4fca-8c04-36014a3f3020 {{(pid=81771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 17:58:59 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-8d733892-9d23-4293-b1e1-a42377bc2a25 tempest-SnapshotDependencyTests-1971789782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:58:59 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-8d733892-9d23-4293-b1e1-a42377bc2a25 tempest-SnapshotDependencyTests-1971789782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:58:59 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-8d733892-9d23-4293-b1e1-a42377bc2a25 tempest-SnapshotDependencyTests-1971789782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:58:59 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-8d733892-9d23-4293-b1e1-a42377bc2a25 tempest-SnapshotDependencyTests-1971789782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:58:59 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-8d733892-9d23-4293-b1e1-a42377bc2a25 tempest-SnapshotDependencyTests-1971789782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:58:59 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-8d733892-9d23-4293-b1e1-a42377bc2a25 tempest-SnapshotDependencyTests-1971789782 None] Selected osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 as target Quobyte volume. {{(pid=81771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 17:58:59 devstack cinder-volume[81771]: INFO cinder.volume.drivers.remotefs [None req-8d733892-9d23-4293-b1e1-a42377bc2a25 tempest-SnapshotDependencyTests-1971789782 None] casted to osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 Apr 22 17:58:59 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-8d733892-9d23-4293-b1e1-a42377bc2a25 tempest-SnapshotDependencyTests-1971789782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-45a0be4d-13a9-4fca-8c04-36014a3f3020 1073741824 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:58:59 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-82e2d20a-58e1-460d-9167-64fd043288d6 tempest-VolumesActionsTest-678062019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67cceaf4-56b4-4c28-aeef-0227ba72d7b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd18dedb-3381-4a27-b33c-20f64b6166f6', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:58:59 devstack sudo[89608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-45a0be4d-13a9-4fca-8c04-36014a3f3020 1073741824 Apr 22 17:58:59 devstack sudo[89608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:58:59 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-82e2d20a-58e1-460d-9167-64fd043288d6 tempest-VolumesActionsTest-678062019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52ccb94e-a8cc-4f1d-9572-1a3315d0ddc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:58:59 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-0ae1f722-d56d-4026-b394-ec03991c1ed5 tempest-VolumesSnapshotTestJSON-1790417655 None] Flow 'volume_create_manager' (e4c413ae-67b7-4ba8-a18e-aee2de075b35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:58:59 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-0ae1f722-d56d-4026-b394-ec03991c1ed5 tempest-VolumesSnapshotTestJSON-1790417655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (370ee712-4471-4c99-84e0-72a47e33789b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:58:59 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-82e2d20a-58e1-460d-9167-64fd043288d6 tempest-VolumesActionsTest-678062019 None] Volume volume-fd18dedb-3381-4a27-b33c-20f64b6166f6 (fd18dedb-3381-4a27-b33c-20f64b6166f6): created successfully Apr 22 17:58:59 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-82e2d20a-58e1-460d-9167-64fd043288d6 tempest-VolumesActionsTest-678062019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52ccb94e-a8cc-4f1d-9572-1a3315d0ddc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:58:59 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-82e2d20a-58e1-460d-9167-64fd043288d6 tempest-VolumesActionsTest-678062019 None] Flow 'volume_create_manager' (66897048-4686-454b-b4b2-b41a431793f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:58:59 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-0ae1f722-d56d-4026-b394-ec03991c1ed5 tempest-VolumesSnapshotTestJSON-1790417655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (370ee712-4471-4c99-84e0-72a47e33789b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:59:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1091080335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b4d3cfe-c041-453d-be45-46de837e41e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afd9a86ddfc94168aaf00fc1e9b425f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:59:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=bca44290-3254-4e40-a3b7-26b94912e195,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:59:00Z,use_quota=True,user_id='e1b4ff9f921345ce968b249e8ba0c04b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:58:59 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-0ae1f722-d56d-4026-b394-ec03991c1ed5 tempest-VolumesSnapshotTestJSON-1790417655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34a845bf-30e8-4a7d-8a30-e842869d0c06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:58:59 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-0ae1f722-d56d-4026-b394-ec03991c1ed5 tempest-VolumesSnapshotTestJSON-1790417655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34a845bf-30e8-4a7d-8a30-e842869d0c06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:58:59 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-0ae1f722-d56d-4026-b394-ec03991c1ed5 tempest-VolumesSnapshotTestJSON-1790417655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e98f487-d54f-4ff6-b8d0-2878d320292b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:58:59 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-0ae1f722-d56d-4026-b394-ec03991c1ed5 tempest-VolumesSnapshotTestJSON-1790417655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e98f487-d54f-4ff6-b8d0-2878d320292b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1b4d3cfe-c041-453d-be45-46de837e41e7', 'volume_name': 'volume-1b4d3cfe-c041-453d-be45-46de837e41e7', 'volume_size': 1, 'snapshot_id': 'bca44290-3254-4e40-a3b7-26b94912e195'}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:58:59 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-0ae1f722-d56d-4026-b394-ec03991c1ed5 tempest-VolumesSnapshotTestJSON-1790417655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3d7c30e-6406-4a1c-82e9-b204da705463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:58:59 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-0ae1f722-d56d-4026-b394-ec03991c1ed5 tempest-VolumesSnapshotTestJSON-1790417655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3d7c30e-6406-4a1c-82e9-b204da705463) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:58:59 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-0ae1f722-d56d-4026-b394-ec03991c1ed5 tempest-VolumesSnapshotTestJSON-1790417655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa227f2e-2c95-4ea7-992d-989eb2209688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:58:59 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-0ae1f722-d56d-4026-b394-ec03991c1ed5 tempest-VolumesSnapshotTestJSON-1790417655 None] Volume 1b4d3cfe-c041-453d-be45-46de837e41e7: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1b4d3cfe-c041-453d-be45-46de837e41e7', 'volume_size': 1, 'snapshot_id': 'bca44290-3254-4e40-a3b7-26b94912e195'} Apr 22 17:58:59 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-0ae1f722-d56d-4026-b394-ec03991c1ed5 tempest-VolumesSnapshotTestJSON-1790417655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:58:59 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-82e2d20a-58e1-460d-9167-64fd043288d6 tempest-VolumesActionsTest-678062019 None] Created volume successfully. Apr 22 17:59:00 devstack sudo[89608]: pam_unix(sudo:session): session closed for user root Apr 22 17:59:00 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-8d733892-9d23-4293-b1e1-a42377bc2a25 tempest-SnapshotDependencyTests-1971789782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-45a0be4d-13a9-4fca-8c04-36014a3f3020 1073741824" returned: 0 in 0.640s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:59:00 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-8d733892-9d23-4293-b1e1-a42377bc2a25 tempest-SnapshotDependencyTests-1971789782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-45a0be4d-13a9-4fca-8c04-36014a3f3020 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:59:00 devstack sudo[89614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-45a0be4d-13a9-4fca-8c04-36014a3f3020 Apr 22 17:59:00 devstack sudo[89614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:59:01 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-b2515047-b3d4-4dba-976b-ae4c94250755 tempest-VolumesActionsTest-1312180831 None] Acquiring lock "cinder-fd18dedb-3381-4a27-b33c-20f64b6166f6-delete_volume" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:59:01 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-b2515047-b3d4-4dba-976b-ae4c94250755 tempest-VolumesActionsTest-1312180831 None] Lock "cinder-fd18dedb-3381-4a27-b33c-20f64b6166f6-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:59:01 devstack sudo[89614]: pam_unix(sudo:session): session closed for user root Apr 22 17:59:01 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-8d733892-9d23-4293-b1e1-a42377bc2a25 tempest-SnapshotDependencyTests-1971789782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-45a0be4d-13a9-4fca-8c04-36014a3f3020" returned: 0 in 0.518s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:59:01 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-8d733892-9d23-4293-b1e1-a42377bc2a25 tempest-SnapshotDependencyTests-1971789782 None] <== create_volume: return (1199ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'} {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 17:59:01 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-8d733892-9d23-4293-b1e1-a42377bc2a25 tempest-SnapshotDependencyTests-1971789782 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.203s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:59:01 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-0ae1f722-d56d-4026-b394-ec03991c1ed5 tempest-VolumesSnapshotTestJSON-1790417655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.080s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:59:01 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-0ae1f722-d56d-4026-b394-ec03991c1ed5 tempest-VolumesSnapshotTestJSON-1790417655 None] Acquiring lock "cinder-quobyte-bca44290-3254-4e40-a3b7-26b94912e195-1b4d3cfe-c041-453d-be45-46de837e41e7" by "_create_volume_from_snapshot" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:59:01 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-8d733892-9d23-4293-b1e1-a42377bc2a25 tempest-SnapshotDependencyTests-1971789782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afbd65bb-b305-4152-bd63-fd3c980589f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45a0be4d-13a9-4fca-8c04-36014a3f3020', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:59:01 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-8d733892-9d23-4293-b1e1-a42377bc2a25 tempest-SnapshotDependencyTests-1971789782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ed492fb-70d6-42b2-a20d-b34cd7071692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:59:01 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-b2515047-b3d4-4dba-976b-ae4c94250755 tempest-VolumesActionsTest-1312180831 None] Acquiring lock "cinder-quobyte-fd18dedb-3381-4a27-b33c-20f64b6166f6" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:59:01 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-8d733892-9d23-4293-b1e1-a42377bc2a25 tempest-SnapshotDependencyTests-1971789782 None] Volume volume-45a0be4d-13a9-4fca-8c04-36014a3f3020 (45a0be4d-13a9-4fca-8c04-36014a3f3020): created successfully Apr 22 17:59:01 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-8d733892-9d23-4293-b1e1-a42377bc2a25 tempest-SnapshotDependencyTests-1971789782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ed492fb-70d6-42b2-a20d-b34cd7071692) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:59:01 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-8d733892-9d23-4293-b1e1-a42377bc2a25 tempest-SnapshotDependencyTests-1971789782 None] Flow 'volume_create_manager' (b19f646a-6a0a-49d7-aab2-50bcc4517560) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:59:01 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-0ae1f722-d56d-4026-b394-ec03991c1ed5 tempest-VolumesSnapshotTestJSON-1790417655 None] Lock "cinder-quobyte-bca44290-3254-4e40-a3b7-26b94912e195-1b4d3cfe-c041-453d-be45-46de837e41e7" acquired by "_create_volume_from_snapshot" :: waited 0.071s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:59:01 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-0ae1f722-d56d-4026-b394-ec03991c1ed5 tempest-VolumesSnapshotTestJSON-1790417655 None] Creating volume 1b4d3cfe-c041-453d-be45-46de837e41e7 from snapshot bca44290-3254-4e40-a3b7-26b94912e195 {{(pid=81771) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 22 17:59:01 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-0ae1f722-d56d-4026-b394-ec03991c1ed5 tempest-VolumesSnapshotTestJSON-1790417655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:59:01 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-0ae1f722-d56d-4026-b394-ec03991c1ed5 tempest-VolumesSnapshotTestJSON-1790417655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:59:01 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-0ae1f722-d56d-4026-b394-ec03991c1ed5 tempest-VolumesSnapshotTestJSON-1790417655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:59:01 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-0ae1f722-d56d-4026-b394-ec03991c1ed5 tempest-VolumesSnapshotTestJSON-1790417655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:59:01 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-0ae1f722-d56d-4026-b394-ec03991c1ed5 tempest-VolumesSnapshotTestJSON-1790417655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:59:01 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-0ae1f722-d56d-4026-b394-ec03991c1ed5 tempest-VolumesSnapshotTestJSON-1790417655 None] Selected osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 as target Quobyte volume. {{(pid=81771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 17:59:01 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-0ae1f722-d56d-4026-b394-ec03991c1ed5 tempest-VolumesSnapshotTestJSON-1790417655 None] Acquiring lock "cinder-quobyte-1b4d3cfe-c041-453d-be45-46de837e41e7" by "_copy_volume_from_snapshot" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:59:01 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-8d733892-9d23-4293-b1e1-a42377bc2a25 tempest-SnapshotDependencyTests-1971789782 None] Created volume successfully. Apr 22 17:59:01 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-b2515047-b3d4-4dba-976b-ae4c94250755 tempest-VolumesActionsTest-1312180831 None] Lock "cinder-quobyte-fd18dedb-3381-4a27-b33c-20f64b6166f6" acquired by "delete_volume" :: waited 0.061s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:59:01 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[56b44491-c989-46f3-ad21-b2e1945f0aee]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:59:01 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-b2515047-b3d4-4dba-976b-ae4c94250755 tempest-VolumesActionsTest-1312180831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-fd18dedb-3381-4a27-b33c-20f64b6166f6 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:59:01 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-0ae1f722-d56d-4026-b394-ec03991c1ed5 tempest-VolumesSnapshotTestJSON-1790417655 None] Lock "cinder-quobyte-1b4d3cfe-c041-453d-be45-46de837e41e7" acquired by "_copy_volume_from_snapshot" :: waited 0.060s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:59:01 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-0ae1f722-d56d-4026-b394-ec03991c1ed5 tempest-VolumesSnapshotTestJSON-1790417655 None] snapshot: bca44290-3254-4e40-a3b7-26b94912e195, volume: 1b4d3cfe-c041-453d-be45-46de837e41e7, {{(pid=81771) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 22 17:59:01 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-0ae1f722-d56d-4026-b394-ec03991c1ed5 tempest-VolumesSnapshotTestJSON-1790417655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:59:01 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-0ae1f722-d56d-4026-b394-ec03991c1ed5 tempest-VolumesSnapshotTestJSON-1790417655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:59:01 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-0ae1f722-d56d-4026-b394-ec03991c1ed5 tempest-VolumesSnapshotTestJSON-1790417655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:59:01 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-0ae1f722-d56d-4026-b394-ec03991c1ed5 tempest-VolumesSnapshotTestJSON-1790417655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:59:01 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-0ae1f722-d56d-4026-b394-ec03991c1ed5 tempest-VolumesSnapshotTestJSON-1790417655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:59:01 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b4c25cf-1a5b-41a4-b3f5-d1e07e63893b]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:59:01 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-0ae1f722-d56d-4026-b394-ec03991c1ed5 tempest-VolumesSnapshotTestJSON-1790417655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-73da30b2-98a3-4291-8cdb-ed2406200414.bca44290-3254-4e40-a3b7-26b94912e195 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:59:01 devstack sudo[89617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-fd18dedb-3381-4a27-b33c-20f64b6166f6 Apr 22 17:59:01 devstack sudo[89617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:59:01 devstack sudo[89618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-73da30b2-98a3-4291-8cdb-ed2406200414.bca44290-3254-4e40-a3b7-26b94912e195 Apr 22 17:59:01 devstack sudo[89618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:59:01 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-bf8d2671-cd76-4109-83af-23e371cb0b26 tempest-SnapshotDependencyTests-1971789782 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:59:01 devstack sudo[89617]: pam_unix(sudo:session): session closed for user root Apr 22 17:59:01 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-b2515047-b3d4-4dba-976b-ae4c94250755 tempest-VolumesActionsTest-1312180831 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-fd18dedb-3381-4a27-b33c-20f64b6166f6" returned: 0 in 0.631s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:59:01 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-b2515047-b3d4-4dba-976b-ae4c94250755 tempest-VolumesActionsTest-1312180831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-fd18dedb-3381-4a27-b33c-20f64b6166f6 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:59:01 devstack sudo[89618]: pam_unix(sudo:session): session closed for user root Apr 22 17:59:01 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-0ae1f722-d56d-4026-b394-ec03991c1ed5 tempest-VolumesSnapshotTestJSON-1790417655 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-73da30b2-98a3-4291-8cdb-ed2406200414.bca44290-3254-4e40-a3b7-26b94912e195" returned: 0 in 0.568s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:59:01 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-0ae1f722-d56d-4026-b394-ec03991c1ed5 tempest-VolumesSnapshotTestJSON-1790417655 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-73da30b2-98a3-4291-8cdb-ed2406200414(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81771) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 22 17:59:01 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-0ae1f722-d56d-4026-b394-ec03991c1ed5 tempest-VolumesSnapshotTestJSON-1790417655 None] will copy from snapshot at /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-73da30b2-98a3-4291-8cdb-ed2406200414 {{(pid=81771) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 22 17:59:01 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-0ae1f722-d56d-4026-b394-ec03991c1ed5 tempest-VolumesSnapshotTestJSON-1790417655 None] Creating direct copy from snapshot {{(pid=81771) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 22 17:59:01 devstack sudo[89627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-fd18dedb-3381-4a27-b33c-20f64b6166f6 Apr 22 17:59:01 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[990f40d1-c126-4a7c-8eda-7c8840305a57]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:59:01 devstack sudo[89627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:59:01 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-0ae1f722-d56d-4026-b394-ec03991c1ed5 tempest-VolumesSnapshotTestJSON-1790417655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-73da30b2-98a3-4291-8cdb-ed2406200414 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:59:01 devstack sudo[89629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-73da30b2-98a3-4291-8cdb-ed2406200414 Apr 22 17:59:01 devstack sudo[89629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:59:02 devstack sudo[89627]: pam_unix(sudo:session): session closed for user root Apr 22 17:59:02 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-b2515047-b3d4-4dba-976b-ae4c94250755 tempest-VolumesActionsTest-1312180831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-fd18dedb-3381-4a27-b33c-20f64b6166f6" returned: 0 in 0.468s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:59:02 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-b2515047-b3d4-4dba-976b-ae4c94250755 tempest-VolumesActionsTest-1312180831 None] Lock "cinder-quobyte-fd18dedb-3381-4a27-b33c-20f64b6166f6" released by "delete_volume" :: held 1.147s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:59:02 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-b2515047-b3d4-4dba-976b-ae4c94250755 tempest-VolumesActionsTest-1312180831 None] Created reservations ['c2947854-93f7-46f6-a7b5-ce5a0257d303', '2d8874c0-1a43-4e4b-81ce-f2ed821294e0', 'bced493c-3954-4185-b8bf-99c34c1eb489', '3d1edb73-40ff-4c2c-816d-709546cf4677'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 17:59:02 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-b2515047-b3d4-4dba-976b-ae4c94250755 tempest-VolumesActionsTest-1312180831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:59:02 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-b2515047-b3d4-4dba-976b-ae4c94250755 tempest-VolumesActionsTest-1312180831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:59:02 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-b2515047-b3d4-4dba-976b-ae4c94250755 tempest-VolumesActionsTest-1312180831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:59:02 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-b2515047-b3d4-4dba-976b-ae4c94250755 tempest-VolumesActionsTest-1312180831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:59:02 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-b2515047-b3d4-4dba-976b-ae4c94250755 tempest-VolumesActionsTest-1312180831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:59:02 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-b2515047-b3d4-4dba-976b-ae4c94250755 tempest-VolumesActionsTest-1312180831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:59:02 devstack sudo[89629]: pam_unix(sudo:session): session closed for user root Apr 22 17:59:02 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-0ae1f722-d56d-4026-b394-ec03991c1ed5 tempest-VolumesSnapshotTestJSON-1790417655 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-73da30b2-98a3-4291-8cdb-ed2406200414" returned: 0 in 0.593s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:59:02 devstack cinder-volume[81771]: DEBUG cinder.utils [None req-0ae1f722-d56d-4026-b394-ec03991c1ed5 tempest-VolumesSnapshotTestJSON-1790417655 None] Path /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-1b4d3cfe-c041-453d-be45-46de837e41e7 not found in is_blk_device check {{(pid=81771) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 22 17:59:02 devstack sudo[89635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 Apr 22 17:59:02 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-0ae1f722-d56d-4026-b394-ec03991c1ed5 tempest-VolumesSnapshotTestJSON-1790417655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-73da30b2-98a3-4291-8cdb-ed2406200414 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-1b4d3cfe-c041-453d-be45-46de837e41e7 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:59:02 devstack sudo[89635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:59:02 devstack sudo[89637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-73da30b2-98a3-4291-8cdb-ed2406200414 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-1b4d3cfe-c041-453d-be45-46de837e41e7 Apr 22 17:59:02 devstack sudo[89637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:59:02 devstack sudo[89635]: pam_unix(sudo:session): session closed for user root Apr 22 17:59:02 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-b2515047-b3d4-4dba-976b-ae4c94250755 tempest-VolumesActionsTest-1312180831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33" returned: 0 in 0.450s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:59:02 devstack cinder-volume[81771]: DEBUG cinder.manager [None req-b2515047-b3d4-4dba-976b-ae4c94250755 tempest-VolumesActionsTest-1312180831 None] Notifying Schedulers of capabilities ... {{(pid=81771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 17:59:02 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-b2515047-b3d4-4dba-976b-ae4c94250755 tempest-VolumesActionsTest-1312180831 None] Deleted volume successfully. Apr 22 17:59:02 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-b2515047-b3d4-4dba-976b-ae4c94250755 tempest-VolumesActionsTest-1312180831 None] Lock "cinder-fd18dedb-3381-4a27-b33c-20f64b6166f6-delete_volume" released by "delete_volume" :: held 1.894s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:59:04 devstack cinder-volume[81771]: DEBUG cinder.volume.flows.manager.create_volume [None req-350ed797-e0f1-4e3d-af8c-949b073ed88a tempest-VolumesActionsTest-678062019 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 17:59:04 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-350ed797-e0f1-4e3d-af8c-949b073ed88a tempest-VolumesActionsTest-678062019 None] Flow 'volume_create_manager' (573390d5-4460-4a9a-acb3-fea59e6a486a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:59:04 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-350ed797-e0f1-4e3d-af8c-949b073ed88a tempest-VolumesActionsTest-678062019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dab89583-c557-44c7-9b2b-9e16a76ef1ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:59:04 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-350ed797-e0f1-4e3d-af8c-949b073ed88a tempest-VolumesActionsTest-678062019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dab89583-c557-44c7-9b2b-9e16a76ef1ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:59:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-898537767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5eae773f-38bb-40fc-a8b1-d5202256e4f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd5ed77be0ee418cb4f7816bd70e7b2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:59:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:59:04Z,use_quota=True,user_id='fa7c9a3bff17449bb4b6fcd3fa13fb1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:59:04 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-350ed797-e0f1-4e3d-af8c-949b073ed88a tempest-VolumesActionsTest-678062019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b511994d-9547-42c2-8717-5ae06a63f677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:59:04 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-350ed797-e0f1-4e3d-af8c-949b073ed88a tempest-VolumesActionsTest-678062019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b511994d-9547-42c2-8717-5ae06a63f677) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:59:04 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-350ed797-e0f1-4e3d-af8c-949b073ed88a tempest-VolumesActionsTest-678062019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b56d742-7cac-4416-987e-239e2fe77533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:59:04 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-350ed797-e0f1-4e3d-af8c-949b073ed88a tempest-VolumesActionsTest-678062019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b56d742-7cac-4416-987e-239e2fe77533) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5eae773f-38bb-40fc-a8b1-d5202256e4f3', 'volume_name': 'volume-5eae773f-38bb-40fc-a8b1-d5202256e4f3', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:59:04 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-350ed797-e0f1-4e3d-af8c-949b073ed88a tempest-VolumesActionsTest-678062019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6db2d16-9ac1-43e8-af41-1bd680add7aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:59:04 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-350ed797-e0f1-4e3d-af8c-949b073ed88a tempest-VolumesActionsTest-678062019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6db2d16-9ac1-43e8-af41-1bd680add7aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:59:04 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-350ed797-e0f1-4e3d-af8c-949b073ed88a tempest-VolumesActionsTest-678062019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1633b5bb-d192-49d5-9b71-ade37931e42b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:59:04 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-350ed797-e0f1-4e3d-af8c-949b073ed88a tempest-VolumesActionsTest-678062019 None] Volume 5eae773f-38bb-40fc-a8b1-d5202256e4f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5eae773f-38bb-40fc-a8b1-d5202256e4f3', 'volume_size': 1} Apr 22 17:59:04 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-350ed797-e0f1-4e3d-af8c-949b073ed88a tempest-VolumesActionsTest-678062019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:59:07 devstack sudo[89637]: pam_unix(sudo:session): session closed for user root Apr 22 17:59:07 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-0ae1f722-d56d-4026-b394-ec03991c1ed5 tempest-VolumesSnapshotTestJSON-1790417655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-73da30b2-98a3-4291-8cdb-ed2406200414 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-1b4d3cfe-c041-453d-be45-46de837e41e7" returned: 0 in 4.855s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:59:07 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b439766-f763-4b7d-8995-96b2186b8ca6]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:59:07 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-0ae1f722-d56d-4026-b394-ec03991c1ed5 tempest-VolumesSnapshotTestJSON-1790417655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-73da30b2-98a3-4291-8cdb-ed2406200414 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:59:07 devstack sudo[89651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-73da30b2-98a3-4291-8cdb-ed2406200414 Apr 22 17:59:07 devstack sudo[89651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:59:07 devstack sudo[89651]: pam_unix(sudo:session): session closed for user root Apr 22 17:59:08 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-0ae1f722-d56d-4026-b394-ec03991c1ed5 tempest-VolumesSnapshotTestJSON-1790417655 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-73da30b2-98a3-4291-8cdb-ed2406200414" returned: 0 in 0.666s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:59:08 devstack cinder-volume[81771]: DEBUG cinder.image.image_utils [None req-0ae1f722-d56d-4026-b394-ec03991c1ed5 tempest-VolumesSnapshotTestJSON-1790417655 None] Image conversion details: src /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-73da30b2-98a3-4291-8cdb-ed2406200414, size 1024.00 MB, duration 4.86 sec, destination /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-1b4d3cfe-c041-453d-be45-46de837e41e7 {{(pid=81771) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 22 17:59:08 devstack cinder-volume[81771]: INFO cinder.image.image_utils [None req-0ae1f722-d56d-4026-b394-ec03991c1ed5 tempest-VolumesSnapshotTestJSON-1790417655 None] Converted 1024.00 MB image at 210.83 MB/s Apr 22 17:59:08 devstack cinder-volume[81771]: WARNING cinder.volume.drivers.remotefs [None req-0ae1f722-d56d-4026-b394-ec03991c1ed5 tempest-VolumesSnapshotTestJSON-1790417655 None] /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-1b4d3cfe-c041-453d-be45-46de837e41e7 is being set with open permissions: ugo+rw Apr 22 17:59:08 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-0ae1f722-d56d-4026-b394-ec03991c1ed5 tempest-VolumesSnapshotTestJSON-1790417655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-1b4d3cfe-c041-453d-be45-46de837e41e7 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:59:08 devstack sudo[89656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-1b4d3cfe-c041-453d-be45-46de837e41e7 Apr 22 17:59:08 devstack sudo[89656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:59:08 devstack sudo[89656]: pam_unix(sudo:session): session closed for user root Apr 22 17:59:08 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-0ae1f722-d56d-4026-b394-ec03991c1ed5 tempest-VolumesSnapshotTestJSON-1790417655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-1b4d3cfe-c041-453d-be45-46de837e41e7" returned: 0 in 0.445s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:59:08 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-0ae1f722-d56d-4026-b394-ec03991c1ed5 tempest-VolumesSnapshotTestJSON-1790417655 None] Lock "cinder-quobyte-1b4d3cfe-c041-453d-be45-46de837e41e7" released by "_copy_volume_from_snapshot" :: held 7.246s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:59:08 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-0ae1f722-d56d-4026-b394-ec03991c1ed5 tempest-VolumesSnapshotTestJSON-1790417655 None] Lock "cinder-quobyte-bca44290-3254-4e40-a3b7-26b94912e195-1b4d3cfe-c041-453d-be45-46de837e41e7" released by "_create_volume_from_snapshot" :: held 7.332s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:59:08 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-0ae1f722-d56d-4026-b394-ec03991c1ed5 tempest-VolumesSnapshotTestJSON-1790417655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.404s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:59:08 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-bf8d2671-cd76-4109-83af-23e371cb0b26 tempest-SnapshotDependencyTests-1971789782 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.885s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:59:08 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-bf8d2671-cd76-4109-83af-23e371cb0b26 tempest-SnapshotDependencyTests-1971789782 None] Creating offline snapshot c644ad89-1fa7-4cef-b7be-d6f5f80e0951 of volume 45a0be4d-13a9-4fca-8c04-36014a3f3020 {{(pid=81771) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 22 17:59:08 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[710cb180-ddda-4075-b106-2c5d42ed3ca1]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:59:08 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-bf8d2671-cd76-4109-83af-23e371cb0b26 tempest-SnapshotDependencyTests-1971789782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-45a0be4d-13a9-4fca-8c04-36014a3f3020 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:59:08 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-0ae1f722-d56d-4026-b394-ec03991c1ed5 tempest-VolumesSnapshotTestJSON-1790417655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa227f2e-2c95-4ea7-992d-989eb2209688) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b4d3cfe-c041-453d-be45-46de837e41e7', 'volume_size': 1, 'snapshot_id': 'bca44290-3254-4e40-a3b7-26b94912e195'}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:59:08 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-0ae1f722-d56d-4026-b394-ec03991c1ed5 tempest-VolumesSnapshotTestJSON-1790417655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4b5ff84-6cc9-4b42-8a23-ace8b85db4e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:59:08 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-0ae1f722-d56d-4026-b394-ec03991c1ed5 tempest-VolumesSnapshotTestJSON-1790417655 None] Volume volume-1b4d3cfe-c041-453d-be45-46de837e41e7 (1b4d3cfe-c041-453d-be45-46de837e41e7): created successfully Apr 22 17:59:08 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-0ae1f722-d56d-4026-b394-ec03991c1ed5 tempest-VolumesSnapshotTestJSON-1790417655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4b5ff84-6cc9-4b42-8a23-ace8b85db4e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:59:08 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-0ae1f722-d56d-4026-b394-ec03991c1ed5 tempest-VolumesSnapshotTestJSON-1790417655 None] Flow 'volume_create_manager' (e4c413ae-67b7-4ba8-a18e-aee2de075b35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:59:08 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-0ae1f722-d56d-4026-b394-ec03991c1ed5 tempest-VolumesSnapshotTestJSON-1790417655 None] Created volume successfully. Apr 22 17:59:08 devstack sudo[89659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-45a0be4d-13a9-4fca-8c04-36014a3f3020 Apr 22 17:59:08 devstack sudo[89659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:59:09 devstack sudo[89659]: pam_unix(sudo:session): session closed for user root Apr 22 17:59:09 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-bf8d2671-cd76-4109-83af-23e371cb0b26 tempest-SnapshotDependencyTests-1971789782 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-45a0be4d-13a9-4fca-8c04-36014a3f3020" returned: 0 in 0.562s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:59:09 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-bf8d2671-cd76-4109-83af-23e371cb0b26 tempest-SnapshotDependencyTests-1971789782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-45a0be4d-13a9-4fca-8c04-36014a3f3020,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-45a0be4d-13a9-4fca-8c04-36014a3f3020.c644ad89-1fa7-4cef-b7be-d6f5f80e0951 1G {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:59:09 devstack sudo[89664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-45a0be4d-13a9-4fca-8c04-36014a3f3020,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-45a0be4d-13a9-4fca-8c04-36014a3f3020.c644ad89-1fa7-4cef-b7be-d6f5f80e0951 1G Apr 22 17:59:09 devstack sudo[89664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:59:09 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-7cd17f22-092c-4617-9b41-1b0e115f47fa tempest-VolumesSnapshotTestJSON-1790417655 None] Acquiring lock "cinder-1b4d3cfe-c041-453d-be45-46de837e41e7-delete_volume" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:59:09 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-7cd17f22-092c-4617-9b41-1b0e115f47fa tempest-VolumesSnapshotTestJSON-1790417655 None] Lock "cinder-1b4d3cfe-c041-453d-be45-46de837e41e7-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:59:09 devstack sudo[89664]: pam_unix(sudo:session): session closed for user root Apr 22 17:59:09 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-bf8d2671-cd76-4109-83af-23e371cb0b26 tempest-SnapshotDependencyTests-1971789782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-45a0be4d-13a9-4fca-8c04-36014a3f3020,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-45a0be4d-13a9-4fca-8c04-36014a3f3020.c644ad89-1fa7-4cef-b7be-d6f5f80e0951 1G" returned: 0 in 0.651s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:59:09 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-bf8d2671-cd76-4109-83af-23e371cb0b26 tempest-SnapshotDependencyTests-1971789782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45a0be4d-13a9-4fca-8c04-36014a3f3020 -F qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-45a0be4d-13a9-4fca-8c04-36014a3f3020.c644ad89-1fa7-4cef-b7be-d6f5f80e0951 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:59:09 devstack sudo[89669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45a0be4d-13a9-4fca-8c04-36014a3f3020 -F qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-45a0be4d-13a9-4fca-8c04-36014a3f3020.c644ad89-1fa7-4cef-b7be-d6f5f80e0951 Apr 22 17:59:09 devstack sudo[89669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:59:09 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-7cd17f22-092c-4617-9b41-1b0e115f47fa tempest-VolumesSnapshotTestJSON-1790417655 None] Acquiring lock "cinder-quobyte-1b4d3cfe-c041-453d-be45-46de837e41e7" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:59:09 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-7cd17f22-092c-4617-9b41-1b0e115f47fa tempest-VolumesSnapshotTestJSON-1790417655 None] Lock "cinder-quobyte-1b4d3cfe-c041-453d-be45-46de837e41e7" acquired by "delete_volume" :: waited 0.016s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:59:09 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[57e129c5-5b02-44a1-9e73-9a74f51bfdaa]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:59:09 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-7cd17f22-092c-4617-9b41-1b0e115f47fa tempest-VolumesSnapshotTestJSON-1790417655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-1b4d3cfe-c041-453d-be45-46de837e41e7 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:59:09 devstack sudo[89671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-1b4d3cfe-c041-453d-be45-46de837e41e7 Apr 22 17:59:09 devstack sudo[89671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:59:10 devstack sudo[89669]: pam_unix(sudo:session): session closed for user root Apr 22 17:59:10 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-bf8d2671-cd76-4109-83af-23e371cb0b26 tempest-SnapshotDependencyTests-1971789782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45a0be4d-13a9-4fca-8c04-36014a3f3020 -F qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-45a0be4d-13a9-4fca-8c04-36014a3f3020.c644ad89-1fa7-4cef-b7be-d6f5f80e0951" returned: 0 in 0.516s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:59:10 devstack cinder-volume[81771]: WARNING cinder.volume.drivers.remotefs [None req-bf8d2671-cd76-4109-83af-23e371cb0b26 tempest-SnapshotDependencyTests-1971789782 None] /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-45a0be4d-13a9-4fca-8c04-36014a3f3020.c644ad89-1fa7-4cef-b7be-d6f5f80e0951 is being set with open permissions: ugo+rw Apr 22 17:59:10 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-bf8d2671-cd76-4109-83af-23e371cb0b26 tempest-SnapshotDependencyTests-1971789782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-45a0be4d-13a9-4fca-8c04-36014a3f3020.c644ad89-1fa7-4cef-b7be-d6f5f80e0951 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:59:10 devstack sudo[89679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-45a0be4d-13a9-4fca-8c04-36014a3f3020.c644ad89-1fa7-4cef-b7be-d6f5f80e0951 Apr 22 17:59:10 devstack sudo[89679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:59:10 devstack sudo[89671]: pam_unix(sudo:session): session closed for user root Apr 22 17:59:10 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-7cd17f22-092c-4617-9b41-1b0e115f47fa tempest-VolumesSnapshotTestJSON-1790417655 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-1b4d3cfe-c041-453d-be45-46de837e41e7" returned: 0 in 0.549s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:59:10 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-7cd17f22-092c-4617-9b41-1b0e115f47fa tempest-VolumesSnapshotTestJSON-1790417655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-1b4d3cfe-c041-453d-be45-46de837e41e7 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:59:10 devstack sudo[89681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-1b4d3cfe-c041-453d-be45-46de837e41e7 Apr 22 17:59:10 devstack sudo[89681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:59:10 devstack sudo[89679]: pam_unix(sudo:session): session closed for user root Apr 22 17:59:10 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-bf8d2671-cd76-4109-83af-23e371cb0b26 tempest-SnapshotDependencyTests-1971789782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-45a0be4d-13a9-4fca-8c04-36014a3f3020.c644ad89-1fa7-4cef-b7be-d6f5f80e0951" returned: 0 in 0.462s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:59:10 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-bf8d2671-cd76-4109-83af-23e371cb0b26 tempest-SnapshotDependencyTests-1971789782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-45a0be4d-13a9-4fca-8c04-36014a3f3020.info {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:59:10 devstack sudo[89685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-45a0be4d-13a9-4fca-8c04-36014a3f3020.info Apr 22 17:59:10 devstack sudo[89685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:59:10 devstack sudo[89681]: pam_unix(sudo:session): session closed for user root Apr 22 17:59:10 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-7cd17f22-092c-4617-9b41-1b0e115f47fa tempest-VolumesSnapshotTestJSON-1790417655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-1b4d3cfe-c041-453d-be45-46de837e41e7" returned: 0 in 0.475s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:59:10 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-7cd17f22-092c-4617-9b41-1b0e115f47fa tempest-VolumesSnapshotTestJSON-1790417655 None] Lock "cinder-quobyte-1b4d3cfe-c041-453d-be45-46de837e41e7" released by "delete_volume" :: held 1.066s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:59:10 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-7cd17f22-092c-4617-9b41-1b0e115f47fa tempest-VolumesSnapshotTestJSON-1790417655 None] Created reservations ['58968710-9f6e-41e2-819b-2786f84d8ff8', '56350d05-975d-4a5d-ba29-ab43026515bd', 'b6d0c3b7-5c48-4ce6-b584-afe972d915f7', 'f2659b28-13a0-490a-b715-6ccccceb3a61'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 17:59:10 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-7cd17f22-092c-4617-9b41-1b0e115f47fa tempest-VolumesSnapshotTestJSON-1790417655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:59:10 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-7cd17f22-092c-4617-9b41-1b0e115f47fa tempest-VolumesSnapshotTestJSON-1790417655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:59:10 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-7cd17f22-092c-4617-9b41-1b0e115f47fa tempest-VolumesSnapshotTestJSON-1790417655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:59:10 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-7cd17f22-092c-4617-9b41-1b0e115f47fa tempest-VolumesSnapshotTestJSON-1790417655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:59:10 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-7cd17f22-092c-4617-9b41-1b0e115f47fa tempest-VolumesSnapshotTestJSON-1790417655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:59:10 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-7cd17f22-092c-4617-9b41-1b0e115f47fa tempest-VolumesSnapshotTestJSON-1790417655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:59:10 devstack sudo[89687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 Apr 22 17:59:10 devstack sudo[89687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:59:11 devstack sudo[89685]: pam_unix(sudo:session): session closed for user root Apr 22 17:59:11 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-bf8d2671-cd76-4109-83af-23e371cb0b26 tempest-SnapshotDependencyTests-1971789782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-45a0be4d-13a9-4fca-8c04-36014a3f3020.info" returned: 0 in 0.473s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:59:11 devstack cinder-volume[81771]: WARNING cinder.volume.drivers.remotefs [None req-bf8d2671-cd76-4109-83af-23e371cb0b26 tempest-SnapshotDependencyTests-1971789782 None] /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-45a0be4d-13a9-4fca-8c04-36014a3f3020.info is being set with open permissions: ugo+rw Apr 22 17:59:11 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-bf8d2671-cd76-4109-83af-23e371cb0b26 tempest-SnapshotDependencyTests-1971789782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-45a0be4d-13a9-4fca-8c04-36014a3f3020.info {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:59:11 devstack sudo[89690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-45a0be4d-13a9-4fca-8c04-36014a3f3020.info Apr 22 17:59:11 devstack sudo[89690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:59:11 devstack sudo[89687]: pam_unix(sudo:session): session closed for user root Apr 22 17:59:11 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-7cd17f22-092c-4617-9b41-1b0e115f47fa tempest-VolumesSnapshotTestJSON-1790417655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33" returned: 0 in 0.455s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:59:11 devstack cinder-volume[81771]: DEBUG cinder.manager [None req-7cd17f22-092c-4617-9b41-1b0e115f47fa tempest-VolumesSnapshotTestJSON-1790417655 None] Notifying Schedulers of capabilities ... {{(pid=81771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 17:59:11 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-7cd17f22-092c-4617-9b41-1b0e115f47fa tempest-VolumesSnapshotTestJSON-1790417655 None] Deleted volume successfully. Apr 22 17:59:11 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-7cd17f22-092c-4617-9b41-1b0e115f47fa tempest-VolumesSnapshotTestJSON-1790417655 None] Lock "cinder-1b4d3cfe-c041-453d-be45-46de837e41e7-delete_volume" released by "delete_volume" :: held 1.720s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:59:11 devstack sudo[89690]: pam_unix(sudo:session): session closed for user root Apr 22 17:59:11 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-bf8d2671-cd76-4109-83af-23e371cb0b26 tempest-SnapshotDependencyTests-1971789782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-45a0be4d-13a9-4fca-8c04-36014a3f3020.info" returned: 0 in 0.451s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:59:11 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-bf8d2671-cd76-4109-83af-23e371cb0b26 tempest-SnapshotDependencyTests-1971789782 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.205s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:59:11 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-350ed797-e0f1-4e3d-af8c-949b073ed88a tempest-VolumesActionsTest-678062019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.167s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:59:11 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-350ed797-e0f1-4e3d-af8c-949b073ed88a tempest-VolumesActionsTest-678062019 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:59:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-898537767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5eae773f-38bb-40fc-a8b1-d5202256e4f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd5ed77be0ee418cb4f7816bd70e7b2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:59:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:59:04Z,use_quota=True,user_id='fa7c9a3bff17449bb4b6fcd3fa13fb1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)}" {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 17:59:11 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-350ed797-e0f1-4e3d-af8c-949b073ed88a tempest-VolumesActionsTest-678062019 None] Creating volume 5eae773f-38bb-40fc-a8b1-d5202256e4f3 {{(pid=81771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 17:59:11 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-350ed797-e0f1-4e3d-af8c-949b073ed88a tempest-VolumesActionsTest-678062019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:59:11 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-350ed797-e0f1-4e3d-af8c-949b073ed88a tempest-VolumesActionsTest-678062019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:59:11 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-350ed797-e0f1-4e3d-af8c-949b073ed88a tempest-VolumesActionsTest-678062019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:59:11 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-350ed797-e0f1-4e3d-af8c-949b073ed88a tempest-VolumesActionsTest-678062019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:59:11 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-350ed797-e0f1-4e3d-af8c-949b073ed88a tempest-VolumesActionsTest-678062019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:59:11 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-350ed797-e0f1-4e3d-af8c-949b073ed88a tempest-VolumesActionsTest-678062019 None] Selected osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 as target Quobyte volume. {{(pid=81771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 17:59:11 devstack cinder-volume[81771]: INFO cinder.volume.drivers.remotefs [None req-350ed797-e0f1-4e3d-af8c-949b073ed88a tempest-VolumesActionsTest-678062019 None] casted to osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 Apr 22 17:59:11 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-350ed797-e0f1-4e3d-af8c-949b073ed88a tempest-VolumesActionsTest-678062019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-5eae773f-38bb-40fc-a8b1-d5202256e4f3 1073741824 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:59:11 devstack sudo[89694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-5eae773f-38bb-40fc-a8b1-d5202256e4f3 1073741824 Apr 22 17:59:11 devstack sudo[89694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:59:11 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-bf8d2671-cd76-4109-83af-23e371cb0b26 tempest-SnapshotDependencyTests-1971789782 None] Create snapshot completed successfully Apr 22 17:59:11 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-da048d0c-6beb-4302-9b10-e442b4f094d9 tempest-VolumesSnapshotTestJSON-1790417655 None] Acquiring lock "cinder-bca44290-3254-4e40-a3b7-26b94912e195-delete_snapshot" by "delete_snapshot" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:59:11 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-da048d0c-6beb-4302-9b10-e442b4f094d9 tempest-VolumesSnapshotTestJSON-1790417655 None] Lock "cinder-bca44290-3254-4e40-a3b7-26b94912e195-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:59:11 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-da048d0c-6beb-4302-9b10-e442b4f094d9 tempest-VolumesSnapshotTestJSON-1790417655 None] Acquiring lock "cinder-quobyte-73da30b2-98a3-4291-8cdb-ed2406200414" by "delete_snapshot" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:59:11 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-da048d0c-6beb-4302-9b10-e442b4f094d9 tempest-VolumesSnapshotTestJSON-1790417655 None] Lock "cinder-quobyte-73da30b2-98a3-4291-8cdb-ed2406200414" acquired by "delete_snapshot" :: waited 0.021s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:59:11 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-da048d0c-6beb-4302-9b10-e442b4f094d9 tempest-VolumesSnapshotTestJSON-1790417655 None] Acquiring lock "cinder-quobyte-bca44290-3254-4e40-a3b7-26b94912e195" by "_delete_snapshot" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:59:12 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-da048d0c-6beb-4302-9b10-e442b4f094d9 tempest-VolumesSnapshotTestJSON-1790417655 None] Lock "cinder-quobyte-bca44290-3254-4e40-a3b7-26b94912e195" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:59:12 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-da048d0c-6beb-4302-9b10-e442b4f094d9 tempest-VolumesSnapshotTestJSON-1790417655 None] Deleting offline snapshot bca44290-3254-4e40-a3b7-26b94912e195 of volume 73da30b2-98a3-4291-8cdb-ed2406200414 {{(pid=81771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 22 17:59:12 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-da048d0c-6beb-4302-9b10-e442b4f094d9 tempest-VolumesSnapshotTestJSON-1790417655 None] snapshot_file for this snap is: volume-73da30b2-98a3-4291-8cdb-ed2406200414.bca44290-3254-4e40-a3b7-26b94912e195 {{(pid=81771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 22 17:59:12 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9f0efa0-2d80-40b9-98e5-32bef99be5dd]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:59:12 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-da048d0c-6beb-4302-9b10-e442b4f094d9 tempest-VolumesSnapshotTestJSON-1790417655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-73da30b2-98a3-4291-8cdb-ed2406200414.bca44290-3254-4e40-a3b7-26b94912e195 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:59:12 devstack sudo[89696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-73da30b2-98a3-4291-8cdb-ed2406200414.bca44290-3254-4e40-a3b7-26b94912e195 Apr 22 17:59:12 devstack sudo[89696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:59:12 devstack sudo[89694]: pam_unix(sudo:session): session closed for user root Apr 22 17:59:12 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-350ed797-e0f1-4e3d-af8c-949b073ed88a tempest-VolumesActionsTest-678062019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-5eae773f-38bb-40fc-a8b1-d5202256e4f3 1073741824" returned: 0 in 0.659s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:59:12 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-350ed797-e0f1-4e3d-af8c-949b073ed88a tempest-VolumesActionsTest-678062019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-5eae773f-38bb-40fc-a8b1-d5202256e4f3 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:59:12 devstack sudo[89701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-5eae773f-38bb-40fc-a8b1-d5202256e4f3 Apr 22 17:59:12 devstack sudo[89701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:59:12 devstack cinder-volume[81771]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6ad4fa4-a240-4c1d-9689-9ca8cf16c122 tempest-SnapshotDependencyTests-1971789782 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 17:59:12 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-f6ad4fa4-a240-4c1d-9689-9ca8cf16c122 tempest-SnapshotDependencyTests-1971789782 None] Flow 'volume_create_manager' (91d4b79b-65a6-4b2a-8a47-fce5116df52a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:59:12 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-f6ad4fa4-a240-4c1d-9689-9ca8cf16c122 tempest-SnapshotDependencyTests-1971789782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa420870-7884-4924-956c-752754f14263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:59:12 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-f6ad4fa4-a240-4c1d-9689-9ca8cf16c122 tempest-SnapshotDependencyTests-1971789782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa420870-7884-4924-956c-752754f14263) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:59:12Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afdc1c40-0696-4fad-b24e-ae0e2c2ef97f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c970114d0bb4a368ac5dc22ce955bcb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:59:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c644ad89-1fa7-4cef-b7be-d6f5f80e0951,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:59:13Z,use_quota=True,user_id='5e315d82d6f54bdab03605201c712c9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:59:12 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-f6ad4fa4-a240-4c1d-9689-9ca8cf16c122 tempest-SnapshotDependencyTests-1971789782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (607396bd-2952-42ae-a6db-129ebc44e26b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:59:12 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-f6ad4fa4-a240-4c1d-9689-9ca8cf16c122 tempest-SnapshotDependencyTests-1971789782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (607396bd-2952-42ae-a6db-129ebc44e26b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:59:12 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-f6ad4fa4-a240-4c1d-9689-9ca8cf16c122 tempest-SnapshotDependencyTests-1971789782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01ad61c9-7dbe-4ea2-b0fa-2580327f6c06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:59:12 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-f6ad4fa4-a240-4c1d-9689-9ca8cf16c122 tempest-SnapshotDependencyTests-1971789782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01ad61c9-7dbe-4ea2-b0fa-2580327f6c06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'afdc1c40-0696-4fad-b24e-ae0e2c2ef97f', 'volume_name': 'volume-afdc1c40-0696-4fad-b24e-ae0e2c2ef97f', 'volume_size': 1, 'snapshot_id': 'c644ad89-1fa7-4cef-b7be-d6f5f80e0951'}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:59:12 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-f6ad4fa4-a240-4c1d-9689-9ca8cf16c122 tempest-SnapshotDependencyTests-1971789782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62d209af-0a04-4647-b1e9-c8fc1ead0dc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:59:12 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-f6ad4fa4-a240-4c1d-9689-9ca8cf16c122 tempest-SnapshotDependencyTests-1971789782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62d209af-0a04-4647-b1e9-c8fc1ead0dc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:59:12 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-f6ad4fa4-a240-4c1d-9689-9ca8cf16c122 tempest-SnapshotDependencyTests-1971789782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ebedad3-046e-45f4-b80f-23aef46a325f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:59:12 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-f6ad4fa4-a240-4c1d-9689-9ca8cf16c122 tempest-SnapshotDependencyTests-1971789782 None] Volume afdc1c40-0696-4fad-b24e-ae0e2c2ef97f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-afdc1c40-0696-4fad-b24e-ae0e2c2ef97f', 'volume_size': 1, 'snapshot_id': 'c644ad89-1fa7-4cef-b7be-d6f5f80e0951'} Apr 22 17:59:12 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-f6ad4fa4-a240-4c1d-9689-9ca8cf16c122 tempest-SnapshotDependencyTests-1971789782 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:59:12 devstack sudo[89696]: pam_unix(sudo:session): session closed for user root Apr 22 17:59:12 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-da048d0c-6beb-4302-9b10-e442b4f094d9 tempest-VolumesSnapshotTestJSON-1790417655 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-73da30b2-98a3-4291-8cdb-ed2406200414.bca44290-3254-4e40-a3b7-26b94912e195" returned: 0 in 0.666s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:59:12 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-da048d0c-6beb-4302-9b10-e442b4f094d9 tempest-VolumesSnapshotTestJSON-1790417655 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-73da30b2-98a3-4291-8cdb-ed2406200414(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81771) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 22 17:59:12 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[612d613f-4976-48ec-9692-c27fa13e519f]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:59:12 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-da048d0c-6beb-4302-9b10-e442b4f094d9 tempest-VolumesSnapshotTestJSON-1790417655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-73da30b2-98a3-4291-8cdb-ed2406200414 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:59:12 devstack sudo[89706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-73da30b2-98a3-4291-8cdb-ed2406200414 Apr 22 17:59:12 devstack sudo[89706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:59:12 devstack sudo[89701]: pam_unix(sudo:session): session closed for user root Apr 22 17:59:12 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-350ed797-e0f1-4e3d-af8c-949b073ed88a tempest-VolumesActionsTest-678062019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-5eae773f-38bb-40fc-a8b1-d5202256e4f3" returned: 0 in 0.518s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:59:12 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-350ed797-e0f1-4e3d-af8c-949b073ed88a tempest-VolumesActionsTest-678062019 None] <== create_volume: return (1218ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'} {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 17:59:12 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-350ed797-e0f1-4e3d-af8c-949b073ed88a tempest-VolumesActionsTest-678062019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.221s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:59:12 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-f6ad4fa4-a240-4c1d-9689-9ca8cf16c122 tempest-SnapshotDependencyTests-1971789782 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.251s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:59:12 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-f6ad4fa4-a240-4c1d-9689-9ca8cf16c122 tempest-SnapshotDependencyTests-1971789782 None] Acquiring lock "cinder-quobyte-c644ad89-1fa7-4cef-b7be-d6f5f80e0951-afdc1c40-0696-4fad-b24e-ae0e2c2ef97f" by "_create_volume_from_snapshot" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:59:12 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-350ed797-e0f1-4e3d-af8c-949b073ed88a tempest-VolumesActionsTest-678062019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1633b5bb-d192-49d5-9b71-ade37931e42b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5eae773f-38bb-40fc-a8b1-d5202256e4f3', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:59:12 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-350ed797-e0f1-4e3d-af8c-949b073ed88a tempest-VolumesActionsTest-678062019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aba5d9ab-24a5-4f8b-8eb2-109bc637fbaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:59:12 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-f6ad4fa4-a240-4c1d-9689-9ca8cf16c122 tempest-SnapshotDependencyTests-1971789782 None] Lock "cinder-quobyte-c644ad89-1fa7-4cef-b7be-d6f5f80e0951-afdc1c40-0696-4fad-b24e-ae0e2c2ef97f" acquired by "_create_volume_from_snapshot" :: waited 0.030s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:59:12 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-f6ad4fa4-a240-4c1d-9689-9ca8cf16c122 tempest-SnapshotDependencyTests-1971789782 None] Creating volume afdc1c40-0696-4fad-b24e-ae0e2c2ef97f from snapshot c644ad89-1fa7-4cef-b7be-d6f5f80e0951 {{(pid=81771) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 22 17:59:12 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-f6ad4fa4-a240-4c1d-9689-9ca8cf16c122 tempest-SnapshotDependencyTests-1971789782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:59:12 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-f6ad4fa4-a240-4c1d-9689-9ca8cf16c122 tempest-SnapshotDependencyTests-1971789782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:59:12 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-f6ad4fa4-a240-4c1d-9689-9ca8cf16c122 tempest-SnapshotDependencyTests-1971789782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:59:12 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-f6ad4fa4-a240-4c1d-9689-9ca8cf16c122 tempest-SnapshotDependencyTests-1971789782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:59:12 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-f6ad4fa4-a240-4c1d-9689-9ca8cf16c122 tempest-SnapshotDependencyTests-1971789782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:59:12 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-f6ad4fa4-a240-4c1d-9689-9ca8cf16c122 tempest-SnapshotDependencyTests-1971789782 None] Selected osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 as target Quobyte volume. {{(pid=81771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 17:59:12 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-f6ad4fa4-a240-4c1d-9689-9ca8cf16c122 tempest-SnapshotDependencyTests-1971789782 None] Acquiring lock "cinder-quobyte-afdc1c40-0696-4fad-b24e-ae0e2c2ef97f" by "_copy_volume_from_snapshot" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:59:12 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-350ed797-e0f1-4e3d-af8c-949b073ed88a tempest-VolumesActionsTest-678062019 None] Volume volume-5eae773f-38bb-40fc-a8b1-d5202256e4f3 (5eae773f-38bb-40fc-a8b1-d5202256e4f3): created successfully Apr 22 17:59:12 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-350ed797-e0f1-4e3d-af8c-949b073ed88a tempest-VolumesActionsTest-678062019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aba5d9ab-24a5-4f8b-8eb2-109bc637fbaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:59:12 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-350ed797-e0f1-4e3d-af8c-949b073ed88a tempest-VolumesActionsTest-678062019 None] Flow 'volume_create_manager' (573390d5-4460-4a9a-acb3-fea59e6a486a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:59:12 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-f6ad4fa4-a240-4c1d-9689-9ca8cf16c122 tempest-SnapshotDependencyTests-1971789782 None] Lock "cinder-quobyte-afdc1c40-0696-4fad-b24e-ae0e2c2ef97f" acquired by "_copy_volume_from_snapshot" :: waited 0.034s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:59:12 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-f6ad4fa4-a240-4c1d-9689-9ca8cf16c122 tempest-SnapshotDependencyTests-1971789782 None] snapshot: c644ad89-1fa7-4cef-b7be-d6f5f80e0951, volume: afdc1c40-0696-4fad-b24e-ae0e2c2ef97f, {{(pid=81771) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 22 17:59:13 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-350ed797-e0f1-4e3d-af8c-949b073ed88a tempest-VolumesActionsTest-678062019 None] Created volume successfully. Apr 22 17:59:13 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-f6ad4fa4-a240-4c1d-9689-9ca8cf16c122 tempest-SnapshotDependencyTests-1971789782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:59:13 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-f6ad4fa4-a240-4c1d-9689-9ca8cf16c122 tempest-SnapshotDependencyTests-1971789782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:59:13 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-f6ad4fa4-a240-4c1d-9689-9ca8cf16c122 tempest-SnapshotDependencyTests-1971789782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:59:13 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-f6ad4fa4-a240-4c1d-9689-9ca8cf16c122 tempest-SnapshotDependencyTests-1971789782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:59:13 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-f6ad4fa4-a240-4c1d-9689-9ca8cf16c122 tempest-SnapshotDependencyTests-1971789782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:59:13 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[4306d858-3832-433c-a992-5d5fe00c1197]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:59:13 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-f6ad4fa4-a240-4c1d-9689-9ca8cf16c122 tempest-SnapshotDependencyTests-1971789782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-45a0be4d-13a9-4fca-8c04-36014a3f3020.c644ad89-1fa7-4cef-b7be-d6f5f80e0951 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:59:13 devstack sudo[89709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-45a0be4d-13a9-4fca-8c04-36014a3f3020.c644ad89-1fa7-4cef-b7be-d6f5f80e0951 Apr 22 17:59:13 devstack sudo[89709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:59:13 devstack sudo[89706]: pam_unix(sudo:session): session closed for user root Apr 22 17:59:13 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-da048d0c-6beb-4302-9b10-e442b4f094d9 tempest-VolumesSnapshotTestJSON-1790417655 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-73da30b2-98a3-4291-8cdb-ed2406200414" returned: 0 in 0.538s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:59:13 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-da048d0c-6beb-4302-9b10-e442b4f094d9 tempest-VolumesSnapshotTestJSON-1790417655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-73da30b2-98a3-4291-8cdb-ed2406200414.bca44290-3254-4e40-a3b7-26b94912e195 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:59:13 devstack sudo[89714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-73da30b2-98a3-4291-8cdb-ed2406200414.bca44290-3254-4e40-a3b7-26b94912e195 Apr 22 17:59:13 devstack sudo[89714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:59:13 devstack sudo[89709]: pam_unix(sudo:session): session closed for user root Apr 22 17:59:13 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-f6ad4fa4-a240-4c1d-9689-9ca8cf16c122 tempest-SnapshotDependencyTests-1971789782 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-45a0be4d-13a9-4fca-8c04-36014a3f3020.c644ad89-1fa7-4cef-b7be-d6f5f80e0951" returned: 0 in 0.536s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:59:13 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-f6ad4fa4-a240-4c1d-9689-9ca8cf16c122 tempest-SnapshotDependencyTests-1971789782 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-45a0be4d-13a9-4fca-8c04-36014a3f3020(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81771) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 22 17:59:13 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-f6ad4fa4-a240-4c1d-9689-9ca8cf16c122 tempest-SnapshotDependencyTests-1971789782 None] will copy from snapshot at /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-45a0be4d-13a9-4fca-8c04-36014a3f3020 {{(pid=81771) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 22 17:59:13 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-f6ad4fa4-a240-4c1d-9689-9ca8cf16c122 tempest-SnapshotDependencyTests-1971789782 None] Creating direct copy from snapshot {{(pid=81771) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 22 17:59:13 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ac2ba1e-395e-4c65-9985-1bf86e317a9b]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:59:13 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-f6ad4fa4-a240-4c1d-9689-9ca8cf16c122 tempest-SnapshotDependencyTests-1971789782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-45a0be4d-13a9-4fca-8c04-36014a3f3020 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:59:13 devstack sudo[89719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-45a0be4d-13a9-4fca-8c04-36014a3f3020 Apr 22 17:59:13 devstack sudo[89719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:59:13 devstack sudo[89714]: pam_unix(sudo:session): session closed for user root Apr 22 17:59:13 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-da048d0c-6beb-4302-9b10-e442b4f094d9 tempest-VolumesSnapshotTestJSON-1790417655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-73da30b2-98a3-4291-8cdb-ed2406200414.bca44290-3254-4e40-a3b7-26b94912e195" returned: 0 in 0.601s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:59:13 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-da048d0c-6beb-4302-9b10-e442b4f094d9 tempest-VolumesSnapshotTestJSON-1790417655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-73da30b2-98a3-4291-8cdb-ed2406200414.bca44290-3254-4e40-a3b7-26b94912e195 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:59:13 devstack sudo[89724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-73da30b2-98a3-4291-8cdb-ed2406200414.bca44290-3254-4e40-a3b7-26b94912e195 Apr 22 17:59:13 devstack sudo[89724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:59:14 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-99a15410-b5cf-40cb-9a3b-9415d6784008 tempest-VolumesActionsTest-1312180831 None] Acquiring lock "cinder-5eae773f-38bb-40fc-a8b1-d5202256e4f3-delete_volume" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:59:14 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-99a15410-b5cf-40cb-9a3b-9415d6784008 tempest-VolumesActionsTest-1312180831 None] Lock "cinder-5eae773f-38bb-40fc-a8b1-d5202256e4f3-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:59:14 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-99a15410-b5cf-40cb-9a3b-9415d6784008 tempest-VolumesActionsTest-1312180831 None] Acquiring lock "cinder-quobyte-5eae773f-38bb-40fc-a8b1-d5202256e4f3" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:59:14 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-99a15410-b5cf-40cb-9a3b-9415d6784008 tempest-VolumesActionsTest-1312180831 None] Lock "cinder-quobyte-5eae773f-38bb-40fc-a8b1-d5202256e4f3" acquired by "delete_volume" :: waited 0.020s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:59:14 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fa14f49-ec73-4609-b3b4-fc14301a9adb]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:59:14 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-99a15410-b5cf-40cb-9a3b-9415d6784008 tempest-VolumesActionsTest-1312180831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-5eae773f-38bb-40fc-a8b1-d5202256e4f3 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:59:14 devstack sudo[89719]: pam_unix(sudo:session): session closed for user root Apr 22 17:59:14 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-f6ad4fa4-a240-4c1d-9689-9ca8cf16c122 tempest-SnapshotDependencyTests-1971789782 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-45a0be4d-13a9-4fca-8c04-36014a3f3020" returned: 0 in 0.590s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:59:14 devstack cinder-volume[81771]: DEBUG cinder.utils [None req-f6ad4fa4-a240-4c1d-9689-9ca8cf16c122 tempest-SnapshotDependencyTests-1971789782 None] Path /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-afdc1c40-0696-4fad-b24e-ae0e2c2ef97f not found in is_blk_device check {{(pid=81771) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 22 17:59:14 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-f6ad4fa4-a240-4c1d-9689-9ca8cf16c122 tempest-SnapshotDependencyTests-1971789782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-45a0be4d-13a9-4fca-8c04-36014a3f3020 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-afdc1c40-0696-4fad-b24e-ae0e2c2ef97f {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:59:14 devstack sudo[89729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-5eae773f-38bb-40fc-a8b1-d5202256e4f3 Apr 22 17:59:14 devstack sudo[89729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:59:14 devstack sudo[89730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-45a0be4d-13a9-4fca-8c04-36014a3f3020 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-afdc1c40-0696-4fad-b24e-ae0e2c2ef97f Apr 22 17:59:14 devstack sudo[89730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:59:14 devstack sudo[89724]: pam_unix(sudo:session): session closed for user root Apr 22 17:59:14 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-da048d0c-6beb-4302-9b10-e442b4f094d9 tempest-VolumesSnapshotTestJSON-1790417655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-73da30b2-98a3-4291-8cdb-ed2406200414.bca44290-3254-4e40-a3b7-26b94912e195" returned: 0 in 0.490s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:59:14 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-da048d0c-6beb-4302-9b10-e442b4f094d9 tempest-VolumesSnapshotTestJSON-1790417655 None] Lock "cinder-quobyte-bca44290-3254-4e40-a3b7-26b94912e195" released by "_delete_snapshot" :: held 2.412s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:59:14 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-da048d0c-6beb-4302-9b10-e442b4f094d9 tempest-VolumesSnapshotTestJSON-1790417655 None] Lock "cinder-quobyte-73da30b2-98a3-4291-8cdb-ed2406200414" released by "delete_snapshot" :: held 2.438s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:59:14 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-da048d0c-6beb-4302-9b10-e442b4f094d9 tempest-VolumesSnapshotTestJSON-1790417655 None] Created reservations ['1ba34eda-58ed-44e7-b784-27c4d94e35a5', '98235c53-062a-495f-a4fa-5adeb23329c6', 'b8e7d1e2-90b3-44d5-9627-ac796fa318df', '550b3144-e3d2-4597-8a7f-b926e5f7c840'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 17:59:14 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-da048d0c-6beb-4302-9b10-e442b4f094d9 tempest-VolumesSnapshotTestJSON-1790417655 None] Delete snapshot completed successfully. Apr 22 17:59:14 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-da048d0c-6beb-4302-9b10-e442b4f094d9 tempest-VolumesSnapshotTestJSON-1790417655 None] Lock "cinder-bca44290-3254-4e40-a3b7-26b94912e195-delete_snapshot" released by "delete_snapshot" :: held 2.576s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:59:14 devstack sudo[89729]: pam_unix(sudo:session): session closed for user root Apr 22 17:59:14 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-99a15410-b5cf-40cb-9a3b-9415d6784008 tempest-VolumesActionsTest-1312180831 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-5eae773f-38bb-40fc-a8b1-d5202256e4f3" returned: 0 in 0.573s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:59:14 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-99a15410-b5cf-40cb-9a3b-9415d6784008 tempest-VolumesActionsTest-1312180831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-5eae773f-38bb-40fc-a8b1-d5202256e4f3 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:59:14 devstack sudo[89740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-5eae773f-38bb-40fc-a8b1-d5202256e4f3 Apr 22 17:59:14 devstack sudo[89740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:59:15 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-c57a4d01-64b6-4a39-9ef9-72cbe9b805bd tempest-VolumesSnapshotTestJSON-1790417655 None] Acquiring lock "cinder-73da30b2-98a3-4291-8cdb-ed2406200414-delete_volume" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:59:15 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-c57a4d01-64b6-4a39-9ef9-72cbe9b805bd tempest-VolumesSnapshotTestJSON-1790417655 None] Lock "cinder-73da30b2-98a3-4291-8cdb-ed2406200414-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:59:15 devstack sudo[89740]: pam_unix(sudo:session): session closed for user root Apr 22 17:59:15 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-99a15410-b5cf-40cb-9a3b-9415d6784008 tempest-VolumesActionsTest-1312180831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-5eae773f-38bb-40fc-a8b1-d5202256e4f3" returned: 0 in 0.807s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:59:15 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-c57a4d01-64b6-4a39-9ef9-72cbe9b805bd tempest-VolumesSnapshotTestJSON-1790417655 None] Acquiring lock "cinder-quobyte-73da30b2-98a3-4291-8cdb-ed2406200414" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:59:15 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-99a15410-b5cf-40cb-9a3b-9415d6784008 tempest-VolumesActionsTest-1312180831 None] Lock "cinder-quobyte-5eae773f-38bb-40fc-a8b1-d5202256e4f3" released by "delete_volume" :: held 1.484s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:59:15 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-c57a4d01-64b6-4a39-9ef9-72cbe9b805bd tempest-VolumesSnapshotTestJSON-1790417655 None] Lock "cinder-quobyte-73da30b2-98a3-4291-8cdb-ed2406200414" acquired by "delete_volume" :: waited 0.079s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:59:15 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[cda43fc2-8e43-4c57-860f-84c55047c8a1]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:59:15 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-c57a4d01-64b6-4a39-9ef9-72cbe9b805bd tempest-VolumesSnapshotTestJSON-1790417655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-73da30b2-98a3-4291-8cdb-ed2406200414 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:59:15 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-99a15410-b5cf-40cb-9a3b-9415d6784008 tempest-VolumesActionsTest-1312180831 None] Created reservations ['cf34c12d-7878-4c1b-bba0-2fd1a29a31c8', 'a5f39458-ccdf-4e0c-b4e0-d26829db2b38', '3091e085-9156-4af5-8295-1289be1d7fa9', 'fbfbc28d-9f4b-45d9-a742-4faf98450d4c'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 17:59:16 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-99a15410-b5cf-40cb-9a3b-9415d6784008 tempest-VolumesActionsTest-1312180831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:59:16 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-99a15410-b5cf-40cb-9a3b-9415d6784008 tempest-VolumesActionsTest-1312180831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:59:16 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-99a15410-b5cf-40cb-9a3b-9415d6784008 tempest-VolumesActionsTest-1312180831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:59:16 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-99a15410-b5cf-40cb-9a3b-9415d6784008 tempest-VolumesActionsTest-1312180831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:59:16 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-99a15410-b5cf-40cb-9a3b-9415d6784008 tempest-VolumesActionsTest-1312180831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:59:16 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-99a15410-b5cf-40cb-9a3b-9415d6784008 tempest-VolumesActionsTest-1312180831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:59:16 devstack sudo[89750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-73da30b2-98a3-4291-8cdb-ed2406200414 Apr 22 17:59:16 devstack sudo[89750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:59:16 devstack sudo[89751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 Apr 22 17:59:16 devstack sudo[89751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:59:17 devstack cinder-volume[81771]: DEBUG cinder.volume.flows.manager.create_volume [None req-ccc39651-10b9-465e-bc62-7675c9f4147f tempest-VolumesActionsTest-678062019 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 17:59:17 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-ccc39651-10b9-465e-bc62-7675c9f4147f tempest-VolumesActionsTest-678062019 None] Flow 'volume_create_manager' (a8aa7e81-eefd-4f6f-b971-f3d0a3883b21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:59:17 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-ccc39651-10b9-465e-bc62-7675c9f4147f tempest-VolumesActionsTest-678062019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37940e72-478d-4f7f-9329-86a2276a30fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:59:17 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-ccc39651-10b9-465e-bc62-7675c9f4147f tempest-VolumesActionsTest-678062019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37940e72-478d-4f7f-9329-86a2276a30fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:59:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-120462098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c3cd91a-c608-4154-9648-696af103d8bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd5ed77be0ee418cb4f7816bd70e7b2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:59:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:59:17Z,use_quota=True,user_id='fa7c9a3bff17449bb4b6fcd3fa13fb1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:59:17 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-ccc39651-10b9-465e-bc62-7675c9f4147f tempest-VolumesActionsTest-678062019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c451dd9b-cd40-459c-8819-a97bffc06a42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:59:17 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-ccc39651-10b9-465e-bc62-7675c9f4147f tempest-VolumesActionsTest-678062019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c451dd9b-cd40-459c-8819-a97bffc06a42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:59:17 devstack sudo[89751]: pam_unix(sudo:session): session closed for user root Apr 22 17:59:17 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-ccc39651-10b9-465e-bc62-7675c9f4147f tempest-VolumesActionsTest-678062019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (279537dc-8dfd-45c2-b8a9-235e2b1478cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:59:17 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-ccc39651-10b9-465e-bc62-7675c9f4147f tempest-VolumesActionsTest-678062019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (279537dc-8dfd-45c2-b8a9-235e2b1478cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c3cd91a-c608-4154-9648-696af103d8bb', 'volume_name': 'volume-0c3cd91a-c608-4154-9648-696af103d8bb', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:59:17 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-ccc39651-10b9-465e-bc62-7675c9f4147f tempest-VolumesActionsTest-678062019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adca0929-8e01-49bd-9a32-1a816b426ea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:59:17 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-ccc39651-10b9-465e-bc62-7675c9f4147f tempest-VolumesActionsTest-678062019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adca0929-8e01-49bd-9a32-1a816b426ea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:59:17 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-ccc39651-10b9-465e-bc62-7675c9f4147f tempest-VolumesActionsTest-678062019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8d06545-4e0f-4e4e-9932-31ff65374a23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:59:17 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-ccc39651-10b9-465e-bc62-7675c9f4147f tempest-VolumesActionsTest-678062019 None] Volume 0c3cd91a-c608-4154-9648-696af103d8bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c3cd91a-c608-4154-9648-696af103d8bb', 'volume_size': 1} Apr 22 17:59:17 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-ccc39651-10b9-465e-bc62-7675c9f4147f tempest-VolumesActionsTest-678062019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:59:17 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-99a15410-b5cf-40cb-9a3b-9415d6784008 tempest-VolumesActionsTest-1312180831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33" returned: 0 in 1.549s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:59:17 devstack cinder-volume[81771]: DEBUG cinder.manager [None req-99a15410-b5cf-40cb-9a3b-9415d6784008 tempest-VolumesActionsTest-1312180831 None] Notifying Schedulers of capabilities ... {{(pid=81771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 17:59:17 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-99a15410-b5cf-40cb-9a3b-9415d6784008 tempest-VolumesActionsTest-1312180831 None] Deleted volume successfully. Apr 22 17:59:17 devstack sudo[89750]: pam_unix(sudo:session): session closed for user root Apr 22 17:59:17 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-c57a4d01-64b6-4a39-9ef9-72cbe9b805bd tempest-VolumesSnapshotTestJSON-1790417655 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-73da30b2-98a3-4291-8cdb-ed2406200414" returned: 0 in 1.873s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:59:17 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-c57a4d01-64b6-4a39-9ef9-72cbe9b805bd tempest-VolumesSnapshotTestJSON-1790417655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-73da30b2-98a3-4291-8cdb-ed2406200414 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:59:17 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-99a15410-b5cf-40cb-9a3b-9415d6784008 tempest-VolumesActionsTest-1312180831 None] Lock "cinder-5eae773f-38bb-40fc-a8b1-d5202256e4f3-delete_volume" released by "delete_volume" :: held 3.673s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:59:17 devstack sudo[89759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-73da30b2-98a3-4291-8cdb-ed2406200414 Apr 22 17:59:17 devstack sudo[89759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:59:18 devstack sudo[89759]: pam_unix(sudo:session): session closed for user root Apr 22 17:59:18 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-c57a4d01-64b6-4a39-9ef9-72cbe9b805bd tempest-VolumesSnapshotTestJSON-1790417655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-73da30b2-98a3-4291-8cdb-ed2406200414" returned: 0 in 0.888s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:59:18 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-c57a4d01-64b6-4a39-9ef9-72cbe9b805bd tempest-VolumesSnapshotTestJSON-1790417655 None] Lock "cinder-quobyte-73da30b2-98a3-4291-8cdb-ed2406200414" released by "delete_volume" :: held 2.941s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:59:18 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-c57a4d01-64b6-4a39-9ef9-72cbe9b805bd tempest-VolumesSnapshotTestJSON-1790417655 None] Created reservations ['38e39e3d-05d6-46f6-ae6d-26358caac2fd', '4dca6c08-4511-4393-9e5b-17d7e8310fc9', 'f7f8e436-101d-4a94-a14c-66c56ee29d58', '9168c544-5a80-447b-a5ee-0ccd99d5ff21'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 17:59:18 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-c57a4d01-64b6-4a39-9ef9-72cbe9b805bd tempest-VolumesSnapshotTestJSON-1790417655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:59:18 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-c57a4d01-64b6-4a39-9ef9-72cbe9b805bd tempest-VolumesSnapshotTestJSON-1790417655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:59:18 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-c57a4d01-64b6-4a39-9ef9-72cbe9b805bd tempest-VolumesSnapshotTestJSON-1790417655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:59:18 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-c57a4d01-64b6-4a39-9ef9-72cbe9b805bd tempest-VolumesSnapshotTestJSON-1790417655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:59:18 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-c57a4d01-64b6-4a39-9ef9-72cbe9b805bd tempest-VolumesSnapshotTestJSON-1790417655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:59:18 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-c57a4d01-64b6-4a39-9ef9-72cbe9b805bd tempest-VolumesSnapshotTestJSON-1790417655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:59:18 devstack sudo[89762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 Apr 22 17:59:18 devstack sudo[89762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:59:19 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-6e04b230-f3ef-49af-8794-42fa1f992eb4 tempest-VolumesSnapshotTestJSON-1790417655 None] Acquiring lock "cinder-de7f585b-1457-43df-9fef-6a683d2f7884-delete_volume" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:59:19 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-6e04b230-f3ef-49af-8794-42fa1f992eb4 tempest-VolumesSnapshotTestJSON-1790417655 None] Lock "cinder-de7f585b-1457-43df-9fef-6a683d2f7884-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:59:19 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-6e04b230-f3ef-49af-8794-42fa1f992eb4 tempest-VolumesSnapshotTestJSON-1790417655 None] Acquiring lock "cinder-quobyte-de7f585b-1457-43df-9fef-6a683d2f7884" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:59:19 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-6e04b230-f3ef-49af-8794-42fa1f992eb4 tempest-VolumesSnapshotTestJSON-1790417655 None] Lock "cinder-quobyte-de7f585b-1457-43df-9fef-6a683d2f7884" acquired by "delete_volume" :: waited 0.027s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:59:19 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dac60f6-23b7-40d9-98fb-fc0216349981]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:59:19 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-6e04b230-f3ef-49af-8794-42fa1f992eb4 tempest-VolumesSnapshotTestJSON-1790417655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-de7f585b-1457-43df-9fef-6a683d2f7884 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:59:19 devstack sudo[89764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-de7f585b-1457-43df-9fef-6a683d2f7884 Apr 22 17:59:19 devstack sudo[89764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:59:19 devstack sudo[89762]: pam_unix(sudo:session): session closed for user root Apr 22 17:59:19 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-c57a4d01-64b6-4a39-9ef9-72cbe9b805bd tempest-VolumesSnapshotTestJSON-1790417655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33" returned: 0 in 0.985s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:59:19 devstack cinder-volume[81771]: DEBUG cinder.manager [None req-c57a4d01-64b6-4a39-9ef9-72cbe9b805bd tempest-VolumesSnapshotTestJSON-1790417655 None] Notifying Schedulers of capabilities ... {{(pid=81771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 17:59:19 devstack sudo[89730]: pam_unix(sudo:session): session closed for user root Apr 22 17:59:19 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-c57a4d01-64b6-4a39-9ef9-72cbe9b805bd tempest-VolumesSnapshotTestJSON-1790417655 None] Deleted volume successfully. Apr 22 17:59:19 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-f6ad4fa4-a240-4c1d-9689-9ca8cf16c122 tempest-SnapshotDependencyTests-1971789782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-45a0be4d-13a9-4fca-8c04-36014a3f3020 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-afdc1c40-0696-4fad-b24e-ae0e2c2ef97f" returned: 0 in 5.657s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:59:19 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0843d18-3eae-4312-916b-3f4714c18aa0]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:59:19 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-f6ad4fa4-a240-4c1d-9689-9ca8cf16c122 tempest-SnapshotDependencyTests-1971789782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-45a0be4d-13a9-4fca-8c04-36014a3f3020 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:59:19 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-c57a4d01-64b6-4a39-9ef9-72cbe9b805bd tempest-VolumesSnapshotTestJSON-1790417655 None] Lock "cinder-73da30b2-98a3-4291-8cdb-ed2406200414-delete_volume" released by "delete_volume" :: held 4.440s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:59:19 devstack sudo[89767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-45a0be4d-13a9-4fca-8c04-36014a3f3020 Apr 22 17:59:19 devstack sudo[89767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:59:20 devstack sudo[89764]: pam_unix(sudo:session): session closed for user root Apr 22 17:59:20 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-6e04b230-f3ef-49af-8794-42fa1f992eb4 tempest-VolumesSnapshotTestJSON-1790417655 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-de7f585b-1457-43df-9fef-6a683d2f7884" returned: 0 in 0.760s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:59:20 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-6e04b230-f3ef-49af-8794-42fa1f992eb4 tempest-VolumesSnapshotTestJSON-1790417655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-de7f585b-1457-43df-9fef-6a683d2f7884 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:59:20 devstack sudo[89772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-de7f585b-1457-43df-9fef-6a683d2f7884 Apr 22 17:59:20 devstack sudo[89772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:59:20 devstack sudo[89767]: pam_unix(sudo:session): session closed for user root Apr 22 17:59:20 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-f6ad4fa4-a240-4c1d-9689-9ca8cf16c122 tempest-SnapshotDependencyTests-1971789782 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-45a0be4d-13a9-4fca-8c04-36014a3f3020" returned: 0 in 0.732s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:59:20 devstack cinder-volume[81771]: DEBUG cinder.image.image_utils [None req-f6ad4fa4-a240-4c1d-9689-9ca8cf16c122 tempest-SnapshotDependencyTests-1971789782 None] Image conversion details: src /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-45a0be4d-13a9-4fca-8c04-36014a3f3020, size 1024.00 MB, duration 5.66 sec, destination /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-afdc1c40-0696-4fad-b24e-ae0e2c2ef97f {{(pid=81771) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 22 17:59:20 devstack cinder-volume[81771]: INFO cinder.image.image_utils [None req-f6ad4fa4-a240-4c1d-9689-9ca8cf16c122 tempest-SnapshotDependencyTests-1971789782 None] Converted 1024.00 MB image at 180.98 MB/s Apr 22 17:59:20 devstack cinder-volume[81771]: WARNING cinder.volume.drivers.remotefs [None req-f6ad4fa4-a240-4c1d-9689-9ca8cf16c122 tempest-SnapshotDependencyTests-1971789782 None] /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-afdc1c40-0696-4fad-b24e-ae0e2c2ef97f is being set with open permissions: ugo+rw Apr 22 17:59:20 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-f6ad4fa4-a240-4c1d-9689-9ca8cf16c122 tempest-SnapshotDependencyTests-1971789782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-afdc1c40-0696-4fad-b24e-ae0e2c2ef97f {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:59:20 devstack sudo[89772]: pam_unix(sudo:session): session closed for user root Apr 22 17:59:20 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-6e04b230-f3ef-49af-8794-42fa1f992eb4 tempest-VolumesSnapshotTestJSON-1790417655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-de7f585b-1457-43df-9fef-6a683d2f7884" returned: 0 in 0.473s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:59:20 devstack sudo[89778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-afdc1c40-0696-4fad-b24e-ae0e2c2ef97f Apr 22 17:59:20 devstack sudo[89778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:59:20 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-6e04b230-f3ef-49af-8794-42fa1f992eb4 tempest-VolumesSnapshotTestJSON-1790417655 None] Lock "cinder-quobyte-de7f585b-1457-43df-9fef-6a683d2f7884" released by "delete_volume" :: held 1.354s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:59:20 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-6e04b230-f3ef-49af-8794-42fa1f992eb4 tempest-VolumesSnapshotTestJSON-1790417655 None] Created reservations ['95b73249-d5ae-4429-8893-def0720f24f6', 'acae69d8-9cbf-4b68-99ee-47eb84976727', 'b1ac0d08-2527-4deb-b444-fec26042b401', 'f9de0314-6316-4274-a1c9-f8af69123247'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 17:59:20 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-6e04b230-f3ef-49af-8794-42fa1f992eb4 tempest-VolumesSnapshotTestJSON-1790417655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:59:20 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-6e04b230-f3ef-49af-8794-42fa1f992eb4 tempest-VolumesSnapshotTestJSON-1790417655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:59:20 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-6e04b230-f3ef-49af-8794-42fa1f992eb4 tempest-VolumesSnapshotTestJSON-1790417655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:59:20 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-6e04b230-f3ef-49af-8794-42fa1f992eb4 tempest-VolumesSnapshotTestJSON-1790417655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:59:20 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-6e04b230-f3ef-49af-8794-42fa1f992eb4 tempest-VolumesSnapshotTestJSON-1790417655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:59:20 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-6e04b230-f3ef-49af-8794-42fa1f992eb4 tempest-VolumesSnapshotTestJSON-1790417655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:59:20 devstack sudo[89780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 Apr 22 17:59:20 devstack sudo[89780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:59:21 devstack sudo[89778]: pam_unix(sudo:session): session closed for user root Apr 22 17:59:21 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-f6ad4fa4-a240-4c1d-9689-9ca8cf16c122 tempest-SnapshotDependencyTests-1971789782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-afdc1c40-0696-4fad-b24e-ae0e2c2ef97f" returned: 0 in 0.516s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:59:21 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-f6ad4fa4-a240-4c1d-9689-9ca8cf16c122 tempest-SnapshotDependencyTests-1971789782 None] Lock "cinder-quobyte-afdc1c40-0696-4fad-b24e-ae0e2c2ef97f" released by "_copy_volume_from_snapshot" :: held 8.155s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:59:21 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-f6ad4fa4-a240-4c1d-9689-9ca8cf16c122 tempest-SnapshotDependencyTests-1971789782 None] Lock "cinder-quobyte-c644ad89-1fa7-4cef-b7be-d6f5f80e0951-afdc1c40-0696-4fad-b24e-ae0e2c2ef97f" released by "_create_volume_from_snapshot" :: held 8.207s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:59:21 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-f6ad4fa4-a240-4c1d-9689-9ca8cf16c122 tempest-SnapshotDependencyTests-1971789782 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.239s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:59:21 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-ccc39651-10b9-465e-bc62-7675c9f4147f tempest-VolumesActionsTest-678062019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.540s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:59:21 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-ccc39651-10b9-465e-bc62-7675c9f4147f tempest-VolumesActionsTest-678062019 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:59:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-120462098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c3cd91a-c608-4154-9648-696af103d8bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd5ed77be0ee418cb4f7816bd70e7b2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:59:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:59:17Z,use_quota=True,user_id='fa7c9a3bff17449bb4b6fcd3fa13fb1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)}" {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 17:59:21 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-ccc39651-10b9-465e-bc62-7675c9f4147f tempest-VolumesActionsTest-678062019 None] Creating volume 0c3cd91a-c608-4154-9648-696af103d8bb {{(pid=81771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 17:59:21 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-ccc39651-10b9-465e-bc62-7675c9f4147f tempest-VolumesActionsTest-678062019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:59:21 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-ccc39651-10b9-465e-bc62-7675c9f4147f tempest-VolumesActionsTest-678062019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:59:21 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-ccc39651-10b9-465e-bc62-7675c9f4147f tempest-VolumesActionsTest-678062019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:59:21 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-ccc39651-10b9-465e-bc62-7675c9f4147f tempest-VolumesActionsTest-678062019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:59:21 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-ccc39651-10b9-465e-bc62-7675c9f4147f tempest-VolumesActionsTest-678062019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:59:21 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-ccc39651-10b9-465e-bc62-7675c9f4147f tempest-VolumesActionsTest-678062019 None] Selected osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 as target Quobyte volume. {{(pid=81771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 17:59:21 devstack cinder-volume[81771]: INFO cinder.volume.drivers.remotefs [None req-ccc39651-10b9-465e-bc62-7675c9f4147f tempest-VolumesActionsTest-678062019 None] casted to osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 Apr 22 17:59:21 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-ccc39651-10b9-465e-bc62-7675c9f4147f tempest-VolumesActionsTest-678062019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-0c3cd91a-c608-4154-9648-696af103d8bb 1073741824 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:59:21 devstack sudo[89783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-0c3cd91a-c608-4154-9648-696af103d8bb 1073741824 Apr 22 17:59:21 devstack sudo[89783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:59:21 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-f6ad4fa4-a240-4c1d-9689-9ca8cf16c122 tempest-SnapshotDependencyTests-1971789782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ebedad3-046e-45f4-b80f-23aef46a325f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afdc1c40-0696-4fad-b24e-ae0e2c2ef97f', 'volume_size': 1, 'snapshot_id': 'c644ad89-1fa7-4cef-b7be-d6f5f80e0951'}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:59:21 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-f6ad4fa4-a240-4c1d-9689-9ca8cf16c122 tempest-SnapshotDependencyTests-1971789782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ed3c053-058c-43b0-98a0-2b99da0ac57d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:59:21 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-f6ad4fa4-a240-4c1d-9689-9ca8cf16c122 tempest-SnapshotDependencyTests-1971789782 None] Volume volume-afdc1c40-0696-4fad-b24e-ae0e2c2ef97f (afdc1c40-0696-4fad-b24e-ae0e2c2ef97f): created successfully Apr 22 17:59:21 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-f6ad4fa4-a240-4c1d-9689-9ca8cf16c122 tempest-SnapshotDependencyTests-1971789782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ed3c053-058c-43b0-98a0-2b99da0ac57d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:59:21 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-f6ad4fa4-a240-4c1d-9689-9ca8cf16c122 tempest-SnapshotDependencyTests-1971789782 None] Flow 'volume_create_manager' (91d4b79b-65a6-4b2a-8a47-fce5116df52a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:59:21 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-f6ad4fa4-a240-4c1d-9689-9ca8cf16c122 tempest-SnapshotDependencyTests-1971789782 None] Created volume successfully. Apr 22 17:59:21 devstack sudo[89780]: pam_unix(sudo:session): session closed for user root Apr 22 17:59:21 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-6e04b230-f3ef-49af-8794-42fa1f992eb4 tempest-VolumesSnapshotTestJSON-1790417655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33" returned: 0 in 0.528s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:59:21 devstack cinder-volume[81771]: DEBUG cinder.manager [None req-6e04b230-f3ef-49af-8794-42fa1f992eb4 tempest-VolumesSnapshotTestJSON-1790417655 None] Notifying Schedulers of capabilities ... {{(pid=81771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 17:59:21 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-6e04b230-f3ef-49af-8794-42fa1f992eb4 tempest-VolumesSnapshotTestJSON-1790417655 None] Deleted volume successfully. Apr 22 17:59:21 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-6e04b230-f3ef-49af-8794-42fa1f992eb4 tempest-VolumesSnapshotTestJSON-1790417655 None] Lock "cinder-de7f585b-1457-43df-9fef-6a683d2f7884-delete_volume" released by "delete_volume" :: held 2.130s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:59:21 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-b8772dc2-8600-40dd-8343-c52417b0edd3 tempest-SnapshotDependencyTests-1971789782 None] Acquiring lock "cinder-c644ad89-1fa7-4cef-b7be-d6f5f80e0951-delete_snapshot" by "delete_snapshot" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:59:21 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-b8772dc2-8600-40dd-8343-c52417b0edd3 tempest-SnapshotDependencyTests-1971789782 None] Lock "cinder-c644ad89-1fa7-4cef-b7be-d6f5f80e0951-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:59:21 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-b8772dc2-8600-40dd-8343-c52417b0edd3 tempest-SnapshotDependencyTests-1971789782 None] Acquiring lock "cinder-quobyte-45a0be4d-13a9-4fca-8c04-36014a3f3020" by "delete_snapshot" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:59:21 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-b8772dc2-8600-40dd-8343-c52417b0edd3 tempest-SnapshotDependencyTests-1971789782 None] Lock "cinder-quobyte-45a0be4d-13a9-4fca-8c04-36014a3f3020" acquired by "delete_snapshot" :: waited 0.018s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:59:21 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-b8772dc2-8600-40dd-8343-c52417b0edd3 tempest-SnapshotDependencyTests-1971789782 None] Acquiring lock "cinder-quobyte-c644ad89-1fa7-4cef-b7be-d6f5f80e0951" by "_delete_snapshot" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:59:21 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-b8772dc2-8600-40dd-8343-c52417b0edd3 tempest-SnapshotDependencyTests-1971789782 None] Lock "cinder-quobyte-c644ad89-1fa7-4cef-b7be-d6f5f80e0951" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:59:21 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-b8772dc2-8600-40dd-8343-c52417b0edd3 tempest-SnapshotDependencyTests-1971789782 None] Deleting offline snapshot c644ad89-1fa7-4cef-b7be-d6f5f80e0951 of volume 45a0be4d-13a9-4fca-8c04-36014a3f3020 {{(pid=81771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 22 17:59:21 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-b8772dc2-8600-40dd-8343-c52417b0edd3 tempest-SnapshotDependencyTests-1971789782 None] snapshot_file for this snap is: volume-45a0be4d-13a9-4fca-8c04-36014a3f3020.c644ad89-1fa7-4cef-b7be-d6f5f80e0951 {{(pid=81771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 22 17:59:21 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[1537e1b4-4f51-4558-b4f1-b8d99ffe2671]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:59:21 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-b8772dc2-8600-40dd-8343-c52417b0edd3 tempest-SnapshotDependencyTests-1971789782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-45a0be4d-13a9-4fca-8c04-36014a3f3020.c644ad89-1fa7-4cef-b7be-d6f5f80e0951 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:59:21 devstack sudo[89786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-45a0be4d-13a9-4fca-8c04-36014a3f3020.c644ad89-1fa7-4cef-b7be-d6f5f80e0951 Apr 22 17:59:21 devstack sudo[89786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:59:21 devstack sudo[89783]: pam_unix(sudo:session): session closed for user root Apr 22 17:59:21 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-ccc39651-10b9-465e-bc62-7675c9f4147f tempest-VolumesActionsTest-678062019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-0c3cd91a-c608-4154-9648-696af103d8bb 1073741824" returned: 0 in 0.714s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:59:21 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-ccc39651-10b9-465e-bc62-7675c9f4147f tempest-VolumesActionsTest-678062019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-0c3cd91a-c608-4154-9648-696af103d8bb {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:59:21 devstack sudo[89791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-0c3cd91a-c608-4154-9648-696af103d8bb Apr 22 17:59:21 devstack sudo[89791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:59:22 devstack sudo[89786]: pam_unix(sudo:session): session closed for user root Apr 22 17:59:22 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-b8772dc2-8600-40dd-8343-c52417b0edd3 tempest-SnapshotDependencyTests-1971789782 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-45a0be4d-13a9-4fca-8c04-36014a3f3020.c644ad89-1fa7-4cef-b7be-d6f5f80e0951" returned: 0 in 0.704s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:59:22 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-b8772dc2-8600-40dd-8343-c52417b0edd3 tempest-SnapshotDependencyTests-1971789782 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-45a0be4d-13a9-4fca-8c04-36014a3f3020(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81771) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 22 17:59:22 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fcff053-3bd6-458f-b101-a87bed4a6b52]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:59:22 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-b8772dc2-8600-40dd-8343-c52417b0edd3 tempest-SnapshotDependencyTests-1971789782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-45a0be4d-13a9-4fca-8c04-36014a3f3020 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:59:22 devstack sudo[89797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-45a0be4d-13a9-4fca-8c04-36014a3f3020 Apr 22 17:59:22 devstack sudo[89797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:59:22 devstack sudo[89791]: pam_unix(sudo:session): session closed for user root Apr 22 17:59:22 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-ccc39651-10b9-465e-bc62-7675c9f4147f tempest-VolumesActionsTest-678062019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-0c3cd91a-c608-4154-9648-696af103d8bb" returned: 0 in 0.585s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:59:22 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-ccc39651-10b9-465e-bc62-7675c9f4147f tempest-VolumesActionsTest-678062019 None] <== create_volume: return (1341ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'} {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 17:59:22 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-ccc39651-10b9-465e-bc62-7675c9f4147f tempest-VolumesActionsTest-678062019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.345s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:59:22 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-ccc39651-10b9-465e-bc62-7675c9f4147f tempest-VolumesActionsTest-678062019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8d06545-4e0f-4e4e-9932-31ff65374a23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c3cd91a-c608-4154-9648-696af103d8bb', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:59:22 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-ccc39651-10b9-465e-bc62-7675c9f4147f tempest-VolumesActionsTest-678062019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5da467fe-0b1e-4a00-9ae7-8719c76509aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:59:22 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-ccc39651-10b9-465e-bc62-7675c9f4147f tempest-VolumesActionsTest-678062019 None] Volume volume-0c3cd91a-c608-4154-9648-696af103d8bb (0c3cd91a-c608-4154-9648-696af103d8bb): created successfully Apr 22 17:59:22 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-ccc39651-10b9-465e-bc62-7675c9f4147f tempest-VolumesActionsTest-678062019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5da467fe-0b1e-4a00-9ae7-8719c76509aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:59:22 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-ccc39651-10b9-465e-bc62-7675c9f4147f tempest-VolumesActionsTest-678062019 None] Flow 'volume_create_manager' (a8aa7e81-eefd-4f6f-b971-f3d0a3883b21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:59:22 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-ccc39651-10b9-465e-bc62-7675c9f4147f tempest-VolumesActionsTest-678062019 None] Created volume successfully. Apr 22 17:59:22 devstack sudo[89797]: pam_unix(sudo:session): session closed for user root Apr 22 17:59:22 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-b8772dc2-8600-40dd-8343-c52417b0edd3 tempest-SnapshotDependencyTests-1971789782 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-45a0be4d-13a9-4fca-8c04-36014a3f3020" returned: 0 in 0.657s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:59:22 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-b8772dc2-8600-40dd-8343-c52417b0edd3 tempest-SnapshotDependencyTests-1971789782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-45a0be4d-13a9-4fca-8c04-36014a3f3020.c644ad89-1fa7-4cef-b7be-d6f5f80e0951 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:59:22 devstack sudo[89803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-45a0be4d-13a9-4fca-8c04-36014a3f3020.c644ad89-1fa7-4cef-b7be-d6f5f80e0951 Apr 22 17:59:22 devstack sudo[89803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:59:23 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-0ea7fd9a-cca1-4025-809c-85162ae2847c tempest-VolumesActionsTest-678062019 None] Acquiring lock "cinder-0c3cd91a-c608-4154-9648-696af103d8bb-delete_volume" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:59:23 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-0ea7fd9a-cca1-4025-809c-85162ae2847c tempest-VolumesActionsTest-678062019 None] Lock "cinder-0c3cd91a-c608-4154-9648-696af103d8bb-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:59:23 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-0ea7fd9a-cca1-4025-809c-85162ae2847c tempest-VolumesActionsTest-678062019 None] Acquiring lock "cinder-quobyte-0c3cd91a-c608-4154-9648-696af103d8bb" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:59:23 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-0ea7fd9a-cca1-4025-809c-85162ae2847c tempest-VolumesActionsTest-678062019 None] Lock "cinder-quobyte-0c3cd91a-c608-4154-9648-696af103d8bb" acquired by "delete_volume" :: waited 0.021s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:59:23 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecc8c911-7515-4055-8e00-babafda8a066]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:59:23 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-0ea7fd9a-cca1-4025-809c-85162ae2847c tempest-VolumesActionsTest-678062019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-0c3cd91a-c608-4154-9648-696af103d8bb {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:59:23 devstack sudo[89809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-0c3cd91a-c608-4154-9648-696af103d8bb Apr 22 17:59:23 devstack sudo[89809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:59:23 devstack sudo[89803]: pam_unix(sudo:session): session closed for user root Apr 22 17:59:23 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-b8772dc2-8600-40dd-8343-c52417b0edd3 tempest-SnapshotDependencyTests-1971789782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-45a0be4d-13a9-4fca-8c04-36014a3f3020.c644ad89-1fa7-4cef-b7be-d6f5f80e0951" returned: 0 in 0.763s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:59:23 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-b8772dc2-8600-40dd-8343-c52417b0edd3 tempest-SnapshotDependencyTests-1971789782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-45a0be4d-13a9-4fca-8c04-36014a3f3020.c644ad89-1fa7-4cef-b7be-d6f5f80e0951 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:59:23 devstack sudo[89811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-45a0be4d-13a9-4fca-8c04-36014a3f3020.c644ad89-1fa7-4cef-b7be-d6f5f80e0951 Apr 22 17:59:23 devstack sudo[89811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:59:24 devstack sudo[89809]: pam_unix(sudo:session): session closed for user root Apr 22 17:59:24 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-0ea7fd9a-cca1-4025-809c-85162ae2847c tempest-VolumesActionsTest-678062019 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-0c3cd91a-c608-4154-9648-696af103d8bb" returned: 0 in 0.730s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:59:24 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-0ea7fd9a-cca1-4025-809c-85162ae2847c tempest-VolumesActionsTest-678062019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-0c3cd91a-c608-4154-9648-696af103d8bb {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:59:24 devstack sudo[89811]: pam_unix(sudo:session): session closed for user root Apr 22 17:59:24 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-b8772dc2-8600-40dd-8343-c52417b0edd3 tempest-SnapshotDependencyTests-1971789782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-45a0be4d-13a9-4fca-8c04-36014a3f3020.c644ad89-1fa7-4cef-b7be-d6f5f80e0951" returned: 0 in 0.550s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:59:24 devstack sudo[89817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-0c3cd91a-c608-4154-9648-696af103d8bb Apr 22 17:59:24 devstack sudo[89817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:59:24 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-b8772dc2-8600-40dd-8343-c52417b0edd3 tempest-SnapshotDependencyTests-1971789782 None] Lock "cinder-quobyte-c644ad89-1fa7-4cef-b7be-d6f5f80e0951" released by "_delete_snapshot" :: held 2.810s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:59:24 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-b8772dc2-8600-40dd-8343-c52417b0edd3 tempest-SnapshotDependencyTests-1971789782 None] Lock "cinder-quobyte-45a0be4d-13a9-4fca-8c04-36014a3f3020" released by "delete_snapshot" :: held 2.838s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:59:24 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-b8772dc2-8600-40dd-8343-c52417b0edd3 tempest-SnapshotDependencyTests-1971789782 None] Created reservations ['c0137e6a-3d32-4e97-a113-d73f222909a3', 'dbdc6ea9-13dc-4b2d-91cf-12cc6e33e9eb', '304fe3a8-97fc-49b4-a75c-c866c185f106', '87f42858-1d8c-4551-806f-331d489fc9e1'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 17:59:24 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-b8772dc2-8600-40dd-8343-c52417b0edd3 tempest-SnapshotDependencyTests-1971789782 None] Delete snapshot completed successfully. Apr 22 17:59:24 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-b8772dc2-8600-40dd-8343-c52417b0edd3 tempest-SnapshotDependencyTests-1971789782 None] Lock "cinder-c644ad89-1fa7-4cef-b7be-d6f5f80e0951-delete_snapshot" released by "delete_snapshot" :: held 2.969s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:59:24 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-198bab30-6fb3-48da-a64a-6b899a958baf tempest-SnapshotDependencyTests-1971789782 None] Acquiring lock "cinder-45a0be4d-13a9-4fca-8c04-36014a3f3020-delete_volume" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:59:24 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-198bab30-6fb3-48da-a64a-6b899a958baf tempest-SnapshotDependencyTests-1971789782 None] Lock "cinder-45a0be4d-13a9-4fca-8c04-36014a3f3020-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:59:24 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-198bab30-6fb3-48da-a64a-6b899a958baf tempest-SnapshotDependencyTests-1971789782 None] Acquiring lock "cinder-quobyte-45a0be4d-13a9-4fca-8c04-36014a3f3020" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:59:24 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-198bab30-6fb3-48da-a64a-6b899a958baf tempest-SnapshotDependencyTests-1971789782 None] Lock "cinder-quobyte-45a0be4d-13a9-4fca-8c04-36014a3f3020" acquired by "delete_volume" :: waited 0.017s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:59:24 devstack sudo[89817]: pam_unix(sudo:session): session closed for user root Apr 22 17:59:24 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-0ea7fd9a-cca1-4025-809c-85162ae2847c tempest-VolumesActionsTest-678062019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-0c3cd91a-c608-4154-9648-696af103d8bb" returned: 0 in 0.569s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:59:24 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[53c98b75-5794-4b80-8eef-6545493ee0d3]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:59:24 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-0ea7fd9a-cca1-4025-809c-85162ae2847c tempest-VolumesActionsTest-678062019 None] Lock "cinder-quobyte-0c3cd91a-c608-4154-9648-696af103d8bb" released by "delete_volume" :: held 1.353s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:59:24 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-198bab30-6fb3-48da-a64a-6b899a958baf tempest-SnapshotDependencyTests-1971789782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-45a0be4d-13a9-4fca-8c04-36014a3f3020 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:59:24 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-0ea7fd9a-cca1-4025-809c-85162ae2847c tempest-VolumesActionsTest-678062019 None] Created reservations ['1e98ec40-15df-47c6-9de8-86c9cadaf586', 'f09c9f6f-dd57-4477-a012-a4fa867fa956', 'f69a8eaf-3f47-49f8-b581-29aef70ff357', 'fa31dd29-a3c3-48b2-a59d-e1d11665dd62'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 17:59:24 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-0ea7fd9a-cca1-4025-809c-85162ae2847c tempest-VolumesActionsTest-678062019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:59:24 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-0ea7fd9a-cca1-4025-809c-85162ae2847c tempest-VolumesActionsTest-678062019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:59:24 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-0ea7fd9a-cca1-4025-809c-85162ae2847c tempest-VolumesActionsTest-678062019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:59:24 devstack sudo[89820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-45a0be4d-13a9-4fca-8c04-36014a3f3020 Apr 22 17:59:24 devstack sudo[89820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:59:24 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-0ea7fd9a-cca1-4025-809c-85162ae2847c tempest-VolumesActionsTest-678062019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:59:24 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-0ea7fd9a-cca1-4025-809c-85162ae2847c tempest-VolumesActionsTest-678062019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:59:24 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-0ea7fd9a-cca1-4025-809c-85162ae2847c tempest-VolumesActionsTest-678062019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:59:25 devstack sudo[89822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 Apr 22 17:59:25 devstack sudo[89822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:59:25 devstack sudo[89820]: pam_unix(sudo:session): session closed for user root Apr 22 17:59:25 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-198bab30-6fb3-48da-a64a-6b899a958baf tempest-SnapshotDependencyTests-1971789782 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-45a0be4d-13a9-4fca-8c04-36014a3f3020" returned: 0 in 0.621s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:59:25 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-198bab30-6fb3-48da-a64a-6b899a958baf tempest-SnapshotDependencyTests-1971789782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-45a0be4d-13a9-4fca-8c04-36014a3f3020 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:59:25 devstack sudo[89829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-45a0be4d-13a9-4fca-8c04-36014a3f3020 Apr 22 17:59:25 devstack sudo[89829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:59:25 devstack sudo[89822]: pam_unix(sudo:session): session closed for user root Apr 22 17:59:25 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-0ea7fd9a-cca1-4025-809c-85162ae2847c tempest-VolumesActionsTest-678062019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33" returned: 0 in 0.620s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:59:25 devstack cinder-volume[81771]: DEBUG cinder.manager [None req-0ea7fd9a-cca1-4025-809c-85162ae2847c tempest-VolumesActionsTest-678062019 None] Notifying Schedulers of capabilities ... {{(pid=81771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 17:59:25 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-0ea7fd9a-cca1-4025-809c-85162ae2847c tempest-VolumesActionsTest-678062019 None] Deleted volume successfully. Apr 22 17:59:25 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-0ea7fd9a-cca1-4025-809c-85162ae2847c tempest-VolumesActionsTest-678062019 None] Lock "cinder-0c3cd91a-c608-4154-9648-696af103d8bb-delete_volume" released by "delete_volume" :: held 2.195s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:59:26 devstack sudo[89829]: pam_unix(sudo:session): session closed for user root Apr 22 17:59:26 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-198bab30-6fb3-48da-a64a-6b899a958baf tempest-SnapshotDependencyTests-1971789782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-45a0be4d-13a9-4fca-8c04-36014a3f3020" returned: 0 in 0.625s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:59:26 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-198bab30-6fb3-48da-a64a-6b899a958baf tempest-SnapshotDependencyTests-1971789782 None] Lock "cinder-quobyte-45a0be4d-13a9-4fca-8c04-36014a3f3020" released by "delete_volume" :: held 1.328s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:59:26 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-198bab30-6fb3-48da-a64a-6b899a958baf tempest-SnapshotDependencyTests-1971789782 None] Created reservations ['e3aeb084-5988-4656-8c3c-a859b0595e77', '38f25de3-4cce-4e79-87dc-ad499c40abfb', '3cc9b05d-9d70-48ed-ad81-e7668e42e889', 'b1ce9753-9bc3-45ff-9eab-c77813a7fd9c'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 17:59:26 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-198bab30-6fb3-48da-a64a-6b899a958baf tempest-SnapshotDependencyTests-1971789782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:59:26 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-198bab30-6fb3-48da-a64a-6b899a958baf tempest-SnapshotDependencyTests-1971789782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:59:26 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-198bab30-6fb3-48da-a64a-6b899a958baf tempest-SnapshotDependencyTests-1971789782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:59:26 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-198bab30-6fb3-48da-a64a-6b899a958baf tempest-SnapshotDependencyTests-1971789782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:59:26 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-198bab30-6fb3-48da-a64a-6b899a958baf tempest-SnapshotDependencyTests-1971789782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:59:26 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-198bab30-6fb3-48da-a64a-6b899a958baf tempest-SnapshotDependencyTests-1971789782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:59:26 devstack sudo[89832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 Apr 22 17:59:26 devstack sudo[89832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:59:26 devstack sudo[89832]: pam_unix(sudo:session): session closed for user root Apr 22 17:59:26 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-198bab30-6fb3-48da-a64a-6b899a958baf tempest-SnapshotDependencyTests-1971789782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33" returned: 0 in 0.593s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:59:26 devstack cinder-volume[81771]: DEBUG cinder.manager [None req-198bab30-6fb3-48da-a64a-6b899a958baf tempest-SnapshotDependencyTests-1971789782 None] Notifying Schedulers of capabilities ... {{(pid=81771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 17:59:26 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-198bab30-6fb3-48da-a64a-6b899a958baf tempest-SnapshotDependencyTests-1971789782 None] Deleted volume successfully. Apr 22 17:59:26 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-198bab30-6fb3-48da-a64a-6b899a958baf tempest-SnapshotDependencyTests-1971789782 None] Lock "cinder-45a0be4d-13a9-4fca-8c04-36014a3f3020-delete_volume" released by "delete_volume" :: held 2.165s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:59:27 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-b2f42754-2bf6-49df-8b5f-704ec41101e3 tempest-SnapshotDependencyTests-1971789782 None] Acquiring lock "cinder-afdc1c40-0696-4fad-b24e-ae0e2c2ef97f-delete_volume" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:59:27 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-b2f42754-2bf6-49df-8b5f-704ec41101e3 tempest-SnapshotDependencyTests-1971789782 None] Lock "cinder-afdc1c40-0696-4fad-b24e-ae0e2c2ef97f-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:59:27 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-b2f42754-2bf6-49df-8b5f-704ec41101e3 tempest-SnapshotDependencyTests-1971789782 None] Acquiring lock "cinder-quobyte-afdc1c40-0696-4fad-b24e-ae0e2c2ef97f" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:59:27 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-b2f42754-2bf6-49df-8b5f-704ec41101e3 tempest-SnapshotDependencyTests-1971789782 None] Lock "cinder-quobyte-afdc1c40-0696-4fad-b24e-ae0e2c2ef97f" acquired by "delete_volume" :: waited 0.022s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:59:27 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[95339310-641c-4c08-bcf0-2e90e1ded4d1]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:59:27 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-b2f42754-2bf6-49df-8b5f-704ec41101e3 tempest-SnapshotDependencyTests-1971789782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-afdc1c40-0696-4fad-b24e-ae0e2c2ef97f {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:59:27 devstack sudo[89836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-afdc1c40-0696-4fad-b24e-ae0e2c2ef97f Apr 22 17:59:27 devstack sudo[89836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:59:27 devstack sudo[89836]: pam_unix(sudo:session): session closed for user root Apr 22 17:59:27 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-b2f42754-2bf6-49df-8b5f-704ec41101e3 tempest-SnapshotDependencyTests-1971789782 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-afdc1c40-0696-4fad-b24e-ae0e2c2ef97f" returned: 0 in 0.687s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:59:27 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-b2f42754-2bf6-49df-8b5f-704ec41101e3 tempest-SnapshotDependencyTests-1971789782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-afdc1c40-0696-4fad-b24e-ae0e2c2ef97f {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:59:27 devstack sudo[89841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-afdc1c40-0696-4fad-b24e-ae0e2c2ef97f Apr 22 17:59:27 devstack sudo[89841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:59:28 devstack cinder-volume[81771]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f0683bd-cb61-412e-9461-3962d8706f4e tempest-VolumesSnapshotListTestJSON-765344525 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 17:59:28 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-7f0683bd-cb61-412e-9461-3962d8706f4e tempest-VolumesSnapshotListTestJSON-765344525 None] Flow 'volume_create_manager' (42b8a5e6-b894-4526-9490-8fea1c585cba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:59:28 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-7f0683bd-cb61-412e-9461-3962d8706f4e tempest-VolumesSnapshotListTestJSON-765344525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79ea416e-c95a-45ce-8d5e-ee9716a5e3ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:59:28 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-7f0683bd-cb61-412e-9461-3962d8706f4e tempest-VolumesSnapshotListTestJSON-765344525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79ea416e-c95a-45ce-8d5e-ee9716a5e3ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:59:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-751079780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5bd6775-b75d-401e-b1a0-065f4cc4f4ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b12972a3fa084a388fdb8af849388336',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:59:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:59:28Z,use_quota=True,user_id='3f58c8d139164db7b10d2188b2b015c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:59:28 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-7f0683bd-cb61-412e-9461-3962d8706f4e tempest-VolumesSnapshotListTestJSON-765344525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a626bc2-c1f2-4907-9c93-1bb2456c763e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:59:28 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-7f0683bd-cb61-412e-9461-3962d8706f4e tempest-VolumesSnapshotListTestJSON-765344525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a626bc2-c1f2-4907-9c93-1bb2456c763e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:59:28 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-7f0683bd-cb61-412e-9461-3962d8706f4e tempest-VolumesSnapshotListTestJSON-765344525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76754e4d-3ce2-41a0-b13a-6efc6b1fdafe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:59:28 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-7f0683bd-cb61-412e-9461-3962d8706f4e tempest-VolumesSnapshotListTestJSON-765344525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76754e4d-3ce2-41a0-b13a-6efc6b1fdafe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5bd6775-b75d-401e-b1a0-065f4cc4f4ad', 'volume_name': 'volume-e5bd6775-b75d-401e-b1a0-065f4cc4f4ad', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:59:28 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-7f0683bd-cb61-412e-9461-3962d8706f4e tempest-VolumesSnapshotListTestJSON-765344525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c2af202-48bb-47f7-bd0e-f8b51c287da1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:59:28 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-7f0683bd-cb61-412e-9461-3962d8706f4e tempest-VolumesSnapshotListTestJSON-765344525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c2af202-48bb-47f7-bd0e-f8b51c287da1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:59:28 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-7f0683bd-cb61-412e-9461-3962d8706f4e tempest-VolumesSnapshotListTestJSON-765344525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7285a93-0d91-4e21-b9d8-549f416147ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:59:28 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-7f0683bd-cb61-412e-9461-3962d8706f4e tempest-VolumesSnapshotListTestJSON-765344525 None] Volume e5bd6775-b75d-401e-b1a0-065f4cc4f4ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5bd6775-b75d-401e-b1a0-065f4cc4f4ad', 'volume_size': 1} Apr 22 17:59:28 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-7f0683bd-cb61-412e-9461-3962d8706f4e tempest-VolumesSnapshotListTestJSON-765344525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:59:28 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-7f0683bd-cb61-412e-9461-3962d8706f4e tempest-VolumesSnapshotListTestJSON-765344525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:59:28 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-7f0683bd-cb61-412e-9461-3962d8706f4e tempest-VolumesSnapshotListTestJSON-765344525 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:59:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-751079780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5bd6775-b75d-401e-b1a0-065f4cc4f4ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b12972a3fa084a388fdb8af849388336',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:59:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:59:28Z,use_quota=True,user_id='3f58c8d139164db7b10d2188b2b015c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)}" {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 17:59:28 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-7f0683bd-cb61-412e-9461-3962d8706f4e tempest-VolumesSnapshotListTestJSON-765344525 None] Creating volume e5bd6775-b75d-401e-b1a0-065f4cc4f4ad {{(pid=81771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 17:59:28 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-7f0683bd-cb61-412e-9461-3962d8706f4e tempest-VolumesSnapshotListTestJSON-765344525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:59:28 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-7f0683bd-cb61-412e-9461-3962d8706f4e tempest-VolumesSnapshotListTestJSON-765344525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:59:28 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-7f0683bd-cb61-412e-9461-3962d8706f4e tempest-VolumesSnapshotListTestJSON-765344525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:59:28 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-7f0683bd-cb61-412e-9461-3962d8706f4e tempest-VolumesSnapshotListTestJSON-765344525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:59:28 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-7f0683bd-cb61-412e-9461-3962d8706f4e tempest-VolumesSnapshotListTestJSON-765344525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:59:28 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-7f0683bd-cb61-412e-9461-3962d8706f4e tempest-VolumesSnapshotListTestJSON-765344525 None] Selected osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 as target Quobyte volume. {{(pid=81771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 17:59:28 devstack cinder-volume[81771]: INFO cinder.volume.drivers.remotefs [None req-7f0683bd-cb61-412e-9461-3962d8706f4e tempest-VolumesSnapshotListTestJSON-765344525 None] casted to osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 Apr 22 17:59:28 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-7f0683bd-cb61-412e-9461-3962d8706f4e tempest-VolumesSnapshotListTestJSON-765344525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e5bd6775-b75d-401e-b1a0-065f4cc4f4ad 1073741824 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:59:28 devstack sudo[89843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e5bd6775-b75d-401e-b1a0-065f4cc4f4ad 1073741824 Apr 22 17:59:28 devstack sudo[89843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:59:28 devstack sudo[89841]: pam_unix(sudo:session): session closed for user root Apr 22 17:59:28 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-b2f42754-2bf6-49df-8b5f-704ec41101e3 tempest-SnapshotDependencyTests-1971789782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-afdc1c40-0696-4fad-b24e-ae0e2c2ef97f" returned: 0 in 0.556s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:59:28 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-b2f42754-2bf6-49df-8b5f-704ec41101e3 tempest-SnapshotDependencyTests-1971789782 None] Lock "cinder-quobyte-afdc1c40-0696-4fad-b24e-ae0e2c2ef97f" released by "delete_volume" :: held 1.295s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:59:28 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-b2f42754-2bf6-49df-8b5f-704ec41101e3 tempest-SnapshotDependencyTests-1971789782 None] Created reservations ['c0f2156c-f75d-4dde-b16b-cadc358f9ddf', 'd6a70020-49b8-46e2-8547-948a7f0e3b2e', '16688cde-c157-4bfe-961d-ff182e011972', '25fbc662-9697-458a-a600-e66338c573ee'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 17:59:28 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-b2f42754-2bf6-49df-8b5f-704ec41101e3 tempest-SnapshotDependencyTests-1971789782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:59:28 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-b2f42754-2bf6-49df-8b5f-704ec41101e3 tempest-SnapshotDependencyTests-1971789782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:59:28 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-b2f42754-2bf6-49df-8b5f-704ec41101e3 tempest-SnapshotDependencyTests-1971789782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:59:28 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-b2f42754-2bf6-49df-8b5f-704ec41101e3 tempest-SnapshotDependencyTests-1971789782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:59:28 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-b2f42754-2bf6-49df-8b5f-704ec41101e3 tempest-SnapshotDependencyTests-1971789782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:59:28 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-b2f42754-2bf6-49df-8b5f-704ec41101e3 tempest-SnapshotDependencyTests-1971789782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:59:28 devstack sudo[89847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 Apr 22 17:59:28 devstack sudo[89847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:59:28 devstack sudo[89843]: pam_unix(sudo:session): session closed for user root Apr 22 17:59:28 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-7f0683bd-cb61-412e-9461-3962d8706f4e tempest-VolumesSnapshotListTestJSON-765344525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e5bd6775-b75d-401e-b1a0-065f4cc4f4ad 1073741824" returned: 0 in 0.731s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:59:28 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-7f0683bd-cb61-412e-9461-3962d8706f4e tempest-VolumesSnapshotListTestJSON-765344525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e5bd6775-b75d-401e-b1a0-065f4cc4f4ad {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:59:28 devstack sudo[89852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e5bd6775-b75d-401e-b1a0-065f4cc4f4ad Apr 22 17:59:28 devstack sudo[89852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:59:29 devstack sudo[89847]: pam_unix(sudo:session): session closed for user root Apr 22 17:59:29 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-b2f42754-2bf6-49df-8b5f-704ec41101e3 tempest-SnapshotDependencyTests-1971789782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33" returned: 0 in 0.595s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:59:29 devstack cinder-volume[81771]: DEBUG cinder.manager [None req-b2f42754-2bf6-49df-8b5f-704ec41101e3 tempest-SnapshotDependencyTests-1971789782 None] Notifying Schedulers of capabilities ... {{(pid=81771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 17:59:29 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-b2f42754-2bf6-49df-8b5f-704ec41101e3 tempest-SnapshotDependencyTests-1971789782 None] Deleted volume successfully. Apr 22 17:59:29 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-b2f42754-2bf6-49df-8b5f-704ec41101e3 tempest-SnapshotDependencyTests-1971789782 None] Lock "cinder-afdc1c40-0696-4fad-b24e-ae0e2c2ef97f-delete_volume" released by "delete_volume" :: held 2.137s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:59:29 devstack sudo[89852]: pam_unix(sudo:session): session closed for user root Apr 22 17:59:29 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-7f0683bd-cb61-412e-9461-3962d8706f4e tempest-VolumesSnapshotListTestJSON-765344525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e5bd6775-b75d-401e-b1a0-065f4cc4f4ad" returned: 0 in 0.593s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:59:29 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-7f0683bd-cb61-412e-9461-3962d8706f4e tempest-VolumesSnapshotListTestJSON-765344525 None] <== create_volume: return (1367ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'} {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 17:59:29 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-7f0683bd-cb61-412e-9461-3962d8706f4e tempest-VolumesSnapshotListTestJSON-765344525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.369s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:59:29 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-7f0683bd-cb61-412e-9461-3962d8706f4e tempest-VolumesSnapshotListTestJSON-765344525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7285a93-0d91-4e21-b9d8-549f416147ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5bd6775-b75d-401e-b1a0-065f4cc4f4ad', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:59:29 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-7f0683bd-cb61-412e-9461-3962d8706f4e tempest-VolumesSnapshotListTestJSON-765344525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09e00b7d-70bf-4caf-8087-12a49ed6493e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:59:29 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-7f0683bd-cb61-412e-9461-3962d8706f4e tempest-VolumesSnapshotListTestJSON-765344525 None] Volume volume-e5bd6775-b75d-401e-b1a0-065f4cc4f4ad (e5bd6775-b75d-401e-b1a0-065f4cc4f4ad): created successfully Apr 22 17:59:29 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-7f0683bd-cb61-412e-9461-3962d8706f4e tempest-VolumesSnapshotListTestJSON-765344525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09e00b7d-70bf-4caf-8087-12a49ed6493e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:59:29 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-7f0683bd-cb61-412e-9461-3962d8706f4e tempest-VolumesSnapshotListTestJSON-765344525 None] Flow 'volume_create_manager' (42b8a5e6-b894-4526-9490-8fea1c585cba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:59:29 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-7f0683bd-cb61-412e-9461-3962d8706f4e tempest-VolumesSnapshotListTestJSON-765344525 None] Created volume successfully. Apr 22 17:59:29 devstack cinder-volume[81771]: DEBUG oslo_service.periodic_task [None req-1a7bdab5-8190-4e00-a2e2-843e5894ab49 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81771) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 22 17:59:29 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-1a7bdab5-8190-4e00-a2e2-843e5894ab49 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:59:29 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-1a7bdab5-8190-4e00-a2e2-843e5894ab49 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:59:29 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-1a7bdab5-8190-4e00-a2e2-843e5894ab49 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:59:29 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-1a7bdab5-8190-4e00-a2e2-843e5894ab49 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:59:29 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-1a7bdab5-8190-4e00-a2e2-843e5894ab49 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:59:29 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-1a7bdab5-8190-4e00-a2e2-843e5894ab49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:59:29 devstack sudo[89862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 Apr 22 17:59:29 devstack sudo[89862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:59:30 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-ec3169d9-90c2-4b7f-a943-63916429baf8 tempest-VolumesSnapshotListTestJSON-765344525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:59:30 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-ec3169d9-90c2-4b7f-a943-63916429baf8 tempest-VolumesSnapshotListTestJSON-765344525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:59:30 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-ec3169d9-90c2-4b7f-a943-63916429baf8 tempest-VolumesSnapshotListTestJSON-765344525 None] Creating offline snapshot 421c074d-1cc2-4e96-af5f-024359fcecec of volume e5bd6775-b75d-401e-b1a0-065f4cc4f4ad {{(pid=81771) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 22 17:59:30 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[049ac5c9-7d2a-4f9b-a7d8-91283244472f]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:59:30 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-ec3169d9-90c2-4b7f-a943-63916429baf8 tempest-VolumesSnapshotListTestJSON-765344525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e5bd6775-b75d-401e-b1a0-065f4cc4f4ad {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:59:30 devstack sudo[89862]: pam_unix(sudo:session): session closed for user root Apr 22 17:59:30 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-1a7bdab5-8190-4e00-a2e2-843e5894ab49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33" returned: 0 in 0.717s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:59:30 devstack cinder-volume[81771]: DEBUG cinder.manager [None req-1a7bdab5-8190-4e00-a2e2-843e5894ab49 None None] Notifying Schedulers of capabilities ... {{(pid=81771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 17:59:30 devstack sudo[89866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e5bd6775-b75d-401e-b1a0-065f4cc4f4ad Apr 22 17:59:30 devstack sudo[89866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:59:31 devstack sudo[89866]: pam_unix(sudo:session): session closed for user root Apr 22 17:59:31 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-ec3169d9-90c2-4b7f-a943-63916429baf8 tempest-VolumesSnapshotListTestJSON-765344525 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e5bd6775-b75d-401e-b1a0-065f4cc4f4ad" returned: 0 in 0.697s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:59:31 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-ec3169d9-90c2-4b7f-a943-63916429baf8 tempest-VolumesSnapshotListTestJSON-765344525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e5bd6775-b75d-401e-b1a0-065f4cc4f4ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e5bd6775-b75d-401e-b1a0-065f4cc4f4ad.421c074d-1cc2-4e96-af5f-024359fcecec 1G {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:59:31 devstack sudo[89872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e5bd6775-b75d-401e-b1a0-065f4cc4f4ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e5bd6775-b75d-401e-b1a0-065f4cc4f4ad.421c074d-1cc2-4e96-af5f-024359fcecec 1G Apr 22 17:59:31 devstack sudo[89872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:59:32 devstack sudo[89872]: pam_unix(sudo:session): session closed for user root Apr 22 17:59:32 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-ec3169d9-90c2-4b7f-a943-63916429baf8 tempest-VolumesSnapshotListTestJSON-765344525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e5bd6775-b75d-401e-b1a0-065f4cc4f4ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e5bd6775-b75d-401e-b1a0-065f4cc4f4ad.421c074d-1cc2-4e96-af5f-024359fcecec 1G" returned: 0 in 0.736s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:59:32 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-ec3169d9-90c2-4b7f-a943-63916429baf8 tempest-VolumesSnapshotListTestJSON-765344525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5bd6775-b75d-401e-b1a0-065f4cc4f4ad -F qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e5bd6775-b75d-401e-b1a0-065f4cc4f4ad.421c074d-1cc2-4e96-af5f-024359fcecec {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:59:32 devstack sudo[89877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5bd6775-b75d-401e-b1a0-065f4cc4f4ad -F qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e5bd6775-b75d-401e-b1a0-065f4cc4f4ad.421c074d-1cc2-4e96-af5f-024359fcecec Apr 22 17:59:32 devstack sudo[89877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:59:32 devstack sudo[89877]: pam_unix(sudo:session): session closed for user root Apr 22 17:59:32 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-ec3169d9-90c2-4b7f-a943-63916429baf8 tempest-VolumesSnapshotListTestJSON-765344525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5bd6775-b75d-401e-b1a0-065f4cc4f4ad -F qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e5bd6775-b75d-401e-b1a0-065f4cc4f4ad.421c074d-1cc2-4e96-af5f-024359fcecec" returned: 0 in 0.651s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:59:32 devstack cinder-volume[81771]: WARNING cinder.volume.drivers.remotefs [None req-ec3169d9-90c2-4b7f-a943-63916429baf8 tempest-VolumesSnapshotListTestJSON-765344525 None] /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e5bd6775-b75d-401e-b1a0-065f4cc4f4ad.421c074d-1cc2-4e96-af5f-024359fcecec is being set with open permissions: ugo+rw Apr 22 17:59:32 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-ec3169d9-90c2-4b7f-a943-63916429baf8 tempest-VolumesSnapshotListTestJSON-765344525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e5bd6775-b75d-401e-b1a0-065f4cc4f4ad.421c074d-1cc2-4e96-af5f-024359fcecec {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:59:32 devstack sudo[89883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e5bd6775-b75d-401e-b1a0-065f4cc4f4ad.421c074d-1cc2-4e96-af5f-024359fcecec Apr 22 17:59:32 devstack sudo[89883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:59:33 devstack sudo[89883]: pam_unix(sudo:session): session closed for user root Apr 22 17:59:33 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-ec3169d9-90c2-4b7f-a943-63916429baf8 tempest-VolumesSnapshotListTestJSON-765344525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e5bd6775-b75d-401e-b1a0-065f4cc4f4ad.421c074d-1cc2-4e96-af5f-024359fcecec" returned: 0 in 0.509s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:59:33 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-ec3169d9-90c2-4b7f-a943-63916429baf8 tempest-VolumesSnapshotListTestJSON-765344525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e5bd6775-b75d-401e-b1a0-065f4cc4f4ad.info {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:59:33 devstack sudo[89886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e5bd6775-b75d-401e-b1a0-065f4cc4f4ad.info Apr 22 17:59:33 devstack sudo[89886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:59:33 devstack sudo[89886]: pam_unix(sudo:session): session closed for user root Apr 22 17:59:33 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-ec3169d9-90c2-4b7f-a943-63916429baf8 tempest-VolumesSnapshotListTestJSON-765344525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e5bd6775-b75d-401e-b1a0-065f4cc4f4ad.info" returned: 0 in 0.608s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:59:33 devstack cinder-volume[81771]: WARNING cinder.volume.drivers.remotefs [None req-ec3169d9-90c2-4b7f-a943-63916429baf8 tempest-VolumesSnapshotListTestJSON-765344525 None] /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e5bd6775-b75d-401e-b1a0-065f4cc4f4ad.info is being set with open permissions: ugo+rw Apr 22 17:59:33 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-ec3169d9-90c2-4b7f-a943-63916429baf8 tempest-VolumesSnapshotListTestJSON-765344525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e5bd6775-b75d-401e-b1a0-065f4cc4f4ad.info {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:59:33 devstack sudo[89890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e5bd6775-b75d-401e-b1a0-065f4cc4f4ad.info Apr 22 17:59:33 devstack sudo[89890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:59:34 devstack sudo[89890]: pam_unix(sudo:session): session closed for user root Apr 22 17:59:34 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-ec3169d9-90c2-4b7f-a943-63916429baf8 tempest-VolumesSnapshotListTestJSON-765344525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e5bd6775-b75d-401e-b1a0-065f4cc4f4ad.info" returned: 0 in 0.533s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:59:34 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-ec3169d9-90c2-4b7f-a943-63916429baf8 tempest-VolumesSnapshotListTestJSON-765344525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.859s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:59:34 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-ec3169d9-90c2-4b7f-a943-63916429baf8 tempest-VolumesSnapshotListTestJSON-765344525 None] Create snapshot completed successfully Apr 22 17:59:35 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-3db611c4-1d5e-474e-ab85-0c8ace07f969 tempest-VolumesSnapshotListTestJSON-765344525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:59:35 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-3db611c4-1d5e-474e-ab85-0c8ace07f969 tempest-VolumesSnapshotListTestJSON-765344525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:59:35 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-3db611c4-1d5e-474e-ab85-0c8ace07f969 tempest-VolumesSnapshotListTestJSON-765344525 None] Creating offline snapshot 75d64286-f603-41c4-a0bf-40ed413f77e6 of volume e5bd6775-b75d-401e-b1a0-065f4cc4f4ad {{(pid=81771) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 22 17:59:35 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d596d06-2295-4929-a98b-708aec378a38]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:59:35 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-3db611c4-1d5e-474e-ab85-0c8ace07f969 tempest-VolumesSnapshotListTestJSON-765344525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e5bd6775-b75d-401e-b1a0-065f4cc4f4ad.421c074d-1cc2-4e96-af5f-024359fcecec {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:59:35 devstack sudo[89894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e5bd6775-b75d-401e-b1a0-065f4cc4f4ad.421c074d-1cc2-4e96-af5f-024359fcecec Apr 22 17:59:35 devstack sudo[89894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:59:35 devstack sudo[89894]: pam_unix(sudo:session): session closed for user root Apr 22 17:59:35 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-3db611c4-1d5e-474e-ab85-0c8ace07f969 tempest-VolumesSnapshotListTestJSON-765344525 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e5bd6775-b75d-401e-b1a0-065f4cc4f4ad.421c074d-1cc2-4e96-af5f-024359fcecec" returned: 0 in 0.657s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:59:35 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-3db611c4-1d5e-474e-ab85-0c8ace07f969 tempest-VolumesSnapshotListTestJSON-765344525 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e5bd6775-b75d-401e-b1a0-065f4cc4f4ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81771) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 22 17:59:35 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-3db611c4-1d5e-474e-ab85-0c8ace07f969 tempest-VolumesSnapshotListTestJSON-765344525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e5bd6775-b75d-401e-b1a0-065f4cc4f4ad.421c074d-1cc2-4e96-af5f-024359fcecec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e5bd6775-b75d-401e-b1a0-065f4cc4f4ad.75d64286-f603-41c4-a0bf-40ed413f77e6 1G {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:59:35 devstack sudo[89900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e5bd6775-b75d-401e-b1a0-065f4cc4f4ad.421c074d-1cc2-4e96-af5f-024359fcecec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e5bd6775-b75d-401e-b1a0-065f4cc4f4ad.75d64286-f603-41c4-a0bf-40ed413f77e6 1G Apr 22 17:59:35 devstack sudo[89900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:59:36 devstack sudo[89900]: pam_unix(sudo:session): session closed for user root Apr 22 17:59:36 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-3db611c4-1d5e-474e-ab85-0c8ace07f969 tempest-VolumesSnapshotListTestJSON-765344525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e5bd6775-b75d-401e-b1a0-065f4cc4f4ad.421c074d-1cc2-4e96-af5f-024359fcecec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e5bd6775-b75d-401e-b1a0-065f4cc4f4ad.75d64286-f603-41c4-a0bf-40ed413f77e6 1G" returned: 0 in 0.780s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:59:36 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-3db611c4-1d5e-474e-ab85-0c8ace07f969 tempest-VolumesSnapshotListTestJSON-765344525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5bd6775-b75d-401e-b1a0-065f4cc4f4ad.421c074d-1cc2-4e96-af5f-024359fcecec -F qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e5bd6775-b75d-401e-b1a0-065f4cc4f4ad.75d64286-f603-41c4-a0bf-40ed413f77e6 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:59:36 devstack sudo[89905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5bd6775-b75d-401e-b1a0-065f4cc4f4ad.421c074d-1cc2-4e96-af5f-024359fcecec -F qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e5bd6775-b75d-401e-b1a0-065f4cc4f4ad.75d64286-f603-41c4-a0bf-40ed413f77e6 Apr 22 17:59:36 devstack sudo[89905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:59:37 devstack sudo[89905]: pam_unix(sudo:session): session closed for user root Apr 22 17:59:37 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-3db611c4-1d5e-474e-ab85-0c8ace07f969 tempest-VolumesSnapshotListTestJSON-765344525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5bd6775-b75d-401e-b1a0-065f4cc4f4ad.421c074d-1cc2-4e96-af5f-024359fcecec -F qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e5bd6775-b75d-401e-b1a0-065f4cc4f4ad.75d64286-f603-41c4-a0bf-40ed413f77e6" returned: 0 in 0.643s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:59:37 devstack cinder-volume[81771]: WARNING cinder.volume.drivers.remotefs [None req-3db611c4-1d5e-474e-ab85-0c8ace07f969 tempest-VolumesSnapshotListTestJSON-765344525 None] /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e5bd6775-b75d-401e-b1a0-065f4cc4f4ad.75d64286-f603-41c4-a0bf-40ed413f77e6 is being set with open permissions: ugo+rw Apr 22 17:59:37 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-3db611c4-1d5e-474e-ab85-0c8ace07f969 tempest-VolumesSnapshotListTestJSON-765344525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e5bd6775-b75d-401e-b1a0-065f4cc4f4ad.75d64286-f603-41c4-a0bf-40ed413f77e6 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:59:37 devstack sudo[89911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e5bd6775-b75d-401e-b1a0-065f4cc4f4ad.75d64286-f603-41c4-a0bf-40ed413f77e6 Apr 22 17:59:37 devstack sudo[89911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:59:37 devstack sudo[89911]: pam_unix(sudo:session): session closed for user root Apr 22 17:59:37 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-3db611c4-1d5e-474e-ab85-0c8ace07f969 tempest-VolumesSnapshotListTestJSON-765344525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e5bd6775-b75d-401e-b1a0-065f4cc4f4ad.75d64286-f603-41c4-a0bf-40ed413f77e6" returned: 0 in 0.616s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:59:37 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-3db611c4-1d5e-474e-ab85-0c8ace07f969 tempest-VolumesSnapshotListTestJSON-765344525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.808s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:59:37 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-3db611c4-1d5e-474e-ab85-0c8ace07f969 tempest-VolumesSnapshotListTestJSON-765344525 None] Create snapshot completed successfully Apr 22 17:59:38 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-ee2bc1f1-0ed7-4085-a493-c186a8fd2a40 tempest-VolumesSnapshotListTestJSON-765344525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:59:38 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-ee2bc1f1-0ed7-4085-a493-c186a8fd2a40 tempest-VolumesSnapshotListTestJSON-765344525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:59:38 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-ee2bc1f1-0ed7-4085-a493-c186a8fd2a40 tempest-VolumesSnapshotListTestJSON-765344525 None] Creating offline snapshot 91da5aed-4781-476c-9e7a-4aaaaf7a869f of volume e5bd6775-b75d-401e-b1a0-065f4cc4f4ad {{(pid=81771) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 22 17:59:38 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[29d0dd2c-433a-44fd-b493-214c0dbd06a8]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:59:38 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-ee2bc1f1-0ed7-4085-a493-c186a8fd2a40 tempest-VolumesSnapshotListTestJSON-765344525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e5bd6775-b75d-401e-b1a0-065f4cc4f4ad.75d64286-f603-41c4-a0bf-40ed413f77e6 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:59:38 devstack sudo[89915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e5bd6775-b75d-401e-b1a0-065f4cc4f4ad.75d64286-f603-41c4-a0bf-40ed413f77e6 Apr 22 17:59:38 devstack sudo[89915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:59:39 devstack cinder-volume[81771]: DEBUG cinder.volume.flows.manager.create_volume [None req-2826e72c-9f22-414f-9dea-4eb6f17fe4e7 tempest-AbsoluteLimitsTests-1518446855 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 17:59:39 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-2826e72c-9f22-414f-9dea-4eb6f17fe4e7 tempest-AbsoluteLimitsTests-1518446855 None] Flow 'volume_create_manager' (17f6003b-1750-4004-bcaa-3be0995eebe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:59:39 devstack sudo[89915]: pam_unix(sudo:session): session closed for user root Apr 22 17:59:39 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-2826e72c-9f22-414f-9dea-4eb6f17fe4e7 tempest-AbsoluteLimitsTests-1518446855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70cb371b-1e7c-42a1-9209-47acc3f930cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:59:39 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-ee2bc1f1-0ed7-4085-a493-c186a8fd2a40 tempest-VolumesSnapshotListTestJSON-765344525 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e5bd6775-b75d-401e-b1a0-065f4cc4f4ad.75d64286-f603-41c4-a0bf-40ed413f77e6" returned: 0 in 0.741s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:59:39 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-ee2bc1f1-0ed7-4085-a493-c186a8fd2a40 tempest-VolumesSnapshotListTestJSON-765344525 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e5bd6775-b75d-401e-b1a0-065f4cc4f4ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81771) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 22 17:59:39 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-ee2bc1f1-0ed7-4085-a493-c186a8fd2a40 tempest-VolumesSnapshotListTestJSON-765344525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e5bd6775-b75d-401e-b1a0-065f4cc4f4ad.75d64286-f603-41c4-a0bf-40ed413f77e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e5bd6775-b75d-401e-b1a0-065f4cc4f4ad.91da5aed-4781-476c-9e7a-4aaaaf7a869f 1G {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:59:39 devstack sudo[89920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e5bd6775-b75d-401e-b1a0-065f4cc4f4ad.75d64286-f603-41c4-a0bf-40ed413f77e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e5bd6775-b75d-401e-b1a0-065f4cc4f4ad.91da5aed-4781-476c-9e7a-4aaaaf7a869f 1G Apr 22 17:59:39 devstack sudo[89920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:59:39 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-2826e72c-9f22-414f-9dea-4eb6f17fe4e7 tempest-AbsoluteLimitsTests-1518446855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70cb371b-1e7c-42a1-9209-47acc3f930cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:59:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1887398964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a58fefbf-8ad2-4029-8f9e-d5c75b2e3a99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88b09f145a094e9c86f798c77f99b93b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:59:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:59:39Z,use_quota=True,user_id='43e078dd8b2c4444aa3406367a7e11e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:59:39 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-2826e72c-9f22-414f-9dea-4eb6f17fe4e7 tempest-AbsoluteLimitsTests-1518446855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d532baf-f102-4164-a5f3-5dc7300089cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:59:39 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-2826e72c-9f22-414f-9dea-4eb6f17fe4e7 tempest-AbsoluteLimitsTests-1518446855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d532baf-f102-4164-a5f3-5dc7300089cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:59:39 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-2826e72c-9f22-414f-9dea-4eb6f17fe4e7 tempest-AbsoluteLimitsTests-1518446855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b303031b-ea6b-4972-a0ee-421640d10f2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:59:39 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-2826e72c-9f22-414f-9dea-4eb6f17fe4e7 tempest-AbsoluteLimitsTests-1518446855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b303031b-ea6b-4972-a0ee-421640d10f2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a58fefbf-8ad2-4029-8f9e-d5c75b2e3a99', 'volume_name': 'volume-a58fefbf-8ad2-4029-8f9e-d5c75b2e3a99', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:59:39 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-2826e72c-9f22-414f-9dea-4eb6f17fe4e7 tempest-AbsoluteLimitsTests-1518446855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6959996a-cc00-48f6-ad68-8d74553a8555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:59:39 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-2826e72c-9f22-414f-9dea-4eb6f17fe4e7 tempest-AbsoluteLimitsTests-1518446855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6959996a-cc00-48f6-ad68-8d74553a8555) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:59:39 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-2826e72c-9f22-414f-9dea-4eb6f17fe4e7 tempest-AbsoluteLimitsTests-1518446855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (942ff317-8fc2-4c9a-aeeb-cfbc67f9ad48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:59:39 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-2826e72c-9f22-414f-9dea-4eb6f17fe4e7 tempest-AbsoluteLimitsTests-1518446855 None] Volume a58fefbf-8ad2-4029-8f9e-d5c75b2e3a99: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a58fefbf-8ad2-4029-8f9e-d5c75b2e3a99', 'volume_size': 1} Apr 22 17:59:39 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-2826e72c-9f22-414f-9dea-4eb6f17fe4e7 tempest-AbsoluteLimitsTests-1518446855 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:59:39 devstack sudo[89920]: pam_unix(sudo:session): session closed for user root Apr 22 17:59:39 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-ee2bc1f1-0ed7-4085-a493-c186a8fd2a40 tempest-VolumesSnapshotListTestJSON-765344525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e5bd6775-b75d-401e-b1a0-065f4cc4f4ad.75d64286-f603-41c4-a0bf-40ed413f77e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e5bd6775-b75d-401e-b1a0-065f4cc4f4ad.91da5aed-4781-476c-9e7a-4aaaaf7a869f 1G" returned: 0 in 0.685s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:59:39 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-ee2bc1f1-0ed7-4085-a493-c186a8fd2a40 tempest-VolumesSnapshotListTestJSON-765344525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5bd6775-b75d-401e-b1a0-065f4cc4f4ad.75d64286-f603-41c4-a0bf-40ed413f77e6 -F qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e5bd6775-b75d-401e-b1a0-065f4cc4f4ad.91da5aed-4781-476c-9e7a-4aaaaf7a869f {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:59:39 devstack sudo[89925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5bd6775-b75d-401e-b1a0-065f4cc4f4ad.75d64286-f603-41c4-a0bf-40ed413f77e6 -F qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e5bd6775-b75d-401e-b1a0-065f4cc4f4ad.91da5aed-4781-476c-9e7a-4aaaaf7a869f Apr 22 17:59:39 devstack sudo[89925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:59:40 devstack sudo[89925]: pam_unix(sudo:session): session closed for user root Apr 22 17:59:40 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-ee2bc1f1-0ed7-4085-a493-c186a8fd2a40 tempest-VolumesSnapshotListTestJSON-765344525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5bd6775-b75d-401e-b1a0-065f4cc4f4ad.75d64286-f603-41c4-a0bf-40ed413f77e6 -F qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e5bd6775-b75d-401e-b1a0-065f4cc4f4ad.91da5aed-4781-476c-9e7a-4aaaaf7a869f" returned: 0 in 0.483s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:59:40 devstack cinder-volume[81771]: WARNING cinder.volume.drivers.remotefs [None req-ee2bc1f1-0ed7-4085-a493-c186a8fd2a40 tempest-VolumesSnapshotListTestJSON-765344525 None] /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e5bd6775-b75d-401e-b1a0-065f4cc4f4ad.91da5aed-4781-476c-9e7a-4aaaaf7a869f is being set with open permissions: ugo+rw Apr 22 17:59:40 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-ee2bc1f1-0ed7-4085-a493-c186a8fd2a40 tempest-VolumesSnapshotListTestJSON-765344525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e5bd6775-b75d-401e-b1a0-065f4cc4f4ad.91da5aed-4781-476c-9e7a-4aaaaf7a869f {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:59:40 devstack sudo[89930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e5bd6775-b75d-401e-b1a0-065f4cc4f4ad.91da5aed-4781-476c-9e7a-4aaaaf7a869f Apr 22 17:59:40 devstack sudo[89930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:59:40 devstack sudo[89930]: pam_unix(sudo:session): session closed for user root Apr 22 17:59:40 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-ee2bc1f1-0ed7-4085-a493-c186a8fd2a40 tempest-VolumesSnapshotListTestJSON-765344525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e5bd6775-b75d-401e-b1a0-065f4cc4f4ad.91da5aed-4781-476c-9e7a-4aaaaf7a869f" returned: 0 in 0.440s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:59:40 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-ee2bc1f1-0ed7-4085-a493-c186a8fd2a40 tempest-VolumesSnapshotListTestJSON-765344525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.502s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:59:40 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-2826e72c-9f22-414f-9dea-4eb6f17fe4e7 tempest-AbsoluteLimitsTests-1518446855 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.585s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:59:40 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-2826e72c-9f22-414f-9dea-4eb6f17fe4e7 tempest-AbsoluteLimitsTests-1518446855 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:59:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1887398964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a58fefbf-8ad2-4029-8f9e-d5c75b2e3a99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88b09f145a094e9c86f798c77f99b93b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:59:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:59:39Z,use_quota=True,user_id='43e078dd8b2c4444aa3406367a7e11e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)}" {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 17:59:40 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-2826e72c-9f22-414f-9dea-4eb6f17fe4e7 tempest-AbsoluteLimitsTests-1518446855 None] Creating volume a58fefbf-8ad2-4029-8f9e-d5c75b2e3a99 {{(pid=81771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 17:59:40 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-2826e72c-9f22-414f-9dea-4eb6f17fe4e7 tempest-AbsoluteLimitsTests-1518446855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:59:40 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-2826e72c-9f22-414f-9dea-4eb6f17fe4e7 tempest-AbsoluteLimitsTests-1518446855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:59:40 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-2826e72c-9f22-414f-9dea-4eb6f17fe4e7 tempest-AbsoluteLimitsTests-1518446855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:59:40 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-2826e72c-9f22-414f-9dea-4eb6f17fe4e7 tempest-AbsoluteLimitsTests-1518446855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:59:40 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-2826e72c-9f22-414f-9dea-4eb6f17fe4e7 tempest-AbsoluteLimitsTests-1518446855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:59:40 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-2826e72c-9f22-414f-9dea-4eb6f17fe4e7 tempest-AbsoluteLimitsTests-1518446855 None] Selected osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 as target Quobyte volume. {{(pid=81771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 17:59:40 devstack cinder-volume[81771]: INFO cinder.volume.drivers.remotefs [None req-2826e72c-9f22-414f-9dea-4eb6f17fe4e7 tempest-AbsoluteLimitsTests-1518446855 None] casted to osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 Apr 22 17:59:40 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-2826e72c-9f22-414f-9dea-4eb6f17fe4e7 tempest-AbsoluteLimitsTests-1518446855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a58fefbf-8ad2-4029-8f9e-d5c75b2e3a99 1073741824 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:59:40 devstack sudo[89933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a58fefbf-8ad2-4029-8f9e-d5c75b2e3a99 1073741824 Apr 22 17:59:40 devstack sudo[89933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:59:40 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-ee2bc1f1-0ed7-4085-a493-c186a8fd2a40 tempest-VolumesSnapshotListTestJSON-765344525 None] Create snapshot completed successfully Apr 22 17:59:41 devstack sudo[89933]: pam_unix(sudo:session): session closed for user root Apr 22 17:59:41 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-2826e72c-9f22-414f-9dea-4eb6f17fe4e7 tempest-AbsoluteLimitsTests-1518446855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a58fefbf-8ad2-4029-8f9e-d5c75b2e3a99 1073741824" returned: 0 in 0.641s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:59:41 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-2826e72c-9f22-414f-9dea-4eb6f17fe4e7 tempest-AbsoluteLimitsTests-1518446855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a58fefbf-8ad2-4029-8f9e-d5c75b2e3a99 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:59:41 devstack sudo[89938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a58fefbf-8ad2-4029-8f9e-d5c75b2e3a99 Apr 22 17:59:41 devstack sudo[89938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:59:42 devstack sudo[89938]: pam_unix(sudo:session): session closed for user root Apr 22 17:59:42 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-2826e72c-9f22-414f-9dea-4eb6f17fe4e7 tempest-AbsoluteLimitsTests-1518446855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a58fefbf-8ad2-4029-8f9e-d5c75b2e3a99" returned: 0 in 0.494s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:59:42 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-2826e72c-9f22-414f-9dea-4eb6f17fe4e7 tempest-AbsoluteLimitsTests-1518446855 None] <== create_volume: return (1172ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'} {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 17:59:42 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-2826e72c-9f22-414f-9dea-4eb6f17fe4e7 tempest-AbsoluteLimitsTests-1518446855 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.176s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:59:42 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-2826e72c-9f22-414f-9dea-4eb6f17fe4e7 tempest-AbsoluteLimitsTests-1518446855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (942ff317-8fc2-4c9a-aeeb-cfbc67f9ad48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a58fefbf-8ad2-4029-8f9e-d5c75b2e3a99', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:59:42 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-2826e72c-9f22-414f-9dea-4eb6f17fe4e7 tempest-AbsoluteLimitsTests-1518446855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2788f30c-346b-453d-a8fc-e28cfb091d63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:59:42 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-2826e72c-9f22-414f-9dea-4eb6f17fe4e7 tempest-AbsoluteLimitsTests-1518446855 None] Volume volume-a58fefbf-8ad2-4029-8f9e-d5c75b2e3a99 (a58fefbf-8ad2-4029-8f9e-d5c75b2e3a99): created successfully Apr 22 17:59:42 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-2826e72c-9f22-414f-9dea-4eb6f17fe4e7 tempest-AbsoluteLimitsTests-1518446855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2788f30c-346b-453d-a8fc-e28cfb091d63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:59:42 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-2826e72c-9f22-414f-9dea-4eb6f17fe4e7 tempest-AbsoluteLimitsTests-1518446855 None] Flow 'volume_create_manager' (17f6003b-1750-4004-bcaa-3be0995eebe7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:59:42 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-2826e72c-9f22-414f-9dea-4eb6f17fe4e7 tempest-AbsoluteLimitsTests-1518446855 None] Created volume successfully. Apr 22 17:59:42 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-747d4796-dcce-4f11-8cb4-c78824eceeb2 tempest-VolumesSnapshotListTestJSON-765344525 None] Acquiring lock "cinder-91da5aed-4781-476c-9e7a-4aaaaf7a869f-delete_snapshot" by "delete_snapshot" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:59:42 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-747d4796-dcce-4f11-8cb4-c78824eceeb2 tempest-VolumesSnapshotListTestJSON-765344525 None] Lock "cinder-91da5aed-4781-476c-9e7a-4aaaaf7a869f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:59:42 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-747d4796-dcce-4f11-8cb4-c78824eceeb2 tempest-VolumesSnapshotListTestJSON-765344525 None] Acquiring lock "cinder-quobyte-e5bd6775-b75d-401e-b1a0-065f4cc4f4ad" by "delete_snapshot" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:59:42 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-747d4796-dcce-4f11-8cb4-c78824eceeb2 tempest-VolumesSnapshotListTestJSON-765344525 None] Lock "cinder-quobyte-e5bd6775-b75d-401e-b1a0-065f4cc4f4ad" acquired by "delete_snapshot" :: waited 0.017s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:59:42 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-747d4796-dcce-4f11-8cb4-c78824eceeb2 tempest-VolumesSnapshotListTestJSON-765344525 None] Acquiring lock "cinder-quobyte-91da5aed-4781-476c-9e7a-4aaaaf7a869f" by "_delete_snapshot" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:59:42 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-747d4796-dcce-4f11-8cb4-c78824eceeb2 tempest-VolumesSnapshotListTestJSON-765344525 None] Lock "cinder-quobyte-91da5aed-4781-476c-9e7a-4aaaaf7a869f" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:59:42 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-747d4796-dcce-4f11-8cb4-c78824eceeb2 tempest-VolumesSnapshotListTestJSON-765344525 None] Deleting offline snapshot 91da5aed-4781-476c-9e7a-4aaaaf7a869f of volume e5bd6775-b75d-401e-b1a0-065f4cc4f4ad {{(pid=81771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 22 17:59:42 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-747d4796-dcce-4f11-8cb4-c78824eceeb2 tempest-VolumesSnapshotListTestJSON-765344525 None] snapshot_file for this snap is: volume-e5bd6775-b75d-401e-b1a0-065f4cc4f4ad.91da5aed-4781-476c-9e7a-4aaaaf7a869f {{(pid=81771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 22 17:59:42 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce544f26-0149-457d-9b15-0f0b25f49dbd]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:59:42 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-747d4796-dcce-4f11-8cb4-c78824eceeb2 tempest-VolumesSnapshotListTestJSON-765344525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e5bd6775-b75d-401e-b1a0-065f4cc4f4ad.91da5aed-4781-476c-9e7a-4aaaaf7a869f {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:59:42 devstack sudo[89941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e5bd6775-b75d-401e-b1a0-065f4cc4f4ad.91da5aed-4781-476c-9e7a-4aaaaf7a869f Apr 22 17:59:42 devstack sudo[89941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:59:42 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-2d5f1c06-3965-4e73-bde2-bdb427faa0bc tempest-AbsoluteLimitsTests-1518446855 None] Acquiring lock "cinder-a58fefbf-8ad2-4029-8f9e-d5c75b2e3a99-delete_volume" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:59:42 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-2d5f1c06-3965-4e73-bde2-bdb427faa0bc tempest-AbsoluteLimitsTests-1518446855 None] Lock "cinder-a58fefbf-8ad2-4029-8f9e-d5c75b2e3a99-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:59:42 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-2d5f1c06-3965-4e73-bde2-bdb427faa0bc tempest-AbsoluteLimitsTests-1518446855 None] Acquiring lock "cinder-quobyte-a58fefbf-8ad2-4029-8f9e-d5c75b2e3a99" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:59:42 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-2d5f1c06-3965-4e73-bde2-bdb427faa0bc tempest-AbsoluteLimitsTests-1518446855 None] Lock "cinder-quobyte-a58fefbf-8ad2-4029-8f9e-d5c75b2e3a99" acquired by "delete_volume" :: waited 0.015s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:59:42 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b5803b0-3118-4440-aa16-f2b1bd8761b2]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:59:42 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-2d5f1c06-3965-4e73-bde2-bdb427faa0bc tempest-AbsoluteLimitsTests-1518446855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a58fefbf-8ad2-4029-8f9e-d5c75b2e3a99 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:59:42 devstack sudo[89943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a58fefbf-8ad2-4029-8f9e-d5c75b2e3a99 Apr 22 17:59:42 devstack sudo[89943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:59:43 devstack sudo[89941]: pam_unix(sudo:session): session closed for user root Apr 22 17:59:43 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-747d4796-dcce-4f11-8cb4-c78824eceeb2 tempest-VolumesSnapshotListTestJSON-765344525 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e5bd6775-b75d-401e-b1a0-065f4cc4f4ad.91da5aed-4781-476c-9e7a-4aaaaf7a869f" returned: 0 in 0.584s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:59:43 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-747d4796-dcce-4f11-8cb4-c78824eceeb2 tempest-VolumesSnapshotListTestJSON-765344525 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e5bd6775-b75d-401e-b1a0-065f4cc4f4ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81771) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 22 17:59:43 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e298d97-6e4d-444e-b4f7-9729d54c8d43]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:59:43 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-747d4796-dcce-4f11-8cb4-c78824eceeb2 tempest-VolumesSnapshotListTestJSON-765344525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e5bd6775-b75d-401e-b1a0-065f4cc4f4ad.75d64286-f603-41c4-a0bf-40ed413f77e6 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:59:43 devstack sudo[89948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e5bd6775-b75d-401e-b1a0-065f4cc4f4ad.75d64286-f603-41c4-a0bf-40ed413f77e6 Apr 22 17:59:43 devstack sudo[89948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:59:43 devstack sudo[89943]: pam_unix(sudo:session): session closed for user root Apr 22 17:59:43 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-2d5f1c06-3965-4e73-bde2-bdb427faa0bc tempest-AbsoluteLimitsTests-1518446855 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a58fefbf-8ad2-4029-8f9e-d5c75b2e3a99" returned: 0 in 0.552s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:59:43 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-2d5f1c06-3965-4e73-bde2-bdb427faa0bc tempest-AbsoluteLimitsTests-1518446855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a58fefbf-8ad2-4029-8f9e-d5c75b2e3a99 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:59:43 devstack sudo[89953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a58fefbf-8ad2-4029-8f9e-d5c75b2e3a99 Apr 22 17:59:43 devstack sudo[89953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:59:43 devstack sudo[89948]: pam_unix(sudo:session): session closed for user root Apr 22 17:59:43 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-747d4796-dcce-4f11-8cb4-c78824eceeb2 tempest-VolumesSnapshotListTestJSON-765344525 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e5bd6775-b75d-401e-b1a0-065f4cc4f4ad.75d64286-f603-41c4-a0bf-40ed413f77e6" returned: 0 in 0.560s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:59:43 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-747d4796-dcce-4f11-8cb4-c78824eceeb2 tempest-VolumesSnapshotListTestJSON-765344525 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e5bd6775-b75d-401e-b1a0-065f4cc4f4ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81771) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 22 17:59:43 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-747d4796-dcce-4f11-8cb4-c78824eceeb2 tempest-VolumesSnapshotListTestJSON-765344525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e5bd6775-b75d-401e-b1a0-065f4cc4f4ad.91da5aed-4781-476c-9e7a-4aaaaf7a869f {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:59:43 devstack sudo[89961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e5bd6775-b75d-401e-b1a0-065f4cc4f4ad.91da5aed-4781-476c-9e7a-4aaaaf7a869f Apr 22 17:59:43 devstack sudo[89961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:59:43 devstack sudo[89953]: pam_unix(sudo:session): session closed for user root Apr 22 17:59:43 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-2d5f1c06-3965-4e73-bde2-bdb427faa0bc tempest-AbsoluteLimitsTests-1518446855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a58fefbf-8ad2-4029-8f9e-d5c75b2e3a99" returned: 0 in 0.488s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:59:43 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-2d5f1c06-3965-4e73-bde2-bdb427faa0bc tempest-AbsoluteLimitsTests-1518446855 None] Lock "cinder-quobyte-a58fefbf-8ad2-4029-8f9e-d5c75b2e3a99" released by "delete_volume" :: held 1.081s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:59:43 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-2d5f1c06-3965-4e73-bde2-bdb427faa0bc tempest-AbsoluteLimitsTests-1518446855 None] Created reservations ['75ff2455-f81a-474b-8c7a-1e4aad0a5123', '466fa25b-4d73-40a5-b829-160455adfae4', '01122310-2e7d-4bf3-a575-51defc42fdff', '7fe9fe7d-ee5a-4ac0-86c1-3d8a800dcf25'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 17:59:43 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-2d5f1c06-3965-4e73-bde2-bdb427faa0bc tempest-AbsoluteLimitsTests-1518446855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:59:43 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-2d5f1c06-3965-4e73-bde2-bdb427faa0bc tempest-AbsoluteLimitsTests-1518446855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:59:43 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-2d5f1c06-3965-4e73-bde2-bdb427faa0bc tempest-AbsoluteLimitsTests-1518446855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:59:43 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-2d5f1c06-3965-4e73-bde2-bdb427faa0bc tempest-AbsoluteLimitsTests-1518446855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:59:43 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-2d5f1c06-3965-4e73-bde2-bdb427faa0bc tempest-AbsoluteLimitsTests-1518446855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:59:43 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-2d5f1c06-3965-4e73-bde2-bdb427faa0bc tempest-AbsoluteLimitsTests-1518446855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:59:43 devstack sudo[89963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 Apr 22 17:59:43 devstack sudo[89963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:59:44 devstack sudo[89961]: pam_unix(sudo:session): session closed for user root Apr 22 17:59:44 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-747d4796-dcce-4f11-8cb4-c78824eceeb2 tempest-VolumesSnapshotListTestJSON-765344525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e5bd6775-b75d-401e-b1a0-065f4cc4f4ad.91da5aed-4781-476c-9e7a-4aaaaf7a869f" returned: 0 in 0.648s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:59:44 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-747d4796-dcce-4f11-8cb4-c78824eceeb2 tempest-VolumesSnapshotListTestJSON-765344525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e5bd6775-b75d-401e-b1a0-065f4cc4f4ad.91da5aed-4781-476c-9e7a-4aaaaf7a869f {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:59:44 devstack sudo[89969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e5bd6775-b75d-401e-b1a0-065f4cc4f4ad.91da5aed-4781-476c-9e7a-4aaaaf7a869f Apr 22 17:59:44 devstack sudo[89969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:59:44 devstack sudo[89963]: pam_unix(sudo:session): session closed for user root Apr 22 17:59:44 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-2d5f1c06-3965-4e73-bde2-bdb427faa0bc tempest-AbsoluteLimitsTests-1518446855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33" returned: 0 in 0.514s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:59:44 devstack cinder-volume[81771]: DEBUG cinder.manager [None req-2d5f1c06-3965-4e73-bde2-bdb427faa0bc tempest-AbsoluteLimitsTests-1518446855 None] Notifying Schedulers of capabilities ... {{(pid=81771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 17:59:44 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-2d5f1c06-3965-4e73-bde2-bdb427faa0bc tempest-AbsoluteLimitsTests-1518446855 None] Deleted volume successfully. Apr 22 17:59:44 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-2d5f1c06-3965-4e73-bde2-bdb427faa0bc tempest-AbsoluteLimitsTests-1518446855 None] Lock "cinder-a58fefbf-8ad2-4029-8f9e-d5c75b2e3a99-delete_volume" released by "delete_volume" :: held 1.803s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:59:44 devstack sudo[89969]: pam_unix(sudo:session): session closed for user root Apr 22 17:59:44 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-747d4796-dcce-4f11-8cb4-c78824eceeb2 tempest-VolumesSnapshotListTestJSON-765344525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e5bd6775-b75d-401e-b1a0-065f4cc4f4ad.91da5aed-4781-476c-9e7a-4aaaaf7a869f" returned: 0 in 0.487s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:59:44 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-747d4796-dcce-4f11-8cb4-c78824eceeb2 tempest-VolumesSnapshotListTestJSON-765344525 None] Lock "cinder-quobyte-91da5aed-4781-476c-9e7a-4aaaaf7a869f" released by "_delete_snapshot" :: held 2.380s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:59:44 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-747d4796-dcce-4f11-8cb4-c78824eceeb2 tempest-VolumesSnapshotListTestJSON-765344525 None] Lock "cinder-quobyte-e5bd6775-b75d-401e-b1a0-065f4cc4f4ad" released by "delete_snapshot" :: held 2.406s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:59:44 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-747d4796-dcce-4f11-8cb4-c78824eceeb2 tempest-VolumesSnapshotListTestJSON-765344525 None] Created reservations ['620b9860-ab7e-4ff5-bbd4-4bcc10cf99ba', 'a0e6b40d-918b-43fd-aab2-8afa967ac05c', '5f31f9d3-f40c-4214-99a9-535c47072dca', 'caf78869-1b6e-4a9c-8ece-49b4d14e0ebd'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 17:59:44 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-747d4796-dcce-4f11-8cb4-c78824eceeb2 tempest-VolumesSnapshotListTestJSON-765344525 None] Delete snapshot completed successfully. Apr 22 17:59:44 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-747d4796-dcce-4f11-8cb4-c78824eceeb2 tempest-VolumesSnapshotListTestJSON-765344525 None] Lock "cinder-91da5aed-4781-476c-9e7a-4aaaaf7a869f-delete_snapshot" released by "delete_snapshot" :: held 2.557s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:59:45 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-3c6a34ee-7da7-43b3-9b05-491ca70ebbae tempest-VolumesSnapshotListTestJSON-765344525 None] Acquiring lock "cinder-75d64286-f603-41c4-a0bf-40ed413f77e6-delete_snapshot" by "delete_snapshot" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:59:45 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-3c6a34ee-7da7-43b3-9b05-491ca70ebbae tempest-VolumesSnapshotListTestJSON-765344525 None] Lock "cinder-75d64286-f603-41c4-a0bf-40ed413f77e6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:59:45 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-3c6a34ee-7da7-43b3-9b05-491ca70ebbae tempest-VolumesSnapshotListTestJSON-765344525 None] Acquiring lock "cinder-quobyte-e5bd6775-b75d-401e-b1a0-065f4cc4f4ad" by "delete_snapshot" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:59:45 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-3c6a34ee-7da7-43b3-9b05-491ca70ebbae tempest-VolumesSnapshotListTestJSON-765344525 None] Lock "cinder-quobyte-e5bd6775-b75d-401e-b1a0-065f4cc4f4ad" acquired by "delete_snapshot" :: waited 0.025s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:59:45 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-3c6a34ee-7da7-43b3-9b05-491ca70ebbae tempest-VolumesSnapshotListTestJSON-765344525 None] Acquiring lock "cinder-quobyte-75d64286-f603-41c4-a0bf-40ed413f77e6" by "_delete_snapshot" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:59:45 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-3c6a34ee-7da7-43b3-9b05-491ca70ebbae tempest-VolumesSnapshotListTestJSON-765344525 None] Lock "cinder-quobyte-75d64286-f603-41c4-a0bf-40ed413f77e6" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:59:45 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-3c6a34ee-7da7-43b3-9b05-491ca70ebbae tempest-VolumesSnapshotListTestJSON-765344525 None] Deleting offline snapshot 75d64286-f603-41c4-a0bf-40ed413f77e6 of volume e5bd6775-b75d-401e-b1a0-065f4cc4f4ad {{(pid=81771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 22 17:59:45 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-3c6a34ee-7da7-43b3-9b05-491ca70ebbae tempest-VolumesSnapshotListTestJSON-765344525 None] snapshot_file for this snap is: volume-e5bd6775-b75d-401e-b1a0-065f4cc4f4ad.75d64286-f603-41c4-a0bf-40ed413f77e6 {{(pid=81771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 22 17:59:45 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[e50af80e-937e-4272-b01c-18c6a3861f4e]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:59:45 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-3c6a34ee-7da7-43b3-9b05-491ca70ebbae tempest-VolumesSnapshotListTestJSON-765344525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e5bd6775-b75d-401e-b1a0-065f4cc4f4ad.75d64286-f603-41c4-a0bf-40ed413f77e6 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:59:45 devstack sudo[89972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e5bd6775-b75d-401e-b1a0-065f4cc4f4ad.75d64286-f603-41c4-a0bf-40ed413f77e6 Apr 22 17:59:45 devstack sudo[89972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:59:46 devstack sudo[89972]: pam_unix(sudo:session): session closed for user root Apr 22 17:59:46 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-3c6a34ee-7da7-43b3-9b05-491ca70ebbae tempest-VolumesSnapshotListTestJSON-765344525 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e5bd6775-b75d-401e-b1a0-065f4cc4f4ad.75d64286-f603-41c4-a0bf-40ed413f77e6" returned: 0 in 0.658s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:59:46 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-3c6a34ee-7da7-43b3-9b05-491ca70ebbae tempest-VolumesSnapshotListTestJSON-765344525 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e5bd6775-b75d-401e-b1a0-065f4cc4f4ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81771) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 22 17:59:46 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebee351a-7094-41bd-aaec-3b12a9b41979]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:59:46 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-3c6a34ee-7da7-43b3-9b05-491ca70ebbae tempest-VolumesSnapshotListTestJSON-765344525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e5bd6775-b75d-401e-b1a0-065f4cc4f4ad.421c074d-1cc2-4e96-af5f-024359fcecec {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:59:46 devstack sudo[89977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e5bd6775-b75d-401e-b1a0-065f4cc4f4ad.421c074d-1cc2-4e96-af5f-024359fcecec Apr 22 17:59:46 devstack sudo[89977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:59:46 devstack sudo[89977]: pam_unix(sudo:session): session closed for user root Apr 22 17:59:46 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-3c6a34ee-7da7-43b3-9b05-491ca70ebbae tempest-VolumesSnapshotListTestJSON-765344525 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e5bd6775-b75d-401e-b1a0-065f4cc4f4ad.421c074d-1cc2-4e96-af5f-024359fcecec" returned: 0 in 0.654s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:59:46 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-3c6a34ee-7da7-43b3-9b05-491ca70ebbae tempest-VolumesSnapshotListTestJSON-765344525 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e5bd6775-b75d-401e-b1a0-065f4cc4f4ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81771) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 22 17:59:46 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-3c6a34ee-7da7-43b3-9b05-491ca70ebbae tempest-VolumesSnapshotListTestJSON-765344525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e5bd6775-b75d-401e-b1a0-065f4cc4f4ad.75d64286-f603-41c4-a0bf-40ed413f77e6 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:59:47 devstack sudo[89982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e5bd6775-b75d-401e-b1a0-065f4cc4f4ad.75d64286-f603-41c4-a0bf-40ed413f77e6 Apr 22 17:59:47 devstack sudo[89982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:59:47 devstack sudo[89982]: pam_unix(sudo:session): session closed for user root Apr 22 17:59:47 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-3c6a34ee-7da7-43b3-9b05-491ca70ebbae tempest-VolumesSnapshotListTestJSON-765344525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e5bd6775-b75d-401e-b1a0-065f4cc4f4ad.75d64286-f603-41c4-a0bf-40ed413f77e6" returned: 0 in 0.677s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:59:47 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-3c6a34ee-7da7-43b3-9b05-491ca70ebbae tempest-VolumesSnapshotListTestJSON-765344525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e5bd6775-b75d-401e-b1a0-065f4cc4f4ad.75d64286-f603-41c4-a0bf-40ed413f77e6 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:59:47 devstack sudo[89989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e5bd6775-b75d-401e-b1a0-065f4cc4f4ad.75d64286-f603-41c4-a0bf-40ed413f77e6 Apr 22 17:59:47 devstack sudo[89989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:59:48 devstack sudo[89989]: pam_unix(sudo:session): session closed for user root Apr 22 17:59:48 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-3c6a34ee-7da7-43b3-9b05-491ca70ebbae tempest-VolumesSnapshotListTestJSON-765344525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e5bd6775-b75d-401e-b1a0-065f4cc4f4ad.75d64286-f603-41c4-a0bf-40ed413f77e6" returned: 0 in 0.484s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:59:48 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-3c6a34ee-7da7-43b3-9b05-491ca70ebbae tempest-VolumesSnapshotListTestJSON-765344525 None] Lock "cinder-quobyte-75d64286-f603-41c4-a0bf-40ed413f77e6" released by "_delete_snapshot" :: held 2.584s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:59:48 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-3c6a34ee-7da7-43b3-9b05-491ca70ebbae tempest-VolumesSnapshotListTestJSON-765344525 None] Lock "cinder-quobyte-e5bd6775-b75d-401e-b1a0-065f4cc4f4ad" released by "delete_snapshot" :: held 2.621s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:59:48 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-3c6a34ee-7da7-43b3-9b05-491ca70ebbae tempest-VolumesSnapshotListTestJSON-765344525 None] Created reservations ['f4e87bd8-b371-44d4-9a51-b90f1c4effba', '2d2db2cb-bf31-4740-9f16-5dc127860537', '20dd2432-4218-4097-9669-969d349f1f67', '130ef033-87ee-4b41-804d-f4123aa25a6e'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 17:59:48 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-3c6a34ee-7da7-43b3-9b05-491ca70ebbae tempest-VolumesSnapshotListTestJSON-765344525 None] Delete snapshot completed successfully. Apr 22 17:59:48 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-3c6a34ee-7da7-43b3-9b05-491ca70ebbae tempest-VolumesSnapshotListTestJSON-765344525 None] Lock "cinder-75d64286-f603-41c4-a0bf-40ed413f77e6-delete_snapshot" released by "delete_snapshot" :: held 2.768s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:59:48 devstack cinder-volume[81771]: DEBUG cinder.volume.flows.manager.create_volume [None req-86476c8a-6905-4846-9036-48e1bb2b2fbb tempest-VolumesCloneNegativeTest-164597894 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 17:59:48 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-86476c8a-6905-4846-9036-48e1bb2b2fbb tempest-VolumesCloneNegativeTest-164597894 None] Flow 'volume_create_manager' (72b4a6b8-9b99-4cb9-95df-ef98880a9e08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:59:48 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-86476c8a-6905-4846-9036-48e1bb2b2fbb tempest-VolumesCloneNegativeTest-164597894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a58c9251-ca8f-4a3e-852a-c8a81096fad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:59:48 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-86476c8a-6905-4846-9036-48e1bb2b2fbb tempest-VolumesCloneNegativeTest-164597894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a58c9251-ca8f-4a3e-852a-c8a81096fad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:59:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-769638668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e993c5b-a225-4b26-ad75-818bcab470f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7871488b630f4ac7a4ed2a435721ac93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:59:49Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:59:49Z,use_quota=True,user_id='20c7870f6caf4b968a7da3b10c61dc5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:59:48 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-86476c8a-6905-4846-9036-48e1bb2b2fbb tempest-VolumesCloneNegativeTest-164597894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39264c96-d8bc-44df-bd27-4e58ead4f6cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:59:48 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-86476c8a-6905-4846-9036-48e1bb2b2fbb tempest-VolumesCloneNegativeTest-164597894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39264c96-d8bc-44df-bd27-4e58ead4f6cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:59:48 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-86476c8a-6905-4846-9036-48e1bb2b2fbb tempest-VolumesCloneNegativeTest-164597894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04d51ee8-d713-4ba9-8ba5-1d58ac3676fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:59:48 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-86476c8a-6905-4846-9036-48e1bb2b2fbb tempest-VolumesCloneNegativeTest-164597894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04d51ee8-d713-4ba9-8ba5-1d58ac3676fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e993c5b-a225-4b26-ad75-818bcab470f3', 'volume_name': 'volume-1e993c5b-a225-4b26-ad75-818bcab470f3', 'volume_size': 2}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:59:48 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-86476c8a-6905-4846-9036-48e1bb2b2fbb tempest-VolumesCloneNegativeTest-164597894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55fb5650-a6ca-416f-b3bb-5112076aab4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:59:48 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-86476c8a-6905-4846-9036-48e1bb2b2fbb tempest-VolumesCloneNegativeTest-164597894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55fb5650-a6ca-416f-b3bb-5112076aab4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:59:48 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-86476c8a-6905-4846-9036-48e1bb2b2fbb tempest-VolumesCloneNegativeTest-164597894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fd7e986-fd20-4511-9c7f-0db7035e0f63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:59:48 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-86476c8a-6905-4846-9036-48e1bb2b2fbb tempest-VolumesCloneNegativeTest-164597894 None] Volume 1e993c5b-a225-4b26-ad75-818bcab470f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e993c5b-a225-4b26-ad75-818bcab470f3', 'volume_size': 2} Apr 22 17:59:48 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-86476c8a-6905-4846-9036-48e1bb2b2fbb tempest-VolumesCloneNegativeTest-164597894 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:59:48 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-86476c8a-6905-4846-9036-48e1bb2b2fbb tempest-VolumesCloneNegativeTest-164597894 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:59:48 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-86476c8a-6905-4846-9036-48e1bb2b2fbb tempest-VolumesCloneNegativeTest-164597894 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:59:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-769638668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e993c5b-a225-4b26-ad75-818bcab470f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7871488b630f4ac7a4ed2a435721ac93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:59:49Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:59:49Z,use_quota=True,user_id='20c7870f6caf4b968a7da3b10c61dc5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)}" {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 17:59:48 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-86476c8a-6905-4846-9036-48e1bb2b2fbb tempest-VolumesCloneNegativeTest-164597894 None] Creating volume 1e993c5b-a225-4b26-ad75-818bcab470f3 {{(pid=81771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 17:59:48 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-86476c8a-6905-4846-9036-48e1bb2b2fbb tempest-VolumesCloneNegativeTest-164597894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:59:48 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-86476c8a-6905-4846-9036-48e1bb2b2fbb tempest-VolumesCloneNegativeTest-164597894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:59:48 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-86476c8a-6905-4846-9036-48e1bb2b2fbb tempest-VolumesCloneNegativeTest-164597894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:59:48 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-86476c8a-6905-4846-9036-48e1bb2b2fbb tempest-VolumesCloneNegativeTest-164597894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:59:48 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-86476c8a-6905-4846-9036-48e1bb2b2fbb tempest-VolumesCloneNegativeTest-164597894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:59:48 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-86476c8a-6905-4846-9036-48e1bb2b2fbb tempest-VolumesCloneNegativeTest-164597894 None] Selected osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 as target Quobyte volume. {{(pid=81771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 17:59:48 devstack cinder-volume[81771]: INFO cinder.volume.drivers.remotefs [None req-86476c8a-6905-4846-9036-48e1bb2b2fbb tempest-VolumesCloneNegativeTest-164597894 None] casted to osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 Apr 22 17:59:48 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-86476c8a-6905-4846-9036-48e1bb2b2fbb tempest-VolumesCloneNegativeTest-164597894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-1e993c5b-a225-4b26-ad75-818bcab470f3 2147483648 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:59:48 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-8e0e224c-3569-453c-8eb2-81b8ee226719 tempest-VolumesSnapshotListTestJSON-765344525 None] Acquiring lock "cinder-421c074d-1cc2-4e96-af5f-024359fcecec-delete_snapshot" by "delete_snapshot" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:59:48 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-8e0e224c-3569-453c-8eb2-81b8ee226719 tempest-VolumesSnapshotListTestJSON-765344525 None] Lock "cinder-421c074d-1cc2-4e96-af5f-024359fcecec-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:59:48 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-8e0e224c-3569-453c-8eb2-81b8ee226719 tempest-VolumesSnapshotListTestJSON-765344525 None] Acquiring lock "cinder-quobyte-e5bd6775-b75d-401e-b1a0-065f4cc4f4ad" by "delete_snapshot" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:59:48 devstack sudo[89992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-1e993c5b-a225-4b26-ad75-818bcab470f3 2147483648 Apr 22 17:59:48 devstack sudo[89992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:59:48 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-8e0e224c-3569-453c-8eb2-81b8ee226719 tempest-VolumesSnapshotListTestJSON-765344525 None] Lock "cinder-quobyte-e5bd6775-b75d-401e-b1a0-065f4cc4f4ad" acquired by "delete_snapshot" :: waited 0.015s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:59:48 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-8e0e224c-3569-453c-8eb2-81b8ee226719 tempest-VolumesSnapshotListTestJSON-765344525 None] Acquiring lock "cinder-quobyte-421c074d-1cc2-4e96-af5f-024359fcecec" by "_delete_snapshot" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:59:48 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-8e0e224c-3569-453c-8eb2-81b8ee226719 tempest-VolumesSnapshotListTestJSON-765344525 None] Lock "cinder-quobyte-421c074d-1cc2-4e96-af5f-024359fcecec" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:59:48 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-8e0e224c-3569-453c-8eb2-81b8ee226719 tempest-VolumesSnapshotListTestJSON-765344525 None] Deleting offline snapshot 421c074d-1cc2-4e96-af5f-024359fcecec of volume e5bd6775-b75d-401e-b1a0-065f4cc4f4ad {{(pid=81771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 22 17:59:48 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-8e0e224c-3569-453c-8eb2-81b8ee226719 tempest-VolumesSnapshotListTestJSON-765344525 None] snapshot_file for this snap is: volume-e5bd6775-b75d-401e-b1a0-065f4cc4f4ad.421c074d-1cc2-4e96-af5f-024359fcecec {{(pid=81771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 22 17:59:48 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[89425b5c-c9df-44a6-aba0-50cd758f3a04]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:59:48 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-8e0e224c-3569-453c-8eb2-81b8ee226719 tempest-VolumesSnapshotListTestJSON-765344525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e5bd6775-b75d-401e-b1a0-065f4cc4f4ad.421c074d-1cc2-4e96-af5f-024359fcecec {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:59:48 devstack sudo[89994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e5bd6775-b75d-401e-b1a0-065f4cc4f4ad.421c074d-1cc2-4e96-af5f-024359fcecec Apr 22 17:59:48 devstack sudo[89994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:59:49 devstack sudo[89994]: pam_unix(sudo:session): session closed for user root Apr 22 17:59:49 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-8e0e224c-3569-453c-8eb2-81b8ee226719 tempest-VolumesSnapshotListTestJSON-765344525 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e5bd6775-b75d-401e-b1a0-065f4cc4f4ad.421c074d-1cc2-4e96-af5f-024359fcecec" returned: 0 in 0.567s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:59:49 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-8e0e224c-3569-453c-8eb2-81b8ee226719 tempest-VolumesSnapshotListTestJSON-765344525 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e5bd6775-b75d-401e-b1a0-065f4cc4f4ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81771) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 22 17:59:49 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[91db4a63-9200-4f73-92b7-41fd9f960b47]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:59:49 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-8e0e224c-3569-453c-8eb2-81b8ee226719 tempest-VolumesSnapshotListTestJSON-765344525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e5bd6775-b75d-401e-b1a0-065f4cc4f4ad {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:59:49 devstack sudo[89992]: pam_unix(sudo:session): session closed for user root Apr 22 17:59:49 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-86476c8a-6905-4846-9036-48e1bb2b2fbb tempest-VolumesCloneNegativeTest-164597894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-1e993c5b-a225-4b26-ad75-818bcab470f3 2147483648" returned: 0 in 0.734s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:59:49 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-86476c8a-6905-4846-9036-48e1bb2b2fbb tempest-VolumesCloneNegativeTest-164597894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-1e993c5b-a225-4b26-ad75-818bcab470f3 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:59:49 devstack sudo[90002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e5bd6775-b75d-401e-b1a0-065f4cc4f4ad Apr 22 17:59:49 devstack sudo[90002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:59:49 devstack sudo[90003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-1e993c5b-a225-4b26-ad75-818bcab470f3 Apr 22 17:59:49 devstack sudo[90003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:59:49 devstack sudo[90002]: pam_unix(sudo:session): session closed for user root Apr 22 17:59:49 devstack sudo[90003]: pam_unix(sudo:session): session closed for user root Apr 22 17:59:49 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-86476c8a-6905-4846-9036-48e1bb2b2fbb tempest-VolumesCloneNegativeTest-164597894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-1e993c5b-a225-4b26-ad75-818bcab470f3" returned: 0 in 0.481s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:59:49 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-86476c8a-6905-4846-9036-48e1bb2b2fbb tempest-VolumesCloneNegativeTest-164597894 None] <== create_volume: return (1256ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'} {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 17:59:49 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-86476c8a-6905-4846-9036-48e1bb2b2fbb tempest-VolumesCloneNegativeTest-164597894 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.258s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:59:49 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-8e0e224c-3569-453c-8eb2-81b8ee226719 tempest-VolumesSnapshotListTestJSON-765344525 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e5bd6775-b75d-401e-b1a0-065f4cc4f4ad" returned: 0 in 0.552s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:59:49 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-8e0e224c-3569-453c-8eb2-81b8ee226719 tempest-VolumesSnapshotListTestJSON-765344525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e5bd6775-b75d-401e-b1a0-065f4cc4f4ad.421c074d-1cc2-4e96-af5f-024359fcecec {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:59:49 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-86476c8a-6905-4846-9036-48e1bb2b2fbb tempest-VolumesCloneNegativeTest-164597894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fd7e986-fd20-4511-9c7f-0db7035e0f63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e993c5b-a225-4b26-ad75-818bcab470f3', 'volume_size': 2}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:59:49 devstack sudo[90010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e5bd6775-b75d-401e-b1a0-065f4cc4f4ad.421c074d-1cc2-4e96-af5f-024359fcecec Apr 22 17:59:49 devstack sudo[90010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:59:49 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-86476c8a-6905-4846-9036-48e1bb2b2fbb tempest-VolumesCloneNegativeTest-164597894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3270caa7-da9b-47f6-8dc5-ea96c70457ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:59:49 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-86476c8a-6905-4846-9036-48e1bb2b2fbb tempest-VolumesCloneNegativeTest-164597894 None] Volume volume-1e993c5b-a225-4b26-ad75-818bcab470f3 (1e993c5b-a225-4b26-ad75-818bcab470f3): created successfully Apr 22 17:59:50 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-86476c8a-6905-4846-9036-48e1bb2b2fbb tempest-VolumesCloneNegativeTest-164597894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3270caa7-da9b-47f6-8dc5-ea96c70457ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:59:50 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-86476c8a-6905-4846-9036-48e1bb2b2fbb tempest-VolumesCloneNegativeTest-164597894 None] Flow 'volume_create_manager' (72b4a6b8-9b99-4cb9-95df-ef98880a9e08) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:59:50 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-86476c8a-6905-4846-9036-48e1bb2b2fbb tempest-VolumesCloneNegativeTest-164597894 None] Created volume successfully. Apr 22 17:59:50 devstack sudo[90010]: pam_unix(sudo:session): session closed for user root Apr 22 17:59:50 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-8e0e224c-3569-453c-8eb2-81b8ee226719 tempest-VolumesSnapshotListTestJSON-765344525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e5bd6775-b75d-401e-b1a0-065f4cc4f4ad.421c074d-1cc2-4e96-af5f-024359fcecec" returned: 0 in 0.539s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:59:50 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-8e0e224c-3569-453c-8eb2-81b8ee226719 tempest-VolumesSnapshotListTestJSON-765344525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e5bd6775-b75d-401e-b1a0-065f4cc4f4ad.421c074d-1cc2-4e96-af5f-024359fcecec {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:59:50 devstack sudo[90015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e5bd6775-b75d-401e-b1a0-065f4cc4f4ad.421c074d-1cc2-4e96-af5f-024359fcecec Apr 22 17:59:50 devstack sudo[90015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:59:50 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-fce0262c-d3f7-4d11-974d-ecc3c3e5c657 tempest-VolumesCloneNegativeTest-164597894 None] Acquiring lock "cinder-1e993c5b-a225-4b26-ad75-818bcab470f3-delete_volume" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:59:50 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-fce0262c-d3f7-4d11-974d-ecc3c3e5c657 tempest-VolumesCloneNegativeTest-164597894 None] Lock "cinder-1e993c5b-a225-4b26-ad75-818bcab470f3-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:59:50 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-fce0262c-d3f7-4d11-974d-ecc3c3e5c657 tempest-VolumesCloneNegativeTest-164597894 None] Acquiring lock "cinder-quobyte-1e993c5b-a225-4b26-ad75-818bcab470f3" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:59:50 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-fce0262c-d3f7-4d11-974d-ecc3c3e5c657 tempest-VolumesCloneNegativeTest-164597894 None] Lock "cinder-quobyte-1e993c5b-a225-4b26-ad75-818bcab470f3" acquired by "delete_volume" :: waited 0.017s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:59:50 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae341a25-9871-40be-be0e-6a455ca5531f]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:59:50 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-fce0262c-d3f7-4d11-974d-ecc3c3e5c657 tempest-VolumesCloneNegativeTest-164597894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-1e993c5b-a225-4b26-ad75-818bcab470f3 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:59:51 devstack sudo[90015]: pam_unix(sudo:session): session closed for user root Apr 22 17:59:51 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-8e0e224c-3569-453c-8eb2-81b8ee226719 tempest-VolumesSnapshotListTestJSON-765344525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e5bd6775-b75d-401e-b1a0-065f4cc4f4ad.421c074d-1cc2-4e96-af5f-024359fcecec" returned: 0 in 0.505s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:59:51 devstack sudo[90018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-1e993c5b-a225-4b26-ad75-818bcab470f3 Apr 22 17:59:51 devstack sudo[90018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:59:51 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-8e0e224c-3569-453c-8eb2-81b8ee226719 tempest-VolumesSnapshotListTestJSON-765344525 None] Lock "cinder-quobyte-421c074d-1cc2-4e96-af5f-024359fcecec" released by "_delete_snapshot" :: held 2.265s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:59:51 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-8e0e224c-3569-453c-8eb2-81b8ee226719 tempest-VolumesSnapshotListTestJSON-765344525 None] Lock "cinder-quobyte-e5bd6775-b75d-401e-b1a0-065f4cc4f4ad" released by "delete_snapshot" :: held 2.289s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:59:51 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-8e0e224c-3569-453c-8eb2-81b8ee226719 tempest-VolumesSnapshotListTestJSON-765344525 None] Created reservations ['f74cc7ec-a0e4-4425-b1ca-a7218b9019bb', '71efc41c-6683-43c7-b756-77e36ff68c01', '5aa655fa-712d-45c5-a0da-73d874805eb1', '04fdcb67-d5c0-437e-9763-0c635fbbab03'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 17:59:51 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-8e0e224c-3569-453c-8eb2-81b8ee226719 tempest-VolumesSnapshotListTestJSON-765344525 None] Delete snapshot completed successfully. Apr 22 17:59:51 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-8e0e224c-3569-453c-8eb2-81b8ee226719 tempest-VolumesSnapshotListTestJSON-765344525 None] Lock "cinder-421c074d-1cc2-4e96-af5f-024359fcecec-delete_snapshot" released by "delete_snapshot" :: held 2.410s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:59:51 devstack sudo[90018]: pam_unix(sudo:session): session closed for user root Apr 22 17:59:51 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-fce0262c-d3f7-4d11-974d-ecc3c3e5c657 tempest-VolumesCloneNegativeTest-164597894 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-1e993c5b-a225-4b26-ad75-818bcab470f3" returned: 0 in 0.548s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:59:51 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-fce0262c-d3f7-4d11-974d-ecc3c3e5c657 tempest-VolumesCloneNegativeTest-164597894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-1e993c5b-a225-4b26-ad75-818bcab470f3 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:59:51 devstack sudo[90023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-1e993c5b-a225-4b26-ad75-818bcab470f3 Apr 22 17:59:51 devstack sudo[90023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:59:52 devstack sudo[90023]: pam_unix(sudo:session): session closed for user root Apr 22 17:59:52 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-fce0262c-d3f7-4d11-974d-ecc3c3e5c657 tempest-VolumesCloneNegativeTest-164597894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-1e993c5b-a225-4b26-ad75-818bcab470f3" returned: 0 in 0.496s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:59:52 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-5d84fd6f-bff5-426c-8166-1a5a98f3e120 tempest-VolumesSnapshotListTestJSON-765344525 None] Acquiring lock "cinder-e5bd6775-b75d-401e-b1a0-065f4cc4f4ad-delete_volume" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:59:52 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-fce0262c-d3f7-4d11-974d-ecc3c3e5c657 tempest-VolumesCloneNegativeTest-164597894 None] Lock "cinder-quobyte-1e993c5b-a225-4b26-ad75-818bcab470f3" released by "delete_volume" :: held 1.090s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:59:52 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-5d84fd6f-bff5-426c-8166-1a5a98f3e120 tempest-VolumesSnapshotListTestJSON-765344525 None] Lock "cinder-e5bd6775-b75d-401e-b1a0-065f4cc4f4ad-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:59:52 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-5d84fd6f-bff5-426c-8166-1a5a98f3e120 tempest-VolumesSnapshotListTestJSON-765344525 None] Acquiring lock "cinder-quobyte-e5bd6775-b75d-401e-b1a0-065f4cc4f4ad" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 17:59:52 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-fce0262c-d3f7-4d11-974d-ecc3c3e5c657 tempest-VolumesCloneNegativeTest-164597894 None] Created reservations ['4d4b93b7-2462-4690-ac9b-236ef9bf96fc', '1a62b85f-891d-4cfa-a5dc-de57bda3f132', '19ec7db7-9906-4614-8182-5f5fb9b8be02', 'b63380b7-88dd-441b-bfae-1a3b9022f6b1'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 17:59:52 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-5d84fd6f-bff5-426c-8166-1a5a98f3e120 tempest-VolumesSnapshotListTestJSON-765344525 None] Lock "cinder-quobyte-e5bd6775-b75d-401e-b1a0-065f4cc4f4ad" acquired by "delete_volume" :: waited 0.025s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 17:59:52 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf0c6149-93db-476c-a294-378a34b889aa]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:59:52 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-5d84fd6f-bff5-426c-8166-1a5a98f3e120 tempest-VolumesSnapshotListTestJSON-765344525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e5bd6775-b75d-401e-b1a0-065f4cc4f4ad {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:59:52 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-fce0262c-d3f7-4d11-974d-ecc3c3e5c657 tempest-VolumesCloneNegativeTest-164597894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:59:52 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-fce0262c-d3f7-4d11-974d-ecc3c3e5c657 tempest-VolumesCloneNegativeTest-164597894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:59:52 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-fce0262c-d3f7-4d11-974d-ecc3c3e5c657 tempest-VolumesCloneNegativeTest-164597894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:59:52 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-fce0262c-d3f7-4d11-974d-ecc3c3e5c657 tempest-VolumesCloneNegativeTest-164597894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:59:52 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-fce0262c-d3f7-4d11-974d-ecc3c3e5c657 tempest-VolumesCloneNegativeTest-164597894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:59:52 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-fce0262c-d3f7-4d11-974d-ecc3c3e5c657 tempest-VolumesCloneNegativeTest-164597894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:59:52 devstack sudo[90026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e5bd6775-b75d-401e-b1a0-065f4cc4f4ad Apr 22 17:59:52 devstack sudo[90026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:59:52 devstack sudo[90027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 Apr 22 17:59:52 devstack sudo[90027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:59:52 devstack sudo[90027]: pam_unix(sudo:session): session closed for user root Apr 22 17:59:52 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-fce0262c-d3f7-4d11-974d-ecc3c3e5c657 tempest-VolumesCloneNegativeTest-164597894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33" returned: 0 in 0.454s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:59:52 devstack cinder-volume[81771]: DEBUG cinder.manager [None req-fce0262c-d3f7-4d11-974d-ecc3c3e5c657 tempest-VolumesCloneNegativeTest-164597894 None] Notifying Schedulers of capabilities ... {{(pid=81771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 17:59:52 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-fce0262c-d3f7-4d11-974d-ecc3c3e5c657 tempest-VolumesCloneNegativeTest-164597894 None] Deleted volume successfully. Apr 22 17:59:52 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-fce0262c-d3f7-4d11-974d-ecc3c3e5c657 tempest-VolumesCloneNegativeTest-164597894 None] Lock "cinder-1e993c5b-a225-4b26-ad75-818bcab470f3-delete_volume" released by "delete_volume" :: held 1.837s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:59:52 devstack sudo[90026]: pam_unix(sudo:session): session closed for user root Apr 22 17:59:52 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-5d84fd6f-bff5-426c-8166-1a5a98f3e120 tempest-VolumesSnapshotListTestJSON-765344525 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e5bd6775-b75d-401e-b1a0-065f4cc4f4ad" returned: 0 in 0.572s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:59:52 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-5d84fd6f-bff5-426c-8166-1a5a98f3e120 tempest-VolumesSnapshotListTestJSON-765344525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e5bd6775-b75d-401e-b1a0-065f4cc4f4ad {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:59:52 devstack sudo[90034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e5bd6775-b75d-401e-b1a0-065f4cc4f4ad Apr 22 17:59:52 devstack sudo[90034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:59:53 devstack sudo[90034]: pam_unix(sudo:session): session closed for user root Apr 22 17:59:53 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-5d84fd6f-bff5-426c-8166-1a5a98f3e120 tempest-VolumesSnapshotListTestJSON-765344525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e5bd6775-b75d-401e-b1a0-065f4cc4f4ad" returned: 0 in 0.475s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:59:53 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-5d84fd6f-bff5-426c-8166-1a5a98f3e120 tempest-VolumesSnapshotListTestJSON-765344525 None] Lock "cinder-quobyte-e5bd6775-b75d-401e-b1a0-065f4cc4f4ad" released by "delete_volume" :: held 1.110s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:59:53 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-5d84fd6f-bff5-426c-8166-1a5a98f3e120 tempest-VolumesSnapshotListTestJSON-765344525 None] Created reservations ['08f3f18e-0365-4757-9280-8d3af0906e3d', '39c5b9e4-8447-4f72-903a-20a882ee1159', '292a5ec7-fb77-40b2-acd6-a374ab21c0ef', 'f24facb6-7d63-4070-a237-6b20dde4d2e9'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 17:59:53 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-5d84fd6f-bff5-426c-8166-1a5a98f3e120 tempest-VolumesSnapshotListTestJSON-765344525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:59:53 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-5d84fd6f-bff5-426c-8166-1a5a98f3e120 tempest-VolumesSnapshotListTestJSON-765344525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:59:53 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-5d84fd6f-bff5-426c-8166-1a5a98f3e120 tempest-VolumesSnapshotListTestJSON-765344525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:59:53 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-5d84fd6f-bff5-426c-8166-1a5a98f3e120 tempest-VolumesSnapshotListTestJSON-765344525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:59:53 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-5d84fd6f-bff5-426c-8166-1a5a98f3e120 tempest-VolumesSnapshotListTestJSON-765344525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:59:53 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-5d84fd6f-bff5-426c-8166-1a5a98f3e120 tempest-VolumesSnapshotListTestJSON-765344525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:59:53 devstack sudo[90037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 Apr 22 17:59:53 devstack sudo[90037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:59:53 devstack sudo[90037]: pam_unix(sudo:session): session closed for user root Apr 22 17:59:53 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-5d84fd6f-bff5-426c-8166-1a5a98f3e120 tempest-VolumesSnapshotListTestJSON-765344525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33" returned: 0 in 0.496s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:59:53 devstack cinder-volume[81771]: DEBUG cinder.manager [None req-5d84fd6f-bff5-426c-8166-1a5a98f3e120 tempest-VolumesSnapshotListTestJSON-765344525 None] Notifying Schedulers of capabilities ... {{(pid=81771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 17:59:53 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-5d84fd6f-bff5-426c-8166-1a5a98f3e120 tempest-VolumesSnapshotListTestJSON-765344525 None] Deleted volume successfully. Apr 22 17:59:53 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-5d84fd6f-bff5-426c-8166-1a5a98f3e120 tempest-VolumesSnapshotListTestJSON-765344525 None] Lock "cinder-e5bd6775-b75d-401e-b1a0-065f4cc4f4ad-delete_volume" released by "delete_volume" :: held 1.817s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 17:59:56 devstack cinder-volume[81771]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ed5e197-3da1-4e07-a39e-b648590316a8 tempest-VolumesExtendTest-1099015543 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 17:59:56 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-4ed5e197-3da1-4e07-a39e-b648590316a8 tempest-VolumesExtendTest-1099015543 None] Flow 'volume_create_manager' (0a23aa78-fdf0-4b7c-8e88-a68ac8957617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 17:59:56 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-4ed5e197-3da1-4e07-a39e-b648590316a8 tempest-VolumesExtendTest-1099015543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aee6cb99-0040-4cc2-8d9c-f38c2c4e6d1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:59:56 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-4ed5e197-3da1-4e07-a39e-b648590316a8 tempest-VolumesExtendTest-1099015543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aee6cb99-0040-4cc2-8d9c-f38c2c4e6d1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:59:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-597666050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e55611f-359e-4cf7-8961-aba0aae950ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a66ce0ac9e2b41c3b95497606622347d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:59:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:59:56Z,use_quota=True,user_id='9033a0828526412b913692b5593a1e82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:59:56 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-4ed5e197-3da1-4e07-a39e-b648590316a8 tempest-VolumesExtendTest-1099015543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f85701e1-0b23-4cae-94b3-7fbbe42b2947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:59:56 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-4ed5e197-3da1-4e07-a39e-b648590316a8 tempest-VolumesExtendTest-1099015543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f85701e1-0b23-4cae-94b3-7fbbe42b2947) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:59:56 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-4ed5e197-3da1-4e07-a39e-b648590316a8 tempest-VolumesExtendTest-1099015543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (627f1047-628a-4407-8083-880ddcc3f295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:59:56 devstack cinder-volume[81771]: DEBUG cinder.image.glance [None req-4ed5e197-3da1-4e07-a39e-b648590316a8 tempest-VolumesExtendTest-1099015543 None] Creating Keystone auth plugin from conf {{(pid=81771) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 22 17:59:56 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-4ed5e197-3da1-4e07-a39e-b648590316a8 tempest-VolumesExtendTest-1099015543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (627f1047-628a-4407-8083-880ddcc3f295) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6e55611f-359e-4cf7-8961-aba0aae950ab', 'volume_name': 'volume-6e55611f-359e-4cf7-8961-aba0aae950ab', 'volume_size': 1, 'image_id': '9e076047-8ac8-4bf8-88ea-602aa20d3c9e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9e076047-8ac8-4bf8-88ea-602aa20d3c9e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '39e18fb0fde242f68d38bed6963e8744', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9e076047-8ac8-4bf8-88ea-602aa20d3c9e', 'created_at': datetime.datetime(2026, 4, 22, 15, 44, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 22, 15, 44, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9e076047-8ac8-4bf8-88ea-602aa20d3c9e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:59:56 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-4ed5e197-3da1-4e07-a39e-b648590316a8 tempest-VolumesExtendTest-1099015543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e6aa496-1c3f-4817-975a-eb959e317e5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:59:56 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-4ed5e197-3da1-4e07-a39e-b648590316a8 tempest-VolumesExtendTest-1099015543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e6aa496-1c3f-4817-975a-eb959e317e5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 17:59:56 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-4ed5e197-3da1-4e07-a39e-b648590316a8 tempest-VolumesExtendTest-1099015543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07c24f6b-4a0a-4ac4-b2a7-efba17154c83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 17:59:56 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-4ed5e197-3da1-4e07-a39e-b648590316a8 tempest-VolumesExtendTest-1099015543 None] Volume 6e55611f-359e-4cf7-8961-aba0aae950ab: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6e55611f-359e-4cf7-8961-aba0aae950ab', 'volume_size': 1, 'image_id': '9e076047-8ac8-4bf8-88ea-602aa20d3c9e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9e076047-8ac8-4bf8-88ea-602aa20d3c9e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '39e18fb0fde242f68d38bed6963e8744', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9e076047-8ac8-4bf8-88ea-602aa20d3c9e', 'created_at': datetime.datetime(2026, 4, 22, 15, 44, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 22, 15, 44, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9e076047-8ac8-4bf8-88ea-602aa20d3c9e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 22 17:59:56 devstack cinder-volume[81771]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ed5e197-3da1-4e07-a39e-b648590316a8 tempest-VolumesExtendTest-1099015543 None] Trying to clone 6e55611f-359e-4cf7-8961-aba0aae950ab from image 9e076047-8ac8-4bf8-88ea-602aa20d3c9e at location (None, [{'url': 'file:///opt/stack/data/glance/images/9e076047-8ac8-4bf8-88ea-602aa20d3c9e', 'metadata': {}}]). {{(pid=81771) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 22 17:59:56 devstack cinder-volume[81771]: DEBUG cinder.image.image_utils [None req-4ed5e197-3da1-4e07-a39e-b648590316a8 tempest-VolumesExtendTest-1099015543 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9e076047-8ac8-4bf8-88ea-602aa20d3c9e_3w8eb8n7devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=81771) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 22 17:59:56 devstack cinder-volume[81771]: INFO cinder.image.image_utils [None req-4ed5e197-3da1-4e07-a39e-b648590316a8 tempest-VolumesExtendTest-1099015543 None] Image download 20.69 MB at 20.69 MB/s Apr 22 17:59:56 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[e773518f-86c7-4a23-82de-a07a12a0f378]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:59:56 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-4ed5e197-3da1-4e07-a39e-b648590316a8 tempest-VolumesExtendTest-1099015543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9e076047-8ac8-4bf8-88ea-602aa20d3c9e_3w8eb8n7devstack@QuobyteHD {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:59:57 devstack sudo[90041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9e076047-8ac8-4bf8-88ea-602aa20d3c9e_3w8eb8n7devstack@QuobyteHD Apr 22 17:59:57 devstack sudo[90041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:59:57 devstack sudo[90041]: pam_unix(sudo:session): session closed for user root Apr 22 17:59:57 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-4ed5e197-3da1-4e07-a39e-b648590316a8 tempest-VolumesExtendTest-1099015543 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9e076047-8ac8-4bf8-88ea-602aa20d3c9e_3w8eb8n7devstack@QuobyteHD" returned: 0 in 0.482s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:59:57 devstack cinder-volume[81771]: DEBUG cinder.image.image_utils [None req-4ed5e197-3da1-4e07-a39e-b648590316a8 tempest-VolumesExtendTest-1099015543 None] Temporary image 9e076047-8ac8-4bf8-88ea-602aa20d3c9e is fetched for user 9033a0828526412b913692b5593a1e82. {{(pid=81771) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 22 17:59:57 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fab79ae-902c-4c14-90f6-020803ffa2d7]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:59:57 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-4ed5e197-3da1-4e07-a39e-b648590316a8 tempest-VolumesExtendTest-1099015543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9e076047-8ac8-4bf8-88ea-602aa20d3c9e_3w8eb8n7devstack@QuobyteHD {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:59:57 devstack sudo[90047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9e076047-8ac8-4bf8-88ea-602aa20d3c9e_3w8eb8n7devstack@QuobyteHD Apr 22 17:59:57 devstack sudo[90047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:59:57 devstack sudo[90047]: pam_unix(sudo:session): session closed for user root Apr 22 17:59:57 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-4ed5e197-3da1-4e07-a39e-b648590316a8 tempest-VolumesExtendTest-1099015543 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9e076047-8ac8-4bf8-88ea-602aa20d3c9e_3w8eb8n7devstack@QuobyteHD" returned: 0 in 0.471s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:59:57 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-4ed5e197-3da1-4e07-a39e-b648590316a8 tempest-VolumesExtendTest-1099015543 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:59:57 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-4ed5e197-3da1-4e07-a39e-b648590316a8 tempest-VolumesExtendTest-1099015543 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:59:57 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-4ed5e197-3da1-4e07-a39e-b648590316a8 tempest-VolumesExtendTest-1099015543 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T15:59:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-597666050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e55611f-359e-4cf7-8961-aba0aae950ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a66ce0ac9e2b41c3b95497606622347d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T15:59:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T15:59:56Z,use_quota=True,user_id='9033a0828526412b913692b5593a1e82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)}" {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 17:59:57 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-4ed5e197-3da1-4e07-a39e-b648590316a8 tempest-VolumesExtendTest-1099015543 None] Creating volume 6e55611f-359e-4cf7-8961-aba0aae950ab {{(pid=81771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 17:59:57 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-4ed5e197-3da1-4e07-a39e-b648590316a8 tempest-VolumesExtendTest-1099015543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 17:59:57 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-4ed5e197-3da1-4e07-a39e-b648590316a8 tempest-VolumesExtendTest-1099015543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 17:59:57 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-4ed5e197-3da1-4e07-a39e-b648590316a8 tempest-VolumesExtendTest-1099015543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 17:59:57 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-4ed5e197-3da1-4e07-a39e-b648590316a8 tempest-VolumesExtendTest-1099015543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 17:59:57 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-4ed5e197-3da1-4e07-a39e-b648590316a8 tempest-VolumesExtendTest-1099015543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:59:57 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-4ed5e197-3da1-4e07-a39e-b648590316a8 tempest-VolumesExtendTest-1099015543 None] Selected osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 as target Quobyte volume. {{(pid=81771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 17:59:57 devstack cinder-volume[81771]: INFO cinder.volume.drivers.remotefs [None req-4ed5e197-3da1-4e07-a39e-b648590316a8 tempest-VolumesExtendTest-1099015543 None] casted to osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 Apr 22 17:59:57 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-4ed5e197-3da1-4e07-a39e-b648590316a8 tempest-VolumesExtendTest-1099015543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-6e55611f-359e-4cf7-8961-aba0aae950ab 1073741824 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:59:57 devstack sudo[90052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-6e55611f-359e-4cf7-8961-aba0aae950ab 1073741824 Apr 22 17:59:58 devstack sudo[90052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:59:58 devstack sudo[90052]: pam_unix(sudo:session): session closed for user root Apr 22 17:59:58 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-4ed5e197-3da1-4e07-a39e-b648590316a8 tempest-VolumesExtendTest-1099015543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-6e55611f-359e-4cf7-8961-aba0aae950ab 1073741824" returned: 0 in 0.652s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:59:58 devstack cinder-volume[81771]: DEBUG dbcounter [-] [81771] Writing DB stats cinder:SELECT=113,cinder:UPDATE=134,cinder:INSERT=48,cinder:DELETE=11 {{(pid=81771) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 22 17:59:58 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-4ed5e197-3da1-4e07-a39e-b648590316a8 tempest-VolumesExtendTest-1099015543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-6e55611f-359e-4cf7-8961-aba0aae950ab {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:59:58 devstack sudo[90089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-6e55611f-359e-4cf7-8961-aba0aae950ab Apr 22 17:59:58 devstack sudo[90089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:59:59 devstack sudo[90089]: pam_unix(sudo:session): session closed for user root Apr 22 17:59:59 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-4ed5e197-3da1-4e07-a39e-b648590316a8 tempest-VolumesExtendTest-1099015543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-6e55611f-359e-4cf7-8961-aba0aae950ab" returned: 0 in 0.474s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:59:59 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-4ed5e197-3da1-4e07-a39e-b648590316a8 tempest-VolumesExtendTest-1099015543 None] <== create_volume: return (1170ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'} {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 17:59:59 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-4ed5e197-3da1-4e07-a39e-b648590316a8 tempest-VolumesExtendTest-1099015543 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.173s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 17:59:59 devstack cinder-volume[81771]: DEBUG dbcounter [-] [81771] Writing DB stats cinder:DELETE=14,cinder:UPDATE=160,cinder:SELECT=114,cinder:INSERT=27 {{(pid=81771) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 22 17:59:59 devstack cinder-volume[81771]: DEBUG cinder.volume.volume_utils [None req-4ed5e197-3da1-4e07-a39e-b648590316a8 tempest-VolumesExtendTest-1099015543 None] Attempting download of 9e076047-8ac8-4bf8-88ea-602aa20d3c9e ((None, [{'url': 'file:///opt/stack/data/glance/images/9e076047-8ac8-4bf8-88ea-602aa20d3c9e', 'metadata': {}}])) to volume 6e55611f-359e-4cf7-8961-aba0aae950ab. {{(pid=81771) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 22 17:59:59 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[07d5e221-5388-4366-8ec1-6421c0edbc6c]: (4, 'raw') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 17:59:59 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-4ed5e197-3da1-4e07-a39e-b648590316a8 tempest-VolumesExtendTest-1099015543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9e076047-8ac8-4bf8-88ea-602aa20d3c9e_xtmyi7np {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:59:59 devstack sudo[90094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9e076047-8ac8-4bf8-88ea-602aa20d3c9e_xtmyi7np Apr 22 17:59:59 devstack sudo[90094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 17:59:59 devstack sudo[90094]: pam_unix(sudo:session): session closed for user root Apr 22 17:59:59 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-4ed5e197-3da1-4e07-a39e-b648590316a8 tempest-VolumesExtendTest-1099015543 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9e076047-8ac8-4bf8-88ea-602aa20d3c9e_xtmyi7np" returned: 0 in 0.491s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 17:59:59 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-4ed5e197-3da1-4e07-a39e-b648590316a8 tempest-VolumesExtendTest-1099015543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9e076047-8ac8-4bf8-88ea-602aa20d3c9e_xtmyi7np {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 17:59:59 devstack sudo[90098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9e076047-8ac8-4bf8-88ea-602aa20d3c9e_xtmyi7np Apr 22 17:59:59 devstack sudo[90098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:00:00 devstack sudo[90098]: pam_unix(sudo:session): session closed for user root Apr 22 18:00:00 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-4ed5e197-3da1-4e07-a39e-b648590316a8 tempest-VolumesExtendTest-1099015543 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9e076047-8ac8-4bf8-88ea-602aa20d3c9e_xtmyi7np" returned: 1 in 0.510s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:00:00 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-4ed5e197-3da1-4e07-a39e-b648590316a8 tempest-VolumesExtendTest-1099015543 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9e076047-8ac8-4bf8-88ea-602aa20d3c9e_xtmyi7np' failed. Not Retrying. {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 22 18:00:00 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7335ed9-0790-4a29-a358-18601aedd6bf]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 18:00:00 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-4ed5e197-3da1-4e07-a39e-b648590316a8 tempest-VolumesExtendTest-1099015543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9e076047-8ac8-4bf8-88ea-602aa20d3c9e_3w8eb8n7devstack@QuobyteHD {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:00:00 devstack sudo[90102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9e076047-8ac8-4bf8-88ea-602aa20d3c9e_3w8eb8n7devstack@QuobyteHD Apr 22 18:00:00 devstack sudo[90102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:00:00 devstack sudo[90102]: pam_unix(sudo:session): session closed for user root Apr 22 18:00:00 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-4ed5e197-3da1-4e07-a39e-b648590316a8 tempest-VolumesExtendTest-1099015543 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9e076047-8ac8-4bf8-88ea-602aa20d3c9e_3w8eb8n7devstack@QuobyteHD" returned: 0 in 0.490s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:00:00 devstack cinder-volume[81771]: DEBUG cinder.image.image_utils [None req-4ed5e197-3da1-4e07-a39e-b648590316a8 tempest-VolumesExtendTest-1099015543 None] 9e076047-8ac8-4bf8-88ea-602aa20d3c9e was qcow2, converting to raw {{(pid=81771) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 22 18:00:00 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-4ed5e197-3da1-4e07-a39e-b648590316a8 tempest-VolumesExtendTest-1099015543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9e076047-8ac8-4bf8-88ea-602aa20d3c9e_3w8eb8n7devstack@QuobyteHD /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-6e55611f-359e-4cf7-8961-aba0aae950ab {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:00:00 devstack sudo[90108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9e076047-8ac8-4bf8-88ea-602aa20d3c9e_3w8eb8n7devstack@QuobyteHD /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-6e55611f-359e-4cf7-8961-aba0aae950ab Apr 22 18:00:00 devstack sudo[90108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:00:02 devstack sudo[90108]: pam_unix(sudo:session): session closed for user root Apr 22 18:00:02 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-4ed5e197-3da1-4e07-a39e-b648590316a8 tempest-VolumesExtendTest-1099015543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9e076047-8ac8-4bf8-88ea-602aa20d3c9e_3w8eb8n7devstack@QuobyteHD /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-6e55611f-359e-4cf7-8961-aba0aae950ab" returned: 0 in 1.303s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:00:02 devstack cinder-volume[81771]: DEBUG cinder.image.image_utils [None req-4ed5e197-3da1-4e07-a39e-b648590316a8 tempest-VolumesExtendTest-1099015543 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9e076047-8ac8-4bf8-88ea-602aa20d3c9e_3w8eb8n7devstack@QuobyteHD, size 112.00 MB, duration 1.30 sec, destination /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-6e55611f-359e-4cf7-8961-aba0aae950ab {{(pid=81771) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 22 18:00:02 devstack cinder-volume[81771]: INFO cinder.image.image_utils [None req-4ed5e197-3da1-4e07-a39e-b648590316a8 tempest-VolumesExtendTest-1099015543 None] Converted 112.00 MB image at 85.85 MB/s Apr 22 18:00:02 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-4ed5e197-3da1-4e07-a39e-b648590316a8 tempest-VolumesExtendTest-1099015543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-6e55611f-359e-4cf7-8961-aba0aae950ab 1G {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:00:02 devstack sudo[90122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-6e55611f-359e-4cf7-8961-aba0aae950ab 1G Apr 22 18:00:02 devstack sudo[90122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:00:02 devstack sudo[90122]: pam_unix(sudo:session): session closed for user root Apr 22 18:00:02 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-4ed5e197-3da1-4e07-a39e-b648590316a8 tempest-VolumesExtendTest-1099015543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-6e55611f-359e-4cf7-8961-aba0aae950ab 1G" returned: 0 in 0.477s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:00:02 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[d73c0790-4f9b-41cc-a9df-f7dd4e955da0]: (4, 'raw') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 18:00:02 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-4ed5e197-3da1-4e07-a39e-b648590316a8 tempest-VolumesExtendTest-1099015543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-6e55611f-359e-4cf7-8961-aba0aae950ab {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:00:02 devstack sudo[90127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-6e55611f-359e-4cf7-8961-aba0aae950ab Apr 22 18:00:02 devstack sudo[90127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:00:03 devstack sudo[90127]: pam_unix(sudo:session): session closed for user root Apr 22 18:00:03 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-4ed5e197-3da1-4e07-a39e-b648590316a8 tempest-VolumesExtendTest-1099015543 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-6e55611f-359e-4cf7-8961-aba0aae950ab" returned: 0 in 0.513s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:00:03 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-4ed5e197-3da1-4e07-a39e-b648590316a8 tempest-VolumesExtendTest-1099015543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-6e55611f-359e-4cf7-8961-aba0aae950ab {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:00:03 devstack sudo[90131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-6e55611f-359e-4cf7-8961-aba0aae950ab Apr 22 18:00:03 devstack sudo[90131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:00:03 devstack sudo[90131]: pam_unix(sudo:session): session closed for user root Apr 22 18:00:03 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-4ed5e197-3da1-4e07-a39e-b648590316a8 tempest-VolumesExtendTest-1099015543 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-6e55611f-359e-4cf7-8961-aba0aae950ab" returned: 1 in 0.523s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:00:03 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-4ed5e197-3da1-4e07-a39e-b648590316a8 tempest-VolumesExtendTest-1099015543 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-6e55611f-359e-4cf7-8961-aba0aae950ab' failed. Not Retrying. {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 22 18:00:03 devstack cinder-volume[81771]: DEBUG cinder.volume.volume_utils [None req-4ed5e197-3da1-4e07-a39e-b648590316a8 tempest-VolumesExtendTest-1099015543 None] Downloaded image 9e076047-8ac8-4bf8-88ea-602aa20d3c9e ((None, [{'url': 'file:///opt/stack/data/glance/images/9e076047-8ac8-4bf8-88ea-602aa20d3c9e', 'metadata': {}}])) to volume 6e55611f-359e-4cf7-8961-aba0aae950ab successfully. {{(pid=81771) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 22 18:00:03 devstack cinder-volume[81771]: DEBUG cinder.image.image_utils [None req-4ed5e197-3da1-4e07-a39e-b648590316a8 tempest-VolumesExtendTest-1099015543 None] Temporary image 9e076047-8ac8-4bf8-88ea-602aa20d3c9e for user 9033a0828526412b913692b5593a1e82 is deleted. {{(pid=81771) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 22 18:00:03 devstack cinder-volume[81771]: DEBUG cinder.volume.volume_utils [None req-4ed5e197-3da1-4e07-a39e-b648590316a8 tempest-VolumesExtendTest-1099015543 None] Marking volume 6e55611f-359e-4cf7-8961-aba0aae950ab as bootable. {{(pid=81771) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 22 18:00:03 devstack cinder-volume[81771]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ed5e197-3da1-4e07-a39e-b648590316a8 tempest-VolumesExtendTest-1099015543 None] Copying metadata from image 9e076047-8ac8-4bf8-88ea-602aa20d3c9e to 6e55611f-359e-4cf7-8961-aba0aae950ab. {{(pid=81771) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 22 18:00:03 devstack cinder-volume[81771]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ed5e197-3da1-4e07-a39e-b648590316a8 tempest-VolumesExtendTest-1099015543 None] Creating volume glance metadata for volume 6e55611f-359e-4cf7-8961-aba0aae950ab backed by image 9e076047-8ac8-4bf8-88ea-602aa20d3c9e with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '9e076047-8ac8-4bf8-88ea-602aa20d3c9e', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=81771) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 22 18:00:03 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-4ed5e197-3da1-4e07-a39e-b648590316a8 tempest-VolumesExtendTest-1099015543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07c24f6b-4a0a-4ac4-b2a7-efba17154c83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e55611f-359e-4cf7-8961-aba0aae950ab', 'volume_size': 1, 'image_id': '9e076047-8ac8-4bf8-88ea-602aa20d3c9e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9e076047-8ac8-4bf8-88ea-602aa20d3c9e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '39e18fb0fde242f68d38bed6963e8744', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9e076047-8ac8-4bf8-88ea-602aa20d3c9e', 'created_at': datetime.datetime(2026, 4, 22, 15, 44, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 22, 15, 44, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9e076047-8ac8-4bf8-88ea-602aa20d3c9e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:00:03 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-4ed5e197-3da1-4e07-a39e-b648590316a8 tempest-VolumesExtendTest-1099015543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7959cb2-72e8-4306-abd4-140ab77d8e17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:00:03 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-4ed5e197-3da1-4e07-a39e-b648590316a8 tempest-VolumesExtendTest-1099015543 None] Volume volume-6e55611f-359e-4cf7-8961-aba0aae950ab (6e55611f-359e-4cf7-8961-aba0aae950ab): created successfully Apr 22 18:00:03 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-4ed5e197-3da1-4e07-a39e-b648590316a8 tempest-VolumesExtendTest-1099015543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7959cb2-72e8-4306-abd4-140ab77d8e17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:00:03 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-4ed5e197-3da1-4e07-a39e-b648590316a8 tempest-VolumesExtendTest-1099015543 None] Flow 'volume_create_manager' (0a23aa78-fdf0-4b7c-8e88-a68ac8957617) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 18:00:03 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-4ed5e197-3da1-4e07-a39e-b648590316a8 tempest-VolumesExtendTest-1099015543 None] Created volume successfully. Apr 22 18:00:04 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-b9d4f2fd-9efd-49c9-bb30-b4415dab3351 tempest-VolumesExtendTest-1099015543 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 18:00:04 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-b9d4f2fd-9efd-49c9-bb30-b4415dab3351 tempest-VolumesExtendTest-1099015543 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 18:00:04 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1afad9b-7c5b-4528-83ff-5fff1dca6b7e]: (4, 'raw') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 18:00:04 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-b9d4f2fd-9efd-49c9-bb30-b4415dab3351 tempest-VolumesExtendTest-1099015543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-6e55611f-359e-4cf7-8961-aba0aae950ab {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:00:04 devstack sudo[90136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-6e55611f-359e-4cf7-8961-aba0aae950ab Apr 22 18:00:04 devstack sudo[90136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:00:05 devstack sudo[90136]: pam_unix(sudo:session): session closed for user root Apr 22 18:00:05 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-b9d4f2fd-9efd-49c9-bb30-b4415dab3351 tempest-VolumesExtendTest-1099015543 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-6e55611f-359e-4cf7-8961-aba0aae950ab" returned: 0 in 0.518s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:00:05 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-b9d4f2fd-9efd-49c9-bb30-b4415dab3351 tempest-VolumesExtendTest-1099015543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-6e55611f-359e-4cf7-8961-aba0aae950ab {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:00:05 devstack sudo[90140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-6e55611f-359e-4cf7-8961-aba0aae950ab Apr 22 18:00:05 devstack sudo[90140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:00:05 devstack sudo[90140]: pam_unix(sudo:session): session closed for user root Apr 22 18:00:05 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-b9d4f2fd-9efd-49c9-bb30-b4415dab3351 tempest-VolumesExtendTest-1099015543 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-6e55611f-359e-4cf7-8961-aba0aae950ab" returned: 1 in 0.520s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:00:05 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-b9d4f2fd-9efd-49c9-bb30-b4415dab3351 tempest-VolumesExtendTest-1099015543 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-6e55611f-359e-4cf7-8961-aba0aae950ab' failed. Not Retrying. {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 22 18:00:05 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-b9d4f2fd-9efd-49c9-bb30-b4415dab3351 tempest-VolumesExtendTest-1099015543 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-6e55611f-359e-4cf7-8961-aba0aae950ab 2G {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:00:05 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-b9d4f2fd-9efd-49c9-bb30-b4415dab3351 tempest-VolumesExtendTest-1099015543 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-6e55611f-359e-4cf7-8961-aba0aae950ab 2G" returned: 0 in 0.060s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:00:05 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-b9d4f2fd-9efd-49c9-bb30-b4415dab3351 tempest-VolumesExtendTest-1099015543 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.135s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 18:00:05 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-b9d4f2fd-9efd-49c9-bb30-b4415dab3351 tempest-VolumesExtendTest-1099015543 None] Extend volume completed successfully. Apr 22 18:00:06 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-1f47ba57-7f86-4b0c-b7db-3285cce52706 tempest-VolumesExtendTest-1099015543 None] Acquiring lock "cinder-6e55611f-359e-4cf7-8961-aba0aae950ab-delete_volume" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 18:00:06 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-1f47ba57-7f86-4b0c-b7db-3285cce52706 tempest-VolumesExtendTest-1099015543 None] Lock "cinder-6e55611f-359e-4cf7-8961-aba0aae950ab-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 18:00:07 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-1f47ba57-7f86-4b0c-b7db-3285cce52706 tempest-VolumesExtendTest-1099015543 None] Acquiring lock "cinder-quobyte-6e55611f-359e-4cf7-8961-aba0aae950ab" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 18:00:07 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-1f47ba57-7f86-4b0c-b7db-3285cce52706 tempest-VolumesExtendTest-1099015543 None] Lock "cinder-quobyte-6e55611f-359e-4cf7-8961-aba0aae950ab" acquired by "delete_volume" :: waited 0.014s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 18:00:07 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b75c561-f505-4274-b174-e79a7df4d901]: (4, 'raw') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 18:00:07 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-1f47ba57-7f86-4b0c-b7db-3285cce52706 tempest-VolumesExtendTest-1099015543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-6e55611f-359e-4cf7-8961-aba0aae950ab {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:00:07 devstack sudo[90148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-6e55611f-359e-4cf7-8961-aba0aae950ab Apr 22 18:00:07 devstack sudo[90148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:00:07 devstack sudo[90148]: pam_unix(sudo:session): session closed for user root Apr 22 18:00:07 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-1f47ba57-7f86-4b0c-b7db-3285cce52706 tempest-VolumesExtendTest-1099015543 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-6e55611f-359e-4cf7-8961-aba0aae950ab" returned: 0 in 0.520s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:00:07 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-1f47ba57-7f86-4b0c-b7db-3285cce52706 tempest-VolumesExtendTest-1099015543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-6e55611f-359e-4cf7-8961-aba0aae950ab {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:00:07 devstack sudo[90153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-6e55611f-359e-4cf7-8961-aba0aae950ab Apr 22 18:00:07 devstack sudo[90153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:00:08 devstack sudo[90153]: pam_unix(sudo:session): session closed for user root Apr 22 18:00:08 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-1f47ba57-7f86-4b0c-b7db-3285cce52706 tempest-VolumesExtendTest-1099015543 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-6e55611f-359e-4cf7-8961-aba0aae950ab" returned: 1 in 0.527s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:00:08 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-1f47ba57-7f86-4b0c-b7db-3285cce52706 tempest-VolumesExtendTest-1099015543 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-6e55611f-359e-4cf7-8961-aba0aae950ab' failed. Not Retrying. {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 22 18:00:08 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-1f47ba57-7f86-4b0c-b7db-3285cce52706 tempest-VolumesExtendTest-1099015543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-6e55611f-359e-4cf7-8961-aba0aae950ab {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:00:08 devstack sudo[90158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-6e55611f-359e-4cf7-8961-aba0aae950ab Apr 22 18:00:08 devstack sudo[90158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:00:08 devstack sudo[90158]: pam_unix(sudo:session): session closed for user root Apr 22 18:00:08 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-1f47ba57-7f86-4b0c-b7db-3285cce52706 tempest-VolumesExtendTest-1099015543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-6e55611f-359e-4cf7-8961-aba0aae950ab" returned: 0 in 0.447s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:00:08 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-1f47ba57-7f86-4b0c-b7db-3285cce52706 tempest-VolumesExtendTest-1099015543 None] Lock "cinder-quobyte-6e55611f-359e-4cf7-8961-aba0aae950ab" released by "delete_volume" :: held 1.555s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 18:00:08 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-1f47ba57-7f86-4b0c-b7db-3285cce52706 tempest-VolumesExtendTest-1099015543 None] Created reservations ['91a3245f-2908-4f1d-901f-6298f0974453', 'd411b714-7811-486e-9fb0-ff7b5b27dec1', 'f1af5987-6cac-4aac-9d6c-46ef7875a47b', '12a2aca9-cd19-429a-96b6-3572718e697e'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 18:00:08 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-1f47ba57-7f86-4b0c-b7db-3285cce52706 tempest-VolumesExtendTest-1099015543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 18:00:08 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-1f47ba57-7f86-4b0c-b7db-3285cce52706 tempest-VolumesExtendTest-1099015543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 18:00:08 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-1f47ba57-7f86-4b0c-b7db-3285cce52706 tempest-VolumesExtendTest-1099015543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 18:00:08 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-1f47ba57-7f86-4b0c-b7db-3285cce52706 tempest-VolumesExtendTest-1099015543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 18:00:08 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-1f47ba57-7f86-4b0c-b7db-3285cce52706 tempest-VolumesExtendTest-1099015543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 18:00:08 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-1f47ba57-7f86-4b0c-b7db-3285cce52706 tempest-VolumesExtendTest-1099015543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:00:08 devstack sudo[90161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 Apr 22 18:00:08 devstack sudo[90161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:00:09 devstack sudo[90161]: pam_unix(sudo:session): session closed for user root Apr 22 18:00:09 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-1f47ba57-7f86-4b0c-b7db-3285cce52706 tempest-VolumesExtendTest-1099015543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33" returned: 0 in 0.445s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:00:09 devstack cinder-volume[81771]: DEBUG cinder.manager [None req-1f47ba57-7f86-4b0c-b7db-3285cce52706 tempest-VolumesExtendTest-1099015543 None] Notifying Schedulers of capabilities ... {{(pid=81771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 18:00:09 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-1f47ba57-7f86-4b0c-b7db-3285cce52706 tempest-VolumesExtendTest-1099015543 None] Deleted volume successfully. Apr 22 18:00:09 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-1f47ba57-7f86-4b0c-b7db-3285cce52706 tempest-VolumesExtendTest-1099015543 None] Lock "cinder-6e55611f-359e-4cf7-8961-aba0aae950ab-delete_volume" released by "delete_volume" :: held 2.191s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 18:00:09 devstack cinder-volume[81771]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1edb2cc-fea9-486a-bad0-bd4eeb8d98e6 tempest-VolumesExtendTest-1099015543 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 18:00:09 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-b1edb2cc-fea9-486a-bad0-bd4eeb8d98e6 tempest-VolumesExtendTest-1099015543 None] Flow 'volume_create_manager' (5a0f2bad-4ce8-4c99-b2c6-51010083e2b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 18:00:09 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-b1edb2cc-fea9-486a-bad0-bd4eeb8d98e6 tempest-VolumesExtendTest-1099015543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db3591ab-91a2-4947-9a92-96d5b7d6d6d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:00:09 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-b1edb2cc-fea9-486a-bad0-bd4eeb8d98e6 tempest-VolumesExtendTest-1099015543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db3591ab-91a2-4947-9a92-96d5b7d6d6d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T16:00:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2106830448',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc264598-19cb-4aac-97e8-e67b55e0a3ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a66ce0ac9e2b41c3b95497606622347d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T16:00:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T16:00:09Z,use_quota=True,user_id='9033a0828526412b913692b5593a1e82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:00:09 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-b1edb2cc-fea9-486a-bad0-bd4eeb8d98e6 tempest-VolumesExtendTest-1099015543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d7d821c-a9e2-45ca-b1b8-b987e217db05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:00:09 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-b1edb2cc-fea9-486a-bad0-bd4eeb8d98e6 tempest-VolumesExtendTest-1099015543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d7d821c-a9e2-45ca-b1b8-b987e217db05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:00:09 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-b1edb2cc-fea9-486a-bad0-bd4eeb8d98e6 tempest-VolumesExtendTest-1099015543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d97e606-4fa0-4597-b93c-362922ac1ac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:00:09 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-b1edb2cc-fea9-486a-bad0-bd4eeb8d98e6 tempest-VolumesExtendTest-1099015543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d97e606-4fa0-4597-b93c-362922ac1ac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc264598-19cb-4aac-97e8-e67b55e0a3ac', 'volume_name': 'volume-cc264598-19cb-4aac-97e8-e67b55e0a3ac', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:00:09 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-b1edb2cc-fea9-486a-bad0-bd4eeb8d98e6 tempest-VolumesExtendTest-1099015543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2bb9695-7dad-47e5-a9c9-6417e1808ecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:00:09 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-b1edb2cc-fea9-486a-bad0-bd4eeb8d98e6 tempest-VolumesExtendTest-1099015543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2bb9695-7dad-47e5-a9c9-6417e1808ecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:00:09 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-b1edb2cc-fea9-486a-bad0-bd4eeb8d98e6 tempest-VolumesExtendTest-1099015543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2de1597-ba87-4869-99ae-bd0ec019cab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:00:09 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-b1edb2cc-fea9-486a-bad0-bd4eeb8d98e6 tempest-VolumesExtendTest-1099015543 None] Volume cc264598-19cb-4aac-97e8-e67b55e0a3ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc264598-19cb-4aac-97e8-e67b55e0a3ac', 'volume_size': 1} Apr 22 18:00:09 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-b1edb2cc-fea9-486a-bad0-bd4eeb8d98e6 tempest-VolumesExtendTest-1099015543 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 18:00:09 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-b1edb2cc-fea9-486a-bad0-bd4eeb8d98e6 tempest-VolumesExtendTest-1099015543 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 18:00:09 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-b1edb2cc-fea9-486a-bad0-bd4eeb8d98e6 tempest-VolumesExtendTest-1099015543 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T16:00:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2106830448',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc264598-19cb-4aac-97e8-e67b55e0a3ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a66ce0ac9e2b41c3b95497606622347d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T16:00:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T16:00:09Z,use_quota=True,user_id='9033a0828526412b913692b5593a1e82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)}" {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 18:00:09 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-b1edb2cc-fea9-486a-bad0-bd4eeb8d98e6 tempest-VolumesExtendTest-1099015543 None] Creating volume cc264598-19cb-4aac-97e8-e67b55e0a3ac {{(pid=81771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 18:00:09 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-b1edb2cc-fea9-486a-bad0-bd4eeb8d98e6 tempest-VolumesExtendTest-1099015543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 18:00:09 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-b1edb2cc-fea9-486a-bad0-bd4eeb8d98e6 tempest-VolumesExtendTest-1099015543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 18:00:09 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-b1edb2cc-fea9-486a-bad0-bd4eeb8d98e6 tempest-VolumesExtendTest-1099015543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 18:00:09 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-b1edb2cc-fea9-486a-bad0-bd4eeb8d98e6 tempest-VolumesExtendTest-1099015543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 18:00:09 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-b1edb2cc-fea9-486a-bad0-bd4eeb8d98e6 tempest-VolumesExtendTest-1099015543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 18:00:09 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-b1edb2cc-fea9-486a-bad0-bd4eeb8d98e6 tempest-VolumesExtendTest-1099015543 None] Selected osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 as target Quobyte volume. {{(pid=81771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 18:00:09 devstack cinder-volume[81771]: INFO cinder.volume.drivers.remotefs [None req-b1edb2cc-fea9-486a-bad0-bd4eeb8d98e6 tempest-VolumesExtendTest-1099015543 None] casted to osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 Apr 22 18:00:09 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-b1edb2cc-fea9-486a-bad0-bd4eeb8d98e6 tempest-VolumesExtendTest-1099015543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-cc264598-19cb-4aac-97e8-e67b55e0a3ac 1073741824 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:00:09 devstack sudo[90164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-cc264598-19cb-4aac-97e8-e67b55e0a3ac 1073741824 Apr 22 18:00:09 devstack sudo[90164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:00:10 devstack sudo[90164]: pam_unix(sudo:session): session closed for user root Apr 22 18:00:10 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-b1edb2cc-fea9-486a-bad0-bd4eeb8d98e6 tempest-VolumesExtendTest-1099015543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-cc264598-19cb-4aac-97e8-e67b55e0a3ac 1073741824" returned: 0 in 0.614s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:00:10 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-b1edb2cc-fea9-486a-bad0-bd4eeb8d98e6 tempest-VolumesExtendTest-1099015543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-cc264598-19cb-4aac-97e8-e67b55e0a3ac {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:00:10 devstack sudo[90169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-cc264598-19cb-4aac-97e8-e67b55e0a3ac Apr 22 18:00:10 devstack sudo[90169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:00:10 devstack sudo[90169]: pam_unix(sudo:session): session closed for user root Apr 22 18:00:10 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-b1edb2cc-fea9-486a-bad0-bd4eeb8d98e6 tempest-VolumesExtendTest-1099015543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-cc264598-19cb-4aac-97e8-e67b55e0a3ac" returned: 0 in 0.453s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:00:10 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-b1edb2cc-fea9-486a-bad0-bd4eeb8d98e6 tempest-VolumesExtendTest-1099015543 None] <== create_volume: return (1103ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'} {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 18:00:10 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-b1edb2cc-fea9-486a-bad0-bd4eeb8d98e6 tempest-VolumesExtendTest-1099015543 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.105s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 18:00:10 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-b1edb2cc-fea9-486a-bad0-bd4eeb8d98e6 tempest-VolumesExtendTest-1099015543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2de1597-ba87-4869-99ae-bd0ec019cab2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc264598-19cb-4aac-97e8-e67b55e0a3ac', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:00:10 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-b1edb2cc-fea9-486a-bad0-bd4eeb8d98e6 tempest-VolumesExtendTest-1099015543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3faff82a-010e-4095-b397-b39c71314893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:00:10 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-b1edb2cc-fea9-486a-bad0-bd4eeb8d98e6 tempest-VolumesExtendTest-1099015543 None] Volume volume-cc264598-19cb-4aac-97e8-e67b55e0a3ac (cc264598-19cb-4aac-97e8-e67b55e0a3ac): created successfully Apr 22 18:00:10 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-b1edb2cc-fea9-486a-bad0-bd4eeb8d98e6 tempest-VolumesExtendTest-1099015543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3faff82a-010e-4095-b397-b39c71314893) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:00:10 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-b1edb2cc-fea9-486a-bad0-bd4eeb8d98e6 tempest-VolumesExtendTest-1099015543 None] Flow 'volume_create_manager' (5a0f2bad-4ce8-4c99-b2c6-51010083e2b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 18:00:10 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-b1edb2cc-fea9-486a-bad0-bd4eeb8d98e6 tempest-VolumesExtendTest-1099015543 None] Created volume successfully. Apr 22 18:00:11 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-0b8410e9-f1a0-457c-b13e-3a5d4e667f05 tempest-VolumesExtendTest-1099015543 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 18:00:11 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-0b8410e9-f1a0-457c-b13e-3a5d4e667f05 tempest-VolumesExtendTest-1099015543 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 18:00:11 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-0b8410e9-f1a0-457c-b13e-3a5d4e667f05 tempest-VolumesExtendTest-1099015543 None] Creating offline snapshot fadaf9f3-5402-4895-9184-1d234062ad35 of volume cc264598-19cb-4aac-97e8-e67b55e0a3ac {{(pid=81771) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 22 18:00:11 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[58884228-f808-4a04-b66c-719442a02452]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 18:00:11 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-0b8410e9-f1a0-457c-b13e-3a5d4e667f05 tempest-VolumesExtendTest-1099015543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-cc264598-19cb-4aac-97e8-e67b55e0a3ac {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:00:11 devstack sudo[90172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-cc264598-19cb-4aac-97e8-e67b55e0a3ac Apr 22 18:00:11 devstack sudo[90172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:00:12 devstack sudo[90172]: pam_unix(sudo:session): session closed for user root Apr 22 18:00:12 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-0b8410e9-f1a0-457c-b13e-3a5d4e667f05 tempest-VolumesExtendTest-1099015543 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-cc264598-19cb-4aac-97e8-e67b55e0a3ac" returned: 0 in 0.527s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:00:12 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-0b8410e9-f1a0-457c-b13e-3a5d4e667f05 tempest-VolumesExtendTest-1099015543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-cc264598-19cb-4aac-97e8-e67b55e0a3ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-cc264598-19cb-4aac-97e8-e67b55e0a3ac.fadaf9f3-5402-4895-9184-1d234062ad35 1G {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:00:12 devstack sudo[90177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-cc264598-19cb-4aac-97e8-e67b55e0a3ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-cc264598-19cb-4aac-97e8-e67b55e0a3ac.fadaf9f3-5402-4895-9184-1d234062ad35 1G Apr 22 18:00:12 devstack sudo[90177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:00:12 devstack sudo[90177]: pam_unix(sudo:session): session closed for user root Apr 22 18:00:12 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-0b8410e9-f1a0-457c-b13e-3a5d4e667f05 tempest-VolumesExtendTest-1099015543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-cc264598-19cb-4aac-97e8-e67b55e0a3ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-cc264598-19cb-4aac-97e8-e67b55e0a3ac.fadaf9f3-5402-4895-9184-1d234062ad35 1G" returned: 0 in 0.603s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:00:12 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-0b8410e9-f1a0-457c-b13e-3a5d4e667f05 tempest-VolumesExtendTest-1099015543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc264598-19cb-4aac-97e8-e67b55e0a3ac -F qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-cc264598-19cb-4aac-97e8-e67b55e0a3ac.fadaf9f3-5402-4895-9184-1d234062ad35 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:00:12 devstack sudo[90182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc264598-19cb-4aac-97e8-e67b55e0a3ac -F qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-cc264598-19cb-4aac-97e8-e67b55e0a3ac.fadaf9f3-5402-4895-9184-1d234062ad35 Apr 22 18:00:12 devstack sudo[90182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:00:13 devstack sudo[90182]: pam_unix(sudo:session): session closed for user root Apr 22 18:00:13 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-0b8410e9-f1a0-457c-b13e-3a5d4e667f05 tempest-VolumesExtendTest-1099015543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc264598-19cb-4aac-97e8-e67b55e0a3ac -F qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-cc264598-19cb-4aac-97e8-e67b55e0a3ac.fadaf9f3-5402-4895-9184-1d234062ad35" returned: 0 in 0.471s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:00:13 devstack cinder-volume[81771]: WARNING cinder.volume.drivers.remotefs [None req-0b8410e9-f1a0-457c-b13e-3a5d4e667f05 tempest-VolumesExtendTest-1099015543 None] /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-cc264598-19cb-4aac-97e8-e67b55e0a3ac.fadaf9f3-5402-4895-9184-1d234062ad35 is being set with open permissions: ugo+rw Apr 22 18:00:13 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-0b8410e9-f1a0-457c-b13e-3a5d4e667f05 tempest-VolumesExtendTest-1099015543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-cc264598-19cb-4aac-97e8-e67b55e0a3ac.fadaf9f3-5402-4895-9184-1d234062ad35 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:00:13 devstack sudo[90187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-cc264598-19cb-4aac-97e8-e67b55e0a3ac.fadaf9f3-5402-4895-9184-1d234062ad35 Apr 22 18:00:13 devstack sudo[90187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:00:13 devstack sudo[90187]: pam_unix(sudo:session): session closed for user root Apr 22 18:00:13 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-0b8410e9-f1a0-457c-b13e-3a5d4e667f05 tempest-VolumesExtendTest-1099015543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-cc264598-19cb-4aac-97e8-e67b55e0a3ac.fadaf9f3-5402-4895-9184-1d234062ad35" returned: 0 in 0.447s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:00:13 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-0b8410e9-f1a0-457c-b13e-3a5d4e667f05 tempest-VolumesExtendTest-1099015543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-cc264598-19cb-4aac-97e8-e67b55e0a3ac.info {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:00:13 devstack sudo[90190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-cc264598-19cb-4aac-97e8-e67b55e0a3ac.info Apr 22 18:00:13 devstack sudo[90190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:00:14 devstack sudo[90190]: pam_unix(sudo:session): session closed for user root Apr 22 18:00:14 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-0b8410e9-f1a0-457c-b13e-3a5d4e667f05 tempest-VolumesExtendTest-1099015543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-cc264598-19cb-4aac-97e8-e67b55e0a3ac.info" returned: 0 in 0.448s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:00:14 devstack cinder-volume[81771]: WARNING cinder.volume.drivers.remotefs [None req-0b8410e9-f1a0-457c-b13e-3a5d4e667f05 tempest-VolumesExtendTest-1099015543 None] /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-cc264598-19cb-4aac-97e8-e67b55e0a3ac.info is being set with open permissions: ugo+rw Apr 22 18:00:14 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-0b8410e9-f1a0-457c-b13e-3a5d4e667f05 tempest-VolumesExtendTest-1099015543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-cc264598-19cb-4aac-97e8-e67b55e0a3ac.info {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:00:14 devstack sudo[90193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-cc264598-19cb-4aac-97e8-e67b55e0a3ac.info Apr 22 18:00:14 devstack sudo[90193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:00:14 devstack sudo[90193]: pam_unix(sudo:session): session closed for user root Apr 22 18:00:14 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-0b8410e9-f1a0-457c-b13e-3a5d4e667f05 tempest-VolumesExtendTest-1099015543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-cc264598-19cb-4aac-97e8-e67b55e0a3ac.info" returned: 0 in 0.440s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:00:14 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-0b8410e9-f1a0-457c-b13e-3a5d4e667f05 tempest-VolumesExtendTest-1099015543 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.024s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 18:00:14 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-0b8410e9-f1a0-457c-b13e-3a5d4e667f05 tempest-VolumesExtendTest-1099015543 None] Create snapshot completed successfully Apr 22 18:00:16 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-323039c5-0a85-4879-9dd0-f3355fd5f569 tempest-VolumesExtendTest-1099015543 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 18:00:16 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-323039c5-0a85-4879-9dd0-f3355fd5f569 tempest-VolumesExtendTest-1099015543 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 18:00:16 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[524d77c1-5af0-4e4c-b2a1-b3a99a6dfb32]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 18:00:16 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-323039c5-0a85-4879-9dd0-f3355fd5f569 tempest-VolumesExtendTest-1099015543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-cc264598-19cb-4aac-97e8-e67b55e0a3ac {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:00:16 devstack sudo[90196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-cc264598-19cb-4aac-97e8-e67b55e0a3ac Apr 22 18:00:16 devstack sudo[90196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:00:16 devstack sudo[90196]: pam_unix(sudo:session): session closed for user root Apr 22 18:00:16 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-323039c5-0a85-4879-9dd0-f3355fd5f569 tempest-VolumesExtendTest-1099015543 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-cc264598-19cb-4aac-97e8-e67b55e0a3ac" returned: 0 in 0.534s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:00:16 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-323039c5-0a85-4879-9dd0-f3355fd5f569 tempest-VolumesExtendTest-1099015543 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-cc264598-19cb-4aac-97e8-e67b55e0a3ac.fadaf9f3-5402-4895-9184-1d234062ad35 2G {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:00:16 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-323039c5-0a85-4879-9dd0-f3355fd5f569 tempest-VolumesExtendTest-1099015543 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-cc264598-19cb-4aac-97e8-e67b55e0a3ac.fadaf9f3-5402-4895-9184-1d234062ad35 2G" returned: 0 in 0.122s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:00:16 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-323039c5-0a85-4879-9dd0-f3355fd5f569 tempest-VolumesExtendTest-1099015543 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.687s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 18:00:16 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-323039c5-0a85-4879-9dd0-f3355fd5f569 tempest-VolumesExtendTest-1099015543 None] Extend volume completed successfully. Apr 22 18:00:17 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-e35bf5fe-2b5b-4f29-b985-6f2ed2f1d1e2 tempest-VolumesExtendTest-1099015543 None] Acquiring lock "cinder-fadaf9f3-5402-4895-9184-1d234062ad35-delete_snapshot" by "delete_snapshot" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 18:00:17 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-e35bf5fe-2b5b-4f29-b985-6f2ed2f1d1e2 tempest-VolumesExtendTest-1099015543 None] Lock "cinder-fadaf9f3-5402-4895-9184-1d234062ad35-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 18:00:17 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-e35bf5fe-2b5b-4f29-b985-6f2ed2f1d1e2 tempest-VolumesExtendTest-1099015543 None] Acquiring lock "cinder-quobyte-cc264598-19cb-4aac-97e8-e67b55e0a3ac" by "delete_snapshot" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 18:00:17 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-e35bf5fe-2b5b-4f29-b985-6f2ed2f1d1e2 tempest-VolumesExtendTest-1099015543 None] Lock "cinder-quobyte-cc264598-19cb-4aac-97e8-e67b55e0a3ac" acquired by "delete_snapshot" :: waited 0.015s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 18:00:17 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-e35bf5fe-2b5b-4f29-b985-6f2ed2f1d1e2 tempest-VolumesExtendTest-1099015543 None] Acquiring lock "cinder-quobyte-fadaf9f3-5402-4895-9184-1d234062ad35" by "_delete_snapshot" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 18:00:17 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-e35bf5fe-2b5b-4f29-b985-6f2ed2f1d1e2 tempest-VolumesExtendTest-1099015543 None] Lock "cinder-quobyte-fadaf9f3-5402-4895-9184-1d234062ad35" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 18:00:17 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-e35bf5fe-2b5b-4f29-b985-6f2ed2f1d1e2 tempest-VolumesExtendTest-1099015543 None] Deleting offline snapshot fadaf9f3-5402-4895-9184-1d234062ad35 of volume cc264598-19cb-4aac-97e8-e67b55e0a3ac {{(pid=81771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 22 18:00:17 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-e35bf5fe-2b5b-4f29-b985-6f2ed2f1d1e2 tempest-VolumesExtendTest-1099015543 None] snapshot_file for this snap is: volume-cc264598-19cb-4aac-97e8-e67b55e0a3ac.fadaf9f3-5402-4895-9184-1d234062ad35 {{(pid=81771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 22 18:00:17 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[c64d7d24-1f3e-43ef-b0fb-ba0ccd9cd737]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 18:00:17 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-e35bf5fe-2b5b-4f29-b985-6f2ed2f1d1e2 tempest-VolumesExtendTest-1099015543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-cc264598-19cb-4aac-97e8-e67b55e0a3ac.fadaf9f3-5402-4895-9184-1d234062ad35 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:00:17 devstack sudo[90205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-cc264598-19cb-4aac-97e8-e67b55e0a3ac.fadaf9f3-5402-4895-9184-1d234062ad35 Apr 22 18:00:17 devstack sudo[90205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:00:17 devstack sudo[90205]: pam_unix(sudo:session): session closed for user root Apr 22 18:00:17 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-e35bf5fe-2b5b-4f29-b985-6f2ed2f1d1e2 tempest-VolumesExtendTest-1099015543 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-cc264598-19cb-4aac-97e8-e67b55e0a3ac.fadaf9f3-5402-4895-9184-1d234062ad35" returned: 0 in 0.524s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:00:17 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-e35bf5fe-2b5b-4f29-b985-6f2ed2f1d1e2 tempest-VolumesExtendTest-1099015543 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cc264598-19cb-4aac-97e8-e67b55e0a3ac(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81771) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 22 18:00:17 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2dd15ac-2eee-4b05-bf79-0d9c4095fbf8]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 18:00:17 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-e35bf5fe-2b5b-4f29-b985-6f2ed2f1d1e2 tempest-VolumesExtendTest-1099015543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-cc264598-19cb-4aac-97e8-e67b55e0a3ac {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:00:17 devstack sudo[90210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-cc264598-19cb-4aac-97e8-e67b55e0a3ac Apr 22 18:00:17 devstack sudo[90210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:00:18 devstack sudo[90210]: pam_unix(sudo:session): session closed for user root Apr 22 18:00:18 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-e35bf5fe-2b5b-4f29-b985-6f2ed2f1d1e2 tempest-VolumesExtendTest-1099015543 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-cc264598-19cb-4aac-97e8-e67b55e0a3ac" returned: 0 in 0.527s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:00:18 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-e35bf5fe-2b5b-4f29-b985-6f2ed2f1d1e2 tempest-VolumesExtendTest-1099015543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-cc264598-19cb-4aac-97e8-e67b55e0a3ac.fadaf9f3-5402-4895-9184-1d234062ad35 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:00:18 devstack sudo[90215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-cc264598-19cb-4aac-97e8-e67b55e0a3ac.fadaf9f3-5402-4895-9184-1d234062ad35 Apr 22 18:00:18 devstack sudo[90215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:00:18 devstack sudo[90215]: pam_unix(sudo:session): session closed for user root Apr 22 18:00:18 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-e35bf5fe-2b5b-4f29-b985-6f2ed2f1d1e2 tempest-VolumesExtendTest-1099015543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-cc264598-19cb-4aac-97e8-e67b55e0a3ac.fadaf9f3-5402-4895-9184-1d234062ad35" returned: 0 in 0.572s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:00:18 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-e35bf5fe-2b5b-4f29-b985-6f2ed2f1d1e2 tempest-VolumesExtendTest-1099015543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-cc264598-19cb-4aac-97e8-e67b55e0a3ac.fadaf9f3-5402-4895-9184-1d234062ad35 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:00:19 devstack sudo[90220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-cc264598-19cb-4aac-97e8-e67b55e0a3ac.fadaf9f3-5402-4895-9184-1d234062ad35 Apr 22 18:00:19 devstack sudo[90220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:00:19 devstack sudo[90220]: pam_unix(sudo:session): session closed for user root Apr 22 18:00:19 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-e35bf5fe-2b5b-4f29-b985-6f2ed2f1d1e2 tempest-VolumesExtendTest-1099015543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-cc264598-19cb-4aac-97e8-e67b55e0a3ac.fadaf9f3-5402-4895-9184-1d234062ad35" returned: 0 in 0.437s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:00:19 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-e35bf5fe-2b5b-4f29-b985-6f2ed2f1d1e2 tempest-VolumesExtendTest-1099015543 None] Lock "cinder-quobyte-fadaf9f3-5402-4895-9184-1d234062ad35" released by "_delete_snapshot" :: held 2.163s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 18:00:19 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-e35bf5fe-2b5b-4f29-b985-6f2ed2f1d1e2 tempest-VolumesExtendTest-1099015543 None] Lock "cinder-quobyte-cc264598-19cb-4aac-97e8-e67b55e0a3ac" released by "delete_snapshot" :: held 2.188s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 18:00:19 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-e35bf5fe-2b5b-4f29-b985-6f2ed2f1d1e2 tempest-VolumesExtendTest-1099015543 None] Created reservations ['bc5f43cf-a2cc-4c24-806c-dfffae452a4f', 'adf83259-2beb-419e-9217-0422c39a663d', 'ce1d8f06-dbce-4b47-8834-4e1a18a87d3e', 'a70ee05c-4913-41a0-b9c9-2ff59130ac58'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 18:00:19 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-e35bf5fe-2b5b-4f29-b985-6f2ed2f1d1e2 tempest-VolumesExtendTest-1099015543 None] Delete snapshot completed successfully. Apr 22 18:00:19 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-e35bf5fe-2b5b-4f29-b985-6f2ed2f1d1e2 tempest-VolumesExtendTest-1099015543 None] Lock "cinder-fadaf9f3-5402-4895-9184-1d234062ad35-delete_snapshot" released by "delete_snapshot" :: held 2.326s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 18:00:20 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-f2172f3c-91a4-4af4-8fbd-4015ec721309 tempest-VolumesExtendTest-1099015543 None] Acquiring lock "cinder-cc264598-19cb-4aac-97e8-e67b55e0a3ac-delete_volume" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 18:00:20 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-f2172f3c-91a4-4af4-8fbd-4015ec721309 tempest-VolumesExtendTest-1099015543 None] Lock "cinder-cc264598-19cb-4aac-97e8-e67b55e0a3ac-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 18:00:20 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-f2172f3c-91a4-4af4-8fbd-4015ec721309 tempest-VolumesExtendTest-1099015543 None] Acquiring lock "cinder-quobyte-cc264598-19cb-4aac-97e8-e67b55e0a3ac" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 18:00:20 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-f2172f3c-91a4-4af4-8fbd-4015ec721309 tempest-VolumesExtendTest-1099015543 None] Lock "cinder-quobyte-cc264598-19cb-4aac-97e8-e67b55e0a3ac" acquired by "delete_volume" :: waited 0.015s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 18:00:20 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[971442cd-af44-43b7-a455-f29f5523444c]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 18:00:20 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-f2172f3c-91a4-4af4-8fbd-4015ec721309 tempest-VolumesExtendTest-1099015543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-cc264598-19cb-4aac-97e8-e67b55e0a3ac {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:00:20 devstack sudo[90223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-cc264598-19cb-4aac-97e8-e67b55e0a3ac Apr 22 18:00:20 devstack sudo[90223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:00:21 devstack sudo[90223]: pam_unix(sudo:session): session closed for user root Apr 22 18:00:21 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-f2172f3c-91a4-4af4-8fbd-4015ec721309 tempest-VolumesExtendTest-1099015543 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-cc264598-19cb-4aac-97e8-e67b55e0a3ac" returned: 0 in 0.532s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:00:21 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-f2172f3c-91a4-4af4-8fbd-4015ec721309 tempest-VolumesExtendTest-1099015543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-cc264598-19cb-4aac-97e8-e67b55e0a3ac {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:00:21 devstack sudo[90228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-cc264598-19cb-4aac-97e8-e67b55e0a3ac Apr 22 18:00:21 devstack sudo[90228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:00:21 devstack sudo[90228]: pam_unix(sudo:session): session closed for user root Apr 22 18:00:21 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-f2172f3c-91a4-4af4-8fbd-4015ec721309 tempest-VolumesExtendTest-1099015543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-cc264598-19cb-4aac-97e8-e67b55e0a3ac" returned: 0 in 0.461s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:00:21 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-f2172f3c-91a4-4af4-8fbd-4015ec721309 tempest-VolumesExtendTest-1099015543 None] Lock "cinder-quobyte-cc264598-19cb-4aac-97e8-e67b55e0a3ac" released by "delete_volume" :: held 1.053s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 18:00:21 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-f2172f3c-91a4-4af4-8fbd-4015ec721309 tempest-VolumesExtendTest-1099015543 None] Created reservations ['ac12520e-5570-46f9-a3ff-e59463aea955', '2546212f-e395-467c-bc6b-795da41b854c', 'a3479874-e302-4f26-b558-d07ea1c19a98', '34bdfd1e-9b4b-47b3-802c-1bc09a7eaa54'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 18:00:21 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-f2172f3c-91a4-4af4-8fbd-4015ec721309 tempest-VolumesExtendTest-1099015543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 18:00:21 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-f2172f3c-91a4-4af4-8fbd-4015ec721309 tempest-VolumesExtendTest-1099015543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 18:00:21 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-f2172f3c-91a4-4af4-8fbd-4015ec721309 tempest-VolumesExtendTest-1099015543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 18:00:21 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-f2172f3c-91a4-4af4-8fbd-4015ec721309 tempest-VolumesExtendTest-1099015543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 18:00:21 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-f2172f3c-91a4-4af4-8fbd-4015ec721309 tempest-VolumesExtendTest-1099015543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 18:00:21 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-f2172f3c-91a4-4af4-8fbd-4015ec721309 tempest-VolumesExtendTest-1099015543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:00:21 devstack sudo[90231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 Apr 22 18:00:21 devstack sudo[90231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:00:22 devstack sudo[90231]: pam_unix(sudo:session): session closed for user root Apr 22 18:00:22 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-f2172f3c-91a4-4af4-8fbd-4015ec721309 tempest-VolumesExtendTest-1099015543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33" returned: 0 in 0.431s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:00:22 devstack cinder-volume[81771]: DEBUG cinder.manager [None req-f2172f3c-91a4-4af4-8fbd-4015ec721309 tempest-VolumesExtendTest-1099015543 None] Notifying Schedulers of capabilities ... {{(pid=81771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 18:00:22 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-f2172f3c-91a4-4af4-8fbd-4015ec721309 tempest-VolumesExtendTest-1099015543 None] Deleted volume successfully. Apr 22 18:00:22 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-f2172f3c-91a4-4af4-8fbd-4015ec721309 tempest-VolumesExtendTest-1099015543 None] Lock "cinder-cc264598-19cb-4aac-97e8-e67b55e0a3ac-delete_volume" released by "delete_volume" :: held 1.691s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 18:00:25 devstack cinder-volume[81771]: DEBUG cinder.volume.flows.manager.create_volume [None req-c72e5969-497d-4396-8d41-5b4f54f3dc03 tempest-VolumesGetTest-1664969689 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 18:00:25 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-c72e5969-497d-4396-8d41-5b4f54f3dc03 tempest-VolumesGetTest-1664969689 None] Flow 'volume_create_manager' (4ce12251-60ee-4e0a-b47f-97c916f5faf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 18:00:25 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-c72e5969-497d-4396-8d41-5b4f54f3dc03 tempest-VolumesGetTest-1664969689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8f3dcbb-6ae5-4281-8891-620505a06f46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:00:25 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-c72e5969-497d-4396-8d41-5b4f54f3dc03 tempest-VolumesGetTest-1664969689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8f3dcbb-6ae5-4281-8891-620505a06f46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T16:00:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1340107680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ec0fed4-5f68-45ed-bd89-f3e6fa3b377e,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a0e7ec173cd3484986be993fbf902802',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T16:00:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T16:00:25Z,use_quota=True,user_id='30d5ce6c7a8843a2b191f01566e89dc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:00:25 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-c72e5969-497d-4396-8d41-5b4f54f3dc03 tempest-VolumesGetTest-1664969689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b09581f6-71d8-461b-86a4-6d006c035e13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:00:25 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-c72e5969-497d-4396-8d41-5b4f54f3dc03 tempest-VolumesGetTest-1664969689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b09581f6-71d8-461b-86a4-6d006c035e13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:00:25 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-c72e5969-497d-4396-8d41-5b4f54f3dc03 tempest-VolumesGetTest-1664969689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98a9c1c3-6791-43d1-81c0-67e1360c3be1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:00:25 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-c72e5969-497d-4396-8d41-5b4f54f3dc03 tempest-VolumesGetTest-1664969689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98a9c1c3-6791-43d1-81c0-67e1360c3be1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ec0fed4-5f68-45ed-bd89-f3e6fa3b377e', 'volume_name': 'volume-9ec0fed4-5f68-45ed-bd89-f3e6fa3b377e', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:00:25 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-c72e5969-497d-4396-8d41-5b4f54f3dc03 tempest-VolumesGetTest-1664969689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e2852bc-e428-478f-9802-1cbeec6f472d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:00:25 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-c72e5969-497d-4396-8d41-5b4f54f3dc03 tempest-VolumesGetTest-1664969689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e2852bc-e428-478f-9802-1cbeec6f472d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:00:25 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-c72e5969-497d-4396-8d41-5b4f54f3dc03 tempest-VolumesGetTest-1664969689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f05999d3-85fe-47ed-94fa-e24915e87528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:00:25 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-c72e5969-497d-4396-8d41-5b4f54f3dc03 tempest-VolumesGetTest-1664969689 None] Volume 9ec0fed4-5f68-45ed-bd89-f3e6fa3b377e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ec0fed4-5f68-45ed-bd89-f3e6fa3b377e', 'volume_size': 1} Apr 22 18:00:25 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-c72e5969-497d-4396-8d41-5b4f54f3dc03 tempest-VolumesGetTest-1664969689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 18:00:25 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-c72e5969-497d-4396-8d41-5b4f54f3dc03 tempest-VolumesGetTest-1664969689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 18:00:25 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-c72e5969-497d-4396-8d41-5b4f54f3dc03 tempest-VolumesGetTest-1664969689 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T16:00:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1340107680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ec0fed4-5f68-45ed-bd89-f3e6fa3b377e,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a0e7ec173cd3484986be993fbf902802',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T16:00:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T16:00:25Z,use_quota=True,user_id='30d5ce6c7a8843a2b191f01566e89dc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)}" {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 18:00:25 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-c72e5969-497d-4396-8d41-5b4f54f3dc03 tempest-VolumesGetTest-1664969689 None] Creating volume 9ec0fed4-5f68-45ed-bd89-f3e6fa3b377e {{(pid=81771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 18:00:25 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-c72e5969-497d-4396-8d41-5b4f54f3dc03 tempest-VolumesGetTest-1664969689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 18:00:25 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-c72e5969-497d-4396-8d41-5b4f54f3dc03 tempest-VolumesGetTest-1664969689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 18:00:25 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-c72e5969-497d-4396-8d41-5b4f54f3dc03 tempest-VolumesGetTest-1664969689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 18:00:25 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-c72e5969-497d-4396-8d41-5b4f54f3dc03 tempest-VolumesGetTest-1664969689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 18:00:25 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-c72e5969-497d-4396-8d41-5b4f54f3dc03 tempest-VolumesGetTest-1664969689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 18:00:25 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-c72e5969-497d-4396-8d41-5b4f54f3dc03 tempest-VolumesGetTest-1664969689 None] Selected osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 as target Quobyte volume. {{(pid=81771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 18:00:25 devstack cinder-volume[81771]: INFO cinder.volume.drivers.remotefs [None req-c72e5969-497d-4396-8d41-5b4f54f3dc03 tempest-VolumesGetTest-1664969689 None] casted to osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 Apr 22 18:00:25 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-c72e5969-497d-4396-8d41-5b4f54f3dc03 tempest-VolumesGetTest-1664969689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-9ec0fed4-5f68-45ed-bd89-f3e6fa3b377e 1073741824 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:00:25 devstack sudo[90235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-9ec0fed4-5f68-45ed-bd89-f3e6fa3b377e 1073741824 Apr 22 18:00:25 devstack sudo[90235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:00:25 devstack sudo[90235]: pam_unix(sudo:session): session closed for user root Apr 22 18:00:25 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-c72e5969-497d-4396-8d41-5b4f54f3dc03 tempest-VolumesGetTest-1664969689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-9ec0fed4-5f68-45ed-bd89-f3e6fa3b377e 1073741824" returned: 0 in 0.591s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:00:25 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-c72e5969-497d-4396-8d41-5b4f54f3dc03 tempest-VolumesGetTest-1664969689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-9ec0fed4-5f68-45ed-bd89-f3e6fa3b377e {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:00:25 devstack sudo[90240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-9ec0fed4-5f68-45ed-bd89-f3e6fa3b377e Apr 22 18:00:25 devstack sudo[90240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:00:26 devstack sudo[90240]: pam_unix(sudo:session): session closed for user root Apr 22 18:00:26 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-c72e5969-497d-4396-8d41-5b4f54f3dc03 tempest-VolumesGetTest-1664969689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-9ec0fed4-5f68-45ed-bd89-f3e6fa3b377e" returned: 0 in 0.455s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:00:26 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-c72e5969-497d-4396-8d41-5b4f54f3dc03 tempest-VolumesGetTest-1664969689 None] <== create_volume: return (1094ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'} {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 18:00:26 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-c72e5969-497d-4396-8d41-5b4f54f3dc03 tempest-VolumesGetTest-1664969689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.097s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 18:00:26 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-c72e5969-497d-4396-8d41-5b4f54f3dc03 tempest-VolumesGetTest-1664969689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f05999d3-85fe-47ed-94fa-e24915e87528) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ec0fed4-5f68-45ed-bd89-f3e6fa3b377e', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:00:26 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-c72e5969-497d-4396-8d41-5b4f54f3dc03 tempest-VolumesGetTest-1664969689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37575edb-f741-4bfe-8a80-99fff28f6b15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:00:26 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-c72e5969-497d-4396-8d41-5b4f54f3dc03 tempest-VolumesGetTest-1664969689 None] Volume volume-9ec0fed4-5f68-45ed-bd89-f3e6fa3b377e (9ec0fed4-5f68-45ed-bd89-f3e6fa3b377e): created successfully Apr 22 18:00:26 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-c72e5969-497d-4396-8d41-5b4f54f3dc03 tempest-VolumesGetTest-1664969689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37575edb-f741-4bfe-8a80-99fff28f6b15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:00:26 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-c72e5969-497d-4396-8d41-5b4f54f3dc03 tempest-VolumesGetTest-1664969689 None] Flow 'volume_create_manager' (4ce12251-60ee-4e0a-b47f-97c916f5faf7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 18:00:26 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-c72e5969-497d-4396-8d41-5b4f54f3dc03 tempest-VolumesGetTest-1664969689 None] Created volume successfully. Apr 22 18:00:27 devstack cinder-volume[81771]: DEBUG cinder.volume.flows.manager.create_volume [None req-00211a42-55d1-405e-a45d-4413c4ac4603 tempest-VolumesGetTest-1664969689 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 18:00:27 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-00211a42-55d1-405e-a45d-4413c4ac4603 tempest-VolumesGetTest-1664969689 None] Flow 'volume_create_manager' (f506fdbb-a592-4483-9ee6-76eb53ebc0e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 18:00:27 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-00211a42-55d1-405e-a45d-4413c4ac4603 tempest-VolumesGetTest-1664969689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b46ea979-1ffb-40ad-bc6a-19d008c46607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:00:27 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-00211a42-55d1-405e-a45d-4413c4ac4603 tempest-VolumesGetTest-1664969689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b46ea979-1ffb-40ad-bc6a-19d008c46607) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T16:00:28Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1879075100',display_name='tempest-VolumesGetTest-Volume-16074683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c88cf028-f606-4fcd-baae-cdb6ba3c62c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0e7ec173cd3484986be993fbf902802',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T16:00:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T16:00:28Z,use_quota=True,user_id='30d5ce6c7a8843a2b191f01566e89dc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:00:27 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-00211a42-55d1-405e-a45d-4413c4ac4603 tempest-VolumesGetTest-1664969689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9c9ec83-f410-44ed-850e-126dc197e897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:00:27 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-00211a42-55d1-405e-a45d-4413c4ac4603 tempest-VolumesGetTest-1664969689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9c9ec83-f410-44ed-850e-126dc197e897) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:00:27 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-00211a42-55d1-405e-a45d-4413c4ac4603 tempest-VolumesGetTest-1664969689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (deeec475-f35d-41fb-8253-e6cbc7cf3cab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:00:27 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-00211a42-55d1-405e-a45d-4413c4ac4603 tempest-VolumesGetTest-1664969689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (deeec475-f35d-41fb-8253-e6cbc7cf3cab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c88cf028-f606-4fcd-baae-cdb6ba3c62c8', 'volume_name': 'volume-c88cf028-f606-4fcd-baae-cdb6ba3c62c8', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:00:27 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-00211a42-55d1-405e-a45d-4413c4ac4603 tempest-VolumesGetTest-1664969689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68921295-bb26-4811-a8e8-510c85fc751b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:00:27 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-00211a42-55d1-405e-a45d-4413c4ac4603 tempest-VolumesGetTest-1664969689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68921295-bb26-4811-a8e8-510c85fc751b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:00:27 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-00211a42-55d1-405e-a45d-4413c4ac4603 tempest-VolumesGetTest-1664969689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (910cf35e-a007-4982-b96b-66a484b2c588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:00:27 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-00211a42-55d1-405e-a45d-4413c4ac4603 tempest-VolumesGetTest-1664969689 None] Volume c88cf028-f606-4fcd-baae-cdb6ba3c62c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c88cf028-f606-4fcd-baae-cdb6ba3c62c8', 'volume_size': 1} Apr 22 18:00:27 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-00211a42-55d1-405e-a45d-4413c4ac4603 tempest-VolumesGetTest-1664969689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 18:00:27 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-00211a42-55d1-405e-a45d-4413c4ac4603 tempest-VolumesGetTest-1664969689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 18:00:27 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-00211a42-55d1-405e-a45d-4413c4ac4603 tempest-VolumesGetTest-1664969689 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T16:00:28Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1879075100',display_name='tempest-VolumesGetTest-Volume-16074683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c88cf028-f606-4fcd-baae-cdb6ba3c62c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0e7ec173cd3484986be993fbf902802',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T16:00:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T16:00:28Z,use_quota=True,user_id='30d5ce6c7a8843a2b191f01566e89dc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)}" {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 18:00:27 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-00211a42-55d1-405e-a45d-4413c4ac4603 tempest-VolumesGetTest-1664969689 None] Creating volume c88cf028-f606-4fcd-baae-cdb6ba3c62c8 {{(pid=81771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 18:00:27 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-00211a42-55d1-405e-a45d-4413c4ac4603 tempest-VolumesGetTest-1664969689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 18:00:27 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-00211a42-55d1-405e-a45d-4413c4ac4603 tempest-VolumesGetTest-1664969689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 18:00:27 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-00211a42-55d1-405e-a45d-4413c4ac4603 tempest-VolumesGetTest-1664969689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 18:00:27 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-00211a42-55d1-405e-a45d-4413c4ac4603 tempest-VolumesGetTest-1664969689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 18:00:27 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-00211a42-55d1-405e-a45d-4413c4ac4603 tempest-VolumesGetTest-1664969689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 18:00:27 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-00211a42-55d1-405e-a45d-4413c4ac4603 tempest-VolumesGetTest-1664969689 None] Selected osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 as target Quobyte volume. {{(pid=81771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 18:00:27 devstack cinder-volume[81771]: INFO cinder.volume.drivers.remotefs [None req-00211a42-55d1-405e-a45d-4413c4ac4603 tempest-VolumesGetTest-1664969689 None] casted to osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 Apr 22 18:00:27 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-00211a42-55d1-405e-a45d-4413c4ac4603 tempest-VolumesGetTest-1664969689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-c88cf028-f606-4fcd-baae-cdb6ba3c62c8 1073741824 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:00:27 devstack sudo[90244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-c88cf028-f606-4fcd-baae-cdb6ba3c62c8 1073741824 Apr 22 18:00:27 devstack sudo[90244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:00:28 devstack sudo[90244]: pam_unix(sudo:session): session closed for user root Apr 22 18:00:28 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-00211a42-55d1-405e-a45d-4413c4ac4603 tempest-VolumesGetTest-1664969689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-c88cf028-f606-4fcd-baae-cdb6ba3c62c8 1073741824" returned: 0 in 0.632s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:00:28 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-00211a42-55d1-405e-a45d-4413c4ac4603 tempest-VolumesGetTest-1664969689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-c88cf028-f606-4fcd-baae-cdb6ba3c62c8 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:00:28 devstack sudo[90249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-c88cf028-f606-4fcd-baae-cdb6ba3c62c8 Apr 22 18:00:28 devstack sudo[90249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:00:29 devstack sudo[90249]: pam_unix(sudo:session): session closed for user root Apr 22 18:00:29 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-00211a42-55d1-405e-a45d-4413c4ac4603 tempest-VolumesGetTest-1664969689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-c88cf028-f606-4fcd-baae-cdb6ba3c62c8" returned: 0 in 0.458s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:00:29 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-00211a42-55d1-405e-a45d-4413c4ac4603 tempest-VolumesGetTest-1664969689 None] <== create_volume: return (1128ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'} {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 18:00:29 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-00211a42-55d1-405e-a45d-4413c4ac4603 tempest-VolumesGetTest-1664969689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.132s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 18:00:29 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-00211a42-55d1-405e-a45d-4413c4ac4603 tempest-VolumesGetTest-1664969689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (910cf35e-a007-4982-b96b-66a484b2c588) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c88cf028-f606-4fcd-baae-cdb6ba3c62c8', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:00:29 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-00211a42-55d1-405e-a45d-4413c4ac4603 tempest-VolumesGetTest-1664969689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fa8a318-77ad-4380-835f-1d524720bf35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:00:29 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-00211a42-55d1-405e-a45d-4413c4ac4603 tempest-VolumesGetTest-1664969689 None] Volume volume-c88cf028-f606-4fcd-baae-cdb6ba3c62c8 (c88cf028-f606-4fcd-baae-cdb6ba3c62c8): created successfully Apr 22 18:00:29 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-00211a42-55d1-405e-a45d-4413c4ac4603 tempest-VolumesGetTest-1664969689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fa8a318-77ad-4380-835f-1d524720bf35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:00:29 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-00211a42-55d1-405e-a45d-4413c4ac4603 tempest-VolumesGetTest-1664969689 None] Flow 'volume_create_manager' (f506fdbb-a592-4483-9ee6-76eb53ebc0e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 18:00:29 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-00211a42-55d1-405e-a45d-4413c4ac4603 tempest-VolumesGetTest-1664969689 None] Created volume successfully. Apr 22 18:00:29 devstack cinder-volume[81771]: DEBUG oslo_service.periodic_task [None req-1a7bdab5-8190-4e00-a2e2-843e5894ab49 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81771) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 22 18:00:29 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-1a7bdab5-8190-4e00-a2e2-843e5894ab49 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 18:00:29 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-1a7bdab5-8190-4e00-a2e2-843e5894ab49 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 18:00:29 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-1a7bdab5-8190-4e00-a2e2-843e5894ab49 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 18:00:29 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-1a7bdab5-8190-4e00-a2e2-843e5894ab49 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 18:00:29 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-1a7bdab5-8190-4e00-a2e2-843e5894ab49 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 18:00:29 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-1a7bdab5-8190-4e00-a2e2-843e5894ab49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:00:29 devstack sudo[90258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 Apr 22 18:00:29 devstack sudo[90258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:00:30 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-690c18f6-eabb-45bb-aaff-f8227879b43b tempest-VolumesGetTest-1664969689 None] Acquiring lock "cinder-c88cf028-f606-4fcd-baae-cdb6ba3c62c8-delete_volume" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 18:00:30 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-690c18f6-eabb-45bb-aaff-f8227879b43b tempest-VolumesGetTest-1664969689 None] Lock "cinder-c88cf028-f606-4fcd-baae-cdb6ba3c62c8-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 18:00:30 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-690c18f6-eabb-45bb-aaff-f8227879b43b tempest-VolumesGetTest-1664969689 None] Acquiring lock "cinder-quobyte-c88cf028-f606-4fcd-baae-cdb6ba3c62c8" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 18:00:30 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-690c18f6-eabb-45bb-aaff-f8227879b43b tempest-VolumesGetTest-1664969689 None] Lock "cinder-quobyte-c88cf028-f606-4fcd-baae-cdb6ba3c62c8" acquired by "delete_volume" :: waited 0.016s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 18:00:30 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b98c010-30d7-4453-9ef2-35b3b54b03a7]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 18:00:30 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-690c18f6-eabb-45bb-aaff-f8227879b43b tempest-VolumesGetTest-1664969689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-c88cf028-f606-4fcd-baae-cdb6ba3c62c8 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:00:30 devstack sudo[90260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-c88cf028-f606-4fcd-baae-cdb6ba3c62c8 Apr 22 18:00:30 devstack sudo[90260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:00:30 devstack sudo[90258]: pam_unix(sudo:session): session closed for user root Apr 22 18:00:30 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-1a7bdab5-8190-4e00-a2e2-843e5894ab49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33" returned: 0 in 0.506s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:00:30 devstack cinder-volume[81771]: DEBUG cinder.manager [None req-1a7bdab5-8190-4e00-a2e2-843e5894ab49 None None] Notifying Schedulers of capabilities ... {{(pid=81771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 18:00:30 devstack sudo[90260]: pam_unix(sudo:session): session closed for user root Apr 22 18:00:30 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-690c18f6-eabb-45bb-aaff-f8227879b43b tempest-VolumesGetTest-1664969689 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-c88cf028-f606-4fcd-baae-cdb6ba3c62c8" returned: 0 in 0.544s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:00:30 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-690c18f6-eabb-45bb-aaff-f8227879b43b tempest-VolumesGetTest-1664969689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-c88cf028-f606-4fcd-baae-cdb6ba3c62c8 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:00:30 devstack sudo[90266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-c88cf028-f606-4fcd-baae-cdb6ba3c62c8 Apr 22 18:00:30 devstack sudo[90266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:00:31 devstack sudo[90266]: pam_unix(sudo:session): session closed for user root Apr 22 18:00:31 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-690c18f6-eabb-45bb-aaff-f8227879b43b tempest-VolumesGetTest-1664969689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-c88cf028-f606-4fcd-baae-cdb6ba3c62c8" returned: 0 in 0.456s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:00:31 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-690c18f6-eabb-45bb-aaff-f8227879b43b tempest-VolumesGetTest-1664969689 None] Lock "cinder-quobyte-c88cf028-f606-4fcd-baae-cdb6ba3c62c8" released by "delete_volume" :: held 1.040s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 18:00:31 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-690c18f6-eabb-45bb-aaff-f8227879b43b tempest-VolumesGetTest-1664969689 None] Created reservations ['8da3940b-da9c-470b-b579-317f1ca82ad5', '1c671495-df5c-4c2e-b2f7-a20c923d58f7', 'e229daa1-9570-41e0-9299-3b4fbeee64df', '84cb709f-0183-46dc-8176-822ffe552cc8'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 18:00:31 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-690c18f6-eabb-45bb-aaff-f8227879b43b tempest-VolumesGetTest-1664969689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 18:00:31 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-690c18f6-eabb-45bb-aaff-f8227879b43b tempest-VolumesGetTest-1664969689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 18:00:31 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-690c18f6-eabb-45bb-aaff-f8227879b43b tempest-VolumesGetTest-1664969689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 18:00:31 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-690c18f6-eabb-45bb-aaff-f8227879b43b tempest-VolumesGetTest-1664969689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 18:00:31 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-690c18f6-eabb-45bb-aaff-f8227879b43b tempest-VolumesGetTest-1664969689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 18:00:31 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-690c18f6-eabb-45bb-aaff-f8227879b43b tempest-VolumesGetTest-1664969689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:00:31 devstack sudo[90269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 Apr 22 18:00:31 devstack sudo[90269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:00:31 devstack sudo[90269]: pam_unix(sudo:session): session closed for user root Apr 22 18:00:31 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-690c18f6-eabb-45bb-aaff-f8227879b43b tempest-VolumesGetTest-1664969689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33" returned: 0 in 0.438s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:00:31 devstack cinder-volume[81771]: DEBUG cinder.manager [None req-690c18f6-eabb-45bb-aaff-f8227879b43b tempest-VolumesGetTest-1664969689 None] Notifying Schedulers of capabilities ... {{(pid=81771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 18:00:31 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-690c18f6-eabb-45bb-aaff-f8227879b43b tempest-VolumesGetTest-1664969689 None] Deleted volume successfully. Apr 22 18:00:31 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-690c18f6-eabb-45bb-aaff-f8227879b43b tempest-VolumesGetTest-1664969689 None] Lock "cinder-c88cf028-f606-4fcd-baae-cdb6ba3c62c8-delete_volume" released by "delete_volume" :: held 1.669s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 18:00:32 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-84124319-bc2d-4696-8918-b693300fc526 tempest-VolumesGetTest-1664969689 None] Acquiring lock "cinder-9ec0fed4-5f68-45ed-bd89-f3e6fa3b377e-delete_volume" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 18:00:32 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-84124319-bc2d-4696-8918-b693300fc526 tempest-VolumesGetTest-1664969689 None] Lock "cinder-9ec0fed4-5f68-45ed-bd89-f3e6fa3b377e-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 18:00:32 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-84124319-bc2d-4696-8918-b693300fc526 tempest-VolumesGetTest-1664969689 None] Acquiring lock "cinder-quobyte-9ec0fed4-5f68-45ed-bd89-f3e6fa3b377e" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 18:00:32 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-84124319-bc2d-4696-8918-b693300fc526 tempest-VolumesGetTest-1664969689 None] Lock "cinder-quobyte-9ec0fed4-5f68-45ed-bd89-f3e6fa3b377e" acquired by "delete_volume" :: waited 0.018s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 18:00:32 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[04b67c6f-7aaa-40bf-b2f0-01b27baee87d]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 18:00:32 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-84124319-bc2d-4696-8918-b693300fc526 tempest-VolumesGetTest-1664969689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-9ec0fed4-5f68-45ed-bd89-f3e6fa3b377e {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:00:32 devstack sudo[90272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-9ec0fed4-5f68-45ed-bd89-f3e6fa3b377e Apr 22 18:00:32 devstack sudo[90272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:00:33 devstack sudo[90272]: pam_unix(sudo:session): session closed for user root Apr 22 18:00:33 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-84124319-bc2d-4696-8918-b693300fc526 tempest-VolumesGetTest-1664969689 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-9ec0fed4-5f68-45ed-bd89-f3e6fa3b377e" returned: 0 in 0.519s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:00:33 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-84124319-bc2d-4696-8918-b693300fc526 tempest-VolumesGetTest-1664969689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-9ec0fed4-5f68-45ed-bd89-f3e6fa3b377e {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:00:33 devstack sudo[90277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-9ec0fed4-5f68-45ed-bd89-f3e6fa3b377e Apr 22 18:00:33 devstack sudo[90277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:00:33 devstack sudo[90277]: pam_unix(sudo:session): session closed for user root Apr 22 18:00:33 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-84124319-bc2d-4696-8918-b693300fc526 tempest-VolumesGetTest-1664969689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-9ec0fed4-5f68-45ed-bd89-f3e6fa3b377e" returned: 0 in 0.444s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:00:33 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-84124319-bc2d-4696-8918-b693300fc526 tempest-VolumesGetTest-1664969689 None] Lock "cinder-quobyte-9ec0fed4-5f68-45ed-bd89-f3e6fa3b377e" released by "delete_volume" :: held 1.015s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 18:00:33 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-84124319-bc2d-4696-8918-b693300fc526 tempest-VolumesGetTest-1664969689 None] Created reservations ['0cf12aca-9765-42d8-bf79-d5c96e919fd8', '944e7d63-648d-4925-850c-11d730d697b7', 'b7506172-ac0c-4928-9f0c-029fd34ded2b', '977d5839-02d6-46b5-9977-af8b10e7373a'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 18:00:33 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-84124319-bc2d-4696-8918-b693300fc526 tempest-VolumesGetTest-1664969689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 18:00:33 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-84124319-bc2d-4696-8918-b693300fc526 tempest-VolumesGetTest-1664969689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 18:00:33 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-84124319-bc2d-4696-8918-b693300fc526 tempest-VolumesGetTest-1664969689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 18:00:33 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-84124319-bc2d-4696-8918-b693300fc526 tempest-VolumesGetTest-1664969689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 18:00:33 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-84124319-bc2d-4696-8918-b693300fc526 tempest-VolumesGetTest-1664969689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 18:00:33 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-84124319-bc2d-4696-8918-b693300fc526 tempest-VolumesGetTest-1664969689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:00:33 devstack sudo[90280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 Apr 22 18:00:33 devstack sudo[90280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:00:34 devstack sudo[90280]: pam_unix(sudo:session): session closed for user root Apr 22 18:00:34 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-84124319-bc2d-4696-8918-b693300fc526 tempest-VolumesGetTest-1664969689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33" returned: 0 in 0.462s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:00:34 devstack cinder-volume[81771]: DEBUG cinder.manager [None req-84124319-bc2d-4696-8918-b693300fc526 tempest-VolumesGetTest-1664969689 None] Notifying Schedulers of capabilities ... {{(pid=81771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 18:00:34 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-84124319-bc2d-4696-8918-b693300fc526 tempest-VolumesGetTest-1664969689 None] Deleted volume successfully. Apr 22 18:00:34 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-84124319-bc2d-4696-8918-b693300fc526 tempest-VolumesGetTest-1664969689 None] Lock "cinder-9ec0fed4-5f68-45ed-bd89-f3e6fa3b377e-delete_volume" released by "delete_volume" :: held 1.681s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 18:00:34 devstack cinder-volume[81771]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7e4658c-2407-4726-a4be-1171ac112824 tempest-VolumesGetTest-1664969689 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 18:00:35 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-b7e4658c-2407-4726-a4be-1171ac112824 tempest-VolumesGetTest-1664969689 None] Flow 'volume_create_manager' (db415243-f64f-4252-a334-80ef8f55a68a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 18:00:35 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-b7e4658c-2407-4726-a4be-1171ac112824 tempest-VolumesGetTest-1664969689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a62ffe70-1945-4157-b8f3-4d1ca5c30bb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:00:35 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-b7e4658c-2407-4726-a4be-1171ac112824 tempest-VolumesGetTest-1664969689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a62ffe70-1945-4157-b8f3-4d1ca5c30bb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T16:00:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1199883291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9b7aa14-0e48-4b1b-bee6-b959cb4b81d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0e7ec173cd3484986be993fbf902802',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T16:00:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T16:00:35Z,use_quota=True,user_id='30d5ce6c7a8843a2b191f01566e89dc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:00:35 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-b7e4658c-2407-4726-a4be-1171ac112824 tempest-VolumesGetTest-1664969689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23848fde-fd38-4e11-918d-cd72d0391b99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:00:35 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-b7e4658c-2407-4726-a4be-1171ac112824 tempest-VolumesGetTest-1664969689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23848fde-fd38-4e11-918d-cd72d0391b99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:00:35 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-b7e4658c-2407-4726-a4be-1171ac112824 tempest-VolumesGetTest-1664969689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e684336-2ba3-4eac-ab0a-133ae30f9603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:00:35 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-b7e4658c-2407-4726-a4be-1171ac112824 tempest-VolumesGetTest-1664969689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e684336-2ba3-4eac-ab0a-133ae30f9603) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9b7aa14-0e48-4b1b-bee6-b959cb4b81d6', 'volume_name': 'volume-a9b7aa14-0e48-4b1b-bee6-b959cb4b81d6', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:00:35 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-b7e4658c-2407-4726-a4be-1171ac112824 tempest-VolumesGetTest-1664969689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20f5941e-6323-4f57-8a85-04a20f284dde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:00:35 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-b7e4658c-2407-4726-a4be-1171ac112824 tempest-VolumesGetTest-1664969689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20f5941e-6323-4f57-8a85-04a20f284dde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:00:35 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-b7e4658c-2407-4726-a4be-1171ac112824 tempest-VolumesGetTest-1664969689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dddf2a3-b734-4676-87c1-cd01b36cd84c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:00:35 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-b7e4658c-2407-4726-a4be-1171ac112824 tempest-VolumesGetTest-1664969689 None] Volume a9b7aa14-0e48-4b1b-bee6-b959cb4b81d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9b7aa14-0e48-4b1b-bee6-b959cb4b81d6', 'volume_size': 1} Apr 22 18:00:35 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-b7e4658c-2407-4726-a4be-1171ac112824 tempest-VolumesGetTest-1664969689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 18:00:35 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-b7e4658c-2407-4726-a4be-1171ac112824 tempest-VolumesGetTest-1664969689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 18:00:35 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-b7e4658c-2407-4726-a4be-1171ac112824 tempest-VolumesGetTest-1664969689 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T16:00:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1199883291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9b7aa14-0e48-4b1b-bee6-b959cb4b81d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0e7ec173cd3484986be993fbf902802',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T16:00:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T16:00:35Z,use_quota=True,user_id='30d5ce6c7a8843a2b191f01566e89dc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)}" {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 18:00:35 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-b7e4658c-2407-4726-a4be-1171ac112824 tempest-VolumesGetTest-1664969689 None] Creating volume a9b7aa14-0e48-4b1b-bee6-b959cb4b81d6 {{(pid=81771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 18:00:35 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-b7e4658c-2407-4726-a4be-1171ac112824 tempest-VolumesGetTest-1664969689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 18:00:35 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-b7e4658c-2407-4726-a4be-1171ac112824 tempest-VolumesGetTest-1664969689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 18:00:35 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-b7e4658c-2407-4726-a4be-1171ac112824 tempest-VolumesGetTest-1664969689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 18:00:35 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-b7e4658c-2407-4726-a4be-1171ac112824 tempest-VolumesGetTest-1664969689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 18:00:35 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-b7e4658c-2407-4726-a4be-1171ac112824 tempest-VolumesGetTest-1664969689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 18:00:35 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-b7e4658c-2407-4726-a4be-1171ac112824 tempest-VolumesGetTest-1664969689 None] Selected osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 as target Quobyte volume. {{(pid=81771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 18:00:35 devstack cinder-volume[81771]: INFO cinder.volume.drivers.remotefs [None req-b7e4658c-2407-4726-a4be-1171ac112824 tempest-VolumesGetTest-1664969689 None] casted to osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 Apr 22 18:00:35 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-b7e4658c-2407-4726-a4be-1171ac112824 tempest-VolumesGetTest-1664969689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a9b7aa14-0e48-4b1b-bee6-b959cb4b81d6 1073741824 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:00:35 devstack sudo[90283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a9b7aa14-0e48-4b1b-bee6-b959cb4b81d6 1073741824 Apr 22 18:00:35 devstack sudo[90283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:00:35 devstack sudo[90283]: pam_unix(sudo:session): session closed for user root Apr 22 18:00:35 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-b7e4658c-2407-4726-a4be-1171ac112824 tempest-VolumesGetTest-1664969689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a9b7aa14-0e48-4b1b-bee6-b959cb4b81d6 1073741824" returned: 0 in 0.622s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:00:35 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-b7e4658c-2407-4726-a4be-1171ac112824 tempest-VolumesGetTest-1664969689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a9b7aa14-0e48-4b1b-bee6-b959cb4b81d6 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:00:35 devstack sudo[90288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a9b7aa14-0e48-4b1b-bee6-b959cb4b81d6 Apr 22 18:00:35 devstack sudo[90288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:00:36 devstack sudo[90288]: pam_unix(sudo:session): session closed for user root Apr 22 18:00:36 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-b7e4658c-2407-4726-a4be-1171ac112824 tempest-VolumesGetTest-1664969689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a9b7aa14-0e48-4b1b-bee6-b959cb4b81d6" returned: 0 in 0.450s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:00:36 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-b7e4658c-2407-4726-a4be-1171ac112824 tempest-VolumesGetTest-1664969689 None] <== create_volume: return (1111ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'} {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 18:00:36 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-b7e4658c-2407-4726-a4be-1171ac112824 tempest-VolumesGetTest-1664969689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.114s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 18:00:36 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-b7e4658c-2407-4726-a4be-1171ac112824 tempest-VolumesGetTest-1664969689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dddf2a3-b734-4676-87c1-cd01b36cd84c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9b7aa14-0e48-4b1b-bee6-b959cb4b81d6', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:00:36 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-b7e4658c-2407-4726-a4be-1171ac112824 tempest-VolumesGetTest-1664969689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b83b6dde-317d-43f3-9981-3b7c7397192f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:00:36 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-b7e4658c-2407-4726-a4be-1171ac112824 tempest-VolumesGetTest-1664969689 None] Volume volume-a9b7aa14-0e48-4b1b-bee6-b959cb4b81d6 (a9b7aa14-0e48-4b1b-bee6-b959cb4b81d6): created successfully Apr 22 18:00:36 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-b7e4658c-2407-4726-a4be-1171ac112824 tempest-VolumesGetTest-1664969689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b83b6dde-317d-43f3-9981-3b7c7397192f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:00:36 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-b7e4658c-2407-4726-a4be-1171ac112824 tempest-VolumesGetTest-1664969689 None] Flow 'volume_create_manager' (db415243-f64f-4252-a334-80ef8f55a68a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 18:00:36 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-b7e4658c-2407-4726-a4be-1171ac112824 tempest-VolumesGetTest-1664969689 None] Created volume successfully. Apr 22 18:00:37 devstack cinder-volume[81771]: DEBUG cinder.volume.flows.manager.create_volume [None req-8eb4c9b3-b201-42c8-a070-4a9b4bcfca76 tempest-VolumesGetTest-1664969689 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 18:00:37 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-8eb4c9b3-b201-42c8-a070-4a9b4bcfca76 tempest-VolumesGetTest-1664969689 None] Flow 'volume_create_manager' (dbeb38fe-217d-4d51-8d5f-da2e8f46f359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 18:00:37 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-8eb4c9b3-b201-42c8-a070-4a9b4bcfca76 tempest-VolumesGetTest-1664969689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3357533-b934-4872-87ed-1b91a67300f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:00:37 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-8eb4c9b3-b201-42c8-a070-4a9b4bcfca76 tempest-VolumesGetTest-1664969689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3357533-b934-4872-87ed-1b91a67300f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T16:00:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2134643762',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b8226c8-4d12-45c0-af9f-5928ddb557b2,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a0e7ec173cd3484986be993fbf902802',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T16:00:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=a9b7aa14-0e48-4b1b-bee6-b959cb4b81d6,status='creating',terminated_at=None,updated_at=2026-04-22T16:00:37Z,use_quota=True,user_id='30d5ce6c7a8843a2b191f01566e89dc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:00:37 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-8eb4c9b3-b201-42c8-a070-4a9b4bcfca76 tempest-VolumesGetTest-1664969689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b26a50a7-af9c-48ac-98a3-cbce7eac80db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:00:37 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-8eb4c9b3-b201-42c8-a070-4a9b4bcfca76 tempest-VolumesGetTest-1664969689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b26a50a7-af9c-48ac-98a3-cbce7eac80db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:00:37 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-8eb4c9b3-b201-42c8-a070-4a9b4bcfca76 tempest-VolumesGetTest-1664969689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3d42158-7458-4748-b7c4-282a46a39dd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:00:37 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-8eb4c9b3-b201-42c8-a070-4a9b4bcfca76 tempest-VolumesGetTest-1664969689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3d42158-7458-4748-b7c4-282a46a39dd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '2b8226c8-4d12-45c0-af9f-5928ddb557b2', 'volume_name': 'volume-2b8226c8-4d12-45c0-af9f-5928ddb557b2', 'volume_size': 1, 'source_volid': 'a9b7aa14-0e48-4b1b-bee6-b959cb4b81d6', 'source_volstatus': 'available'}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:00:37 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-8eb4c9b3-b201-42c8-a070-4a9b4bcfca76 tempest-VolumesGetTest-1664969689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ee132e3-444e-4dc0-b6c9-f3b003851531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:00:37 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-8eb4c9b3-b201-42c8-a070-4a9b4bcfca76 tempest-VolumesGetTest-1664969689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ee132e3-444e-4dc0-b6c9-f3b003851531) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:00:37 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-8eb4c9b3-b201-42c8-a070-4a9b4bcfca76 tempest-VolumesGetTest-1664969689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1db56fc8-55dd-4960-839a-5048b545cc36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:00:37 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-8eb4c9b3-b201-42c8-a070-4a9b4bcfca76 tempest-VolumesGetTest-1664969689 None] Volume 2b8226c8-4d12-45c0-af9f-5928ddb557b2: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-2b8226c8-4d12-45c0-af9f-5928ddb557b2', 'volume_size': 1, 'source_volid': 'a9b7aa14-0e48-4b1b-bee6-b959cb4b81d6', 'source_volstatus': 'available'} Apr 22 18:00:37 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-8eb4c9b3-b201-42c8-a070-4a9b4bcfca76 tempest-VolumesGetTest-1664969689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 18:00:37 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-8eb4c9b3-b201-42c8-a070-4a9b4bcfca76 tempest-VolumesGetTest-1664969689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 18:00:37 devstack cinder-volume[81771]: INFO cinder.volume.drivers.remotefs [None req-8eb4c9b3-b201-42c8-a070-4a9b4bcfca76 tempest-VolumesGetTest-1664969689 None] Cloning volume a9b7aa14-0e48-4b1b-bee6-b959cb4b81d6 to volume 2b8226c8-4d12-45c0-af9f-5928ddb557b2 Apr 22 18:00:37 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-8eb4c9b3-b201-42c8-a070-4a9b4bcfca76 tempest-VolumesGetTest-1664969689 None] Creating offline snapshot 83cbdc9a-506b-47f1-a387-14e5a8216bb5 of volume a9b7aa14-0e48-4b1b-bee6-b959cb4b81d6 {{(pid=81771) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 22 18:00:37 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[b225b300-ad8d-4365-9283-d74980f24583]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 18:00:37 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-8eb4c9b3-b201-42c8-a070-4a9b4bcfca76 tempest-VolumesGetTest-1664969689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a9b7aa14-0e48-4b1b-bee6-b959cb4b81d6 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:00:37 devstack sudo[90292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a9b7aa14-0e48-4b1b-bee6-b959cb4b81d6 Apr 22 18:00:37 devstack sudo[90292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:00:38 devstack sudo[90292]: pam_unix(sudo:session): session closed for user root Apr 22 18:00:38 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-8eb4c9b3-b201-42c8-a070-4a9b4bcfca76 tempest-VolumesGetTest-1664969689 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a9b7aa14-0e48-4b1b-bee6-b959cb4b81d6" returned: 0 in 0.536s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:00:38 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-8eb4c9b3-b201-42c8-a070-4a9b4bcfca76 tempest-VolumesGetTest-1664969689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a9b7aa14-0e48-4b1b-bee6-b959cb4b81d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a9b7aa14-0e48-4b1b-bee6-b959cb4b81d6.83cbdc9a-506b-47f1-a387-14e5a8216bb5 1G {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:00:38 devstack sudo[90297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a9b7aa14-0e48-4b1b-bee6-b959cb4b81d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a9b7aa14-0e48-4b1b-bee6-b959cb4b81d6.83cbdc9a-506b-47f1-a387-14e5a8216bb5 1G Apr 22 18:00:38 devstack sudo[90297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:00:38 devstack sudo[90297]: pam_unix(sudo:session): session closed for user root Apr 22 18:00:38 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-8eb4c9b3-b201-42c8-a070-4a9b4bcfca76 tempest-VolumesGetTest-1664969689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a9b7aa14-0e48-4b1b-bee6-b959cb4b81d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a9b7aa14-0e48-4b1b-bee6-b959cb4b81d6.83cbdc9a-506b-47f1-a387-14e5a8216bb5 1G" returned: 0 in 0.610s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:00:38 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-8eb4c9b3-b201-42c8-a070-4a9b4bcfca76 tempest-VolumesGetTest-1664969689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a9b7aa14-0e48-4b1b-bee6-b959cb4b81d6 -F qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a9b7aa14-0e48-4b1b-bee6-b959cb4b81d6.83cbdc9a-506b-47f1-a387-14e5a8216bb5 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:00:38 devstack sudo[90302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a9b7aa14-0e48-4b1b-bee6-b959cb4b81d6 -F qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a9b7aa14-0e48-4b1b-bee6-b959cb4b81d6.83cbdc9a-506b-47f1-a387-14e5a8216bb5 Apr 22 18:00:38 devstack sudo[90302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:00:39 devstack sudo[90302]: pam_unix(sudo:session): session closed for user root Apr 22 18:00:39 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-8eb4c9b3-b201-42c8-a070-4a9b4bcfca76 tempest-VolumesGetTest-1664969689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a9b7aa14-0e48-4b1b-bee6-b959cb4b81d6 -F qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a9b7aa14-0e48-4b1b-bee6-b959cb4b81d6.83cbdc9a-506b-47f1-a387-14e5a8216bb5" returned: 0 in 0.517s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:00:39 devstack cinder-volume[81771]: WARNING cinder.volume.drivers.remotefs [None req-8eb4c9b3-b201-42c8-a070-4a9b4bcfca76 tempest-VolumesGetTest-1664969689 None] /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a9b7aa14-0e48-4b1b-bee6-b959cb4b81d6.83cbdc9a-506b-47f1-a387-14e5a8216bb5 is being set with open permissions: ugo+rw Apr 22 18:00:39 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-8eb4c9b3-b201-42c8-a070-4a9b4bcfca76 tempest-VolumesGetTest-1664969689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a9b7aa14-0e48-4b1b-bee6-b959cb4b81d6.83cbdc9a-506b-47f1-a387-14e5a8216bb5 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:00:39 devstack sudo[90307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a9b7aa14-0e48-4b1b-bee6-b959cb4b81d6.83cbdc9a-506b-47f1-a387-14e5a8216bb5 Apr 22 18:00:39 devstack sudo[90307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:00:39 devstack sudo[90307]: pam_unix(sudo:session): session closed for user root Apr 22 18:00:39 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-8eb4c9b3-b201-42c8-a070-4a9b4bcfca76 tempest-VolumesGetTest-1664969689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a9b7aa14-0e48-4b1b-bee6-b959cb4b81d6.83cbdc9a-506b-47f1-a387-14e5a8216bb5" returned: 0 in 0.437s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:00:39 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-8eb4c9b3-b201-42c8-a070-4a9b4bcfca76 tempest-VolumesGetTest-1664969689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a9b7aa14-0e48-4b1b-bee6-b959cb4b81d6.info {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:00:39 devstack sudo[90310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a9b7aa14-0e48-4b1b-bee6-b959cb4b81d6.info Apr 22 18:00:39 devstack sudo[90310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:00:40 devstack sudo[90310]: pam_unix(sudo:session): session closed for user root Apr 22 18:00:40 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-8eb4c9b3-b201-42c8-a070-4a9b4bcfca76 tempest-VolumesGetTest-1664969689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a9b7aa14-0e48-4b1b-bee6-b959cb4b81d6.info" returned: 0 in 0.447s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:00:40 devstack cinder-volume[81771]: WARNING cinder.volume.drivers.remotefs [None req-8eb4c9b3-b201-42c8-a070-4a9b4bcfca76 tempest-VolumesGetTest-1664969689 None] /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a9b7aa14-0e48-4b1b-bee6-b959cb4b81d6.info is being set with open permissions: ugo+rw Apr 22 18:00:40 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-8eb4c9b3-b201-42c8-a070-4a9b4bcfca76 tempest-VolumesGetTest-1664969689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a9b7aa14-0e48-4b1b-bee6-b959cb4b81d6.info {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:00:40 devstack sudo[90313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a9b7aa14-0e48-4b1b-bee6-b959cb4b81d6.info Apr 22 18:00:40 devstack sudo[90313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:00:40 devstack sudo[90313]: pam_unix(sudo:session): session closed for user root Apr 22 18:00:40 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-8eb4c9b3-b201-42c8-a070-4a9b4bcfca76 tempest-VolumesGetTest-1664969689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a9b7aa14-0e48-4b1b-bee6-b959cb4b81d6.info" returned: 0 in 0.446s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:00:40 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-8eb4c9b3-b201-42c8-a070-4a9b4bcfca76 tempest-VolumesGetTest-1664969689 None] Acquiring lock "cinder-quobyte-2b8226c8-4d12-45c0-af9f-5928ddb557b2" by "_copy_volume_from_snapshot" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 18:00:40 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-8eb4c9b3-b201-42c8-a070-4a9b4bcfca76 tempest-VolumesGetTest-1664969689 None] Lock "cinder-quobyte-2b8226c8-4d12-45c0-af9f-5928ddb557b2" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 18:00:40 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-8eb4c9b3-b201-42c8-a070-4a9b4bcfca76 tempest-VolumesGetTest-1664969689 None] snapshot: 83cbdc9a-506b-47f1-a387-14e5a8216bb5, volume: 2b8226c8-4d12-45c0-af9f-5928ddb557b2, {{(pid=81771) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 22 18:00:40 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-8eb4c9b3-b201-42c8-a070-4a9b4bcfca76 tempest-VolumesGetTest-1664969689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 18:00:40 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-8eb4c9b3-b201-42c8-a070-4a9b4bcfca76 tempest-VolumesGetTest-1664969689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 18:00:40 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-8eb4c9b3-b201-42c8-a070-4a9b4bcfca76 tempest-VolumesGetTest-1664969689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 18:00:40 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-8eb4c9b3-b201-42c8-a070-4a9b4bcfca76 tempest-VolumesGetTest-1664969689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 18:00:40 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-8eb4c9b3-b201-42c8-a070-4a9b4bcfca76 tempest-VolumesGetTest-1664969689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 18:00:40 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4be6a4c-d879-4a34-8852-c5cb2f19bae5]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 18:00:40 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-8eb4c9b3-b201-42c8-a070-4a9b4bcfca76 tempest-VolumesGetTest-1664969689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a9b7aa14-0e48-4b1b-bee6-b959cb4b81d6.83cbdc9a-506b-47f1-a387-14e5a8216bb5 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:00:40 devstack sudo[90316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a9b7aa14-0e48-4b1b-bee6-b959cb4b81d6.83cbdc9a-506b-47f1-a387-14e5a8216bb5 Apr 22 18:00:40 devstack sudo[90316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:00:41 devstack sudo[90316]: pam_unix(sudo:session): session closed for user root Apr 22 18:00:41 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-8eb4c9b3-b201-42c8-a070-4a9b4bcfca76 tempest-VolumesGetTest-1664969689 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a9b7aa14-0e48-4b1b-bee6-b959cb4b81d6.83cbdc9a-506b-47f1-a387-14e5a8216bb5" returned: 0 in 0.512s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:00:41 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-8eb4c9b3-b201-42c8-a070-4a9b4bcfca76 tempest-VolumesGetTest-1664969689 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a9b7aa14-0e48-4b1b-bee6-b959cb4b81d6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81771) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 22 18:00:41 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-8eb4c9b3-b201-42c8-a070-4a9b4bcfca76 tempest-VolumesGetTest-1664969689 None] will copy from snapshot at /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a9b7aa14-0e48-4b1b-bee6-b959cb4b81d6 {{(pid=81771) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 22 18:00:41 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-8eb4c9b3-b201-42c8-a070-4a9b4bcfca76 tempest-VolumesGetTest-1664969689 None] Creating direct copy from snapshot {{(pid=81771) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 22 18:00:41 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[29e83fd9-da54-49b5-be8c-ce32f6013233]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 18:00:41 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-8eb4c9b3-b201-42c8-a070-4a9b4bcfca76 tempest-VolumesGetTest-1664969689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a9b7aa14-0e48-4b1b-bee6-b959cb4b81d6 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:00:41 devstack sudo[90321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a9b7aa14-0e48-4b1b-bee6-b959cb4b81d6 Apr 22 18:00:41 devstack sudo[90321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:00:41 devstack sudo[90321]: pam_unix(sudo:session): session closed for user root Apr 22 18:00:41 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-8eb4c9b3-b201-42c8-a070-4a9b4bcfca76 tempest-VolumesGetTest-1664969689 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a9b7aa14-0e48-4b1b-bee6-b959cb4b81d6" returned: 0 in 0.532s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:00:41 devstack cinder-volume[81771]: DEBUG cinder.utils [None req-8eb4c9b3-b201-42c8-a070-4a9b4bcfca76 tempest-VolumesGetTest-1664969689 None] Path /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-2b8226c8-4d12-45c0-af9f-5928ddb557b2 not found in is_blk_device check {{(pid=81771) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 22 18:00:41 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-8eb4c9b3-b201-42c8-a070-4a9b4bcfca76 tempest-VolumesGetTest-1664969689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a9b7aa14-0e48-4b1b-bee6-b959cb4b81d6 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-2b8226c8-4d12-45c0-af9f-5928ddb557b2 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:00:41 devstack sudo[90326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a9b7aa14-0e48-4b1b-bee6-b959cb4b81d6 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-2b8226c8-4d12-45c0-af9f-5928ddb557b2 Apr 22 18:00:41 devstack sudo[90326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:00:46 devstack sudo[90326]: pam_unix(sudo:session): session closed for user root Apr 22 18:00:46 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-8eb4c9b3-b201-42c8-a070-4a9b4bcfca76 tempest-VolumesGetTest-1664969689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a9b7aa14-0e48-4b1b-bee6-b959cb4b81d6 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-2b8226c8-4d12-45c0-af9f-5928ddb557b2" returned: 0 in 4.543s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:00:46 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f489847-9ec1-4e0a-ad46-df1d8cbb8cfd]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 18:00:46 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-8eb4c9b3-b201-42c8-a070-4a9b4bcfca76 tempest-VolumesGetTest-1664969689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a9b7aa14-0e48-4b1b-bee6-b959cb4b81d6 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:00:46 devstack sudo[90340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a9b7aa14-0e48-4b1b-bee6-b959cb4b81d6 Apr 22 18:00:46 devstack sudo[90340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:00:46 devstack sudo[90340]: pam_unix(sudo:session): session closed for user root Apr 22 18:00:46 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-8eb4c9b3-b201-42c8-a070-4a9b4bcfca76 tempest-VolumesGetTest-1664969689 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a9b7aa14-0e48-4b1b-bee6-b959cb4b81d6" returned: 0 in 0.654s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:00:46 devstack cinder-volume[81771]: DEBUG cinder.image.image_utils [None req-8eb4c9b3-b201-42c8-a070-4a9b4bcfca76 tempest-VolumesGetTest-1664969689 None] Image conversion details: src /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a9b7aa14-0e48-4b1b-bee6-b959cb4b81d6, size 1024.00 MB, duration 4.54 sec, destination /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-2b8226c8-4d12-45c0-af9f-5928ddb557b2 {{(pid=81771) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 22 18:00:46 devstack cinder-volume[81771]: INFO cinder.image.image_utils [None req-8eb4c9b3-b201-42c8-a070-4a9b4bcfca76 tempest-VolumesGetTest-1664969689 None] Converted 1024.00 MB image at 225.34 MB/s Apr 22 18:00:46 devstack cinder-volume[81771]: WARNING cinder.volume.drivers.remotefs [None req-8eb4c9b3-b201-42c8-a070-4a9b4bcfca76 tempest-VolumesGetTest-1664969689 None] /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-2b8226c8-4d12-45c0-af9f-5928ddb557b2 is being set with open permissions: ugo+rw Apr 22 18:00:46 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-8eb4c9b3-b201-42c8-a070-4a9b4bcfca76 tempest-VolumesGetTest-1664969689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-2b8226c8-4d12-45c0-af9f-5928ddb557b2 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:00:47 devstack sudo[90345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-2b8226c8-4d12-45c0-af9f-5928ddb557b2 Apr 22 18:00:47 devstack sudo[90345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:00:47 devstack sudo[90345]: pam_unix(sudo:session): session closed for user root Apr 22 18:00:47 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-8eb4c9b3-b201-42c8-a070-4a9b4bcfca76 tempest-VolumesGetTest-1664969689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-2b8226c8-4d12-45c0-af9f-5928ddb557b2" returned: 0 in 0.481s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:00:47 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-8eb4c9b3-b201-42c8-a070-4a9b4bcfca76 tempest-VolumesGetTest-1664969689 None] Lock "cinder-quobyte-2b8226c8-4d12-45c0-af9f-5928ddb557b2" released by "_copy_volume_from_snapshot" :: held 6.794s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 18:00:47 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-8eb4c9b3-b201-42c8-a070-4a9b4bcfca76 tempest-VolumesGetTest-1664969689 None] Acquiring lock "cinder-quobyte-83cbdc9a-506b-47f1-a387-14e5a8216bb5" by "_delete_snapshot" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 18:00:47 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-8eb4c9b3-b201-42c8-a070-4a9b4bcfca76 tempest-VolumesGetTest-1664969689 None] Lock "cinder-quobyte-83cbdc9a-506b-47f1-a387-14e5a8216bb5" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 18:00:47 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-8eb4c9b3-b201-42c8-a070-4a9b4bcfca76 tempest-VolumesGetTest-1664969689 None] Deleting offline snapshot 83cbdc9a-506b-47f1-a387-14e5a8216bb5 of volume a9b7aa14-0e48-4b1b-bee6-b959cb4b81d6 {{(pid=81771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 22 18:00:47 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-8eb4c9b3-b201-42c8-a070-4a9b4bcfca76 tempest-VolumesGetTest-1664969689 None] snapshot_file for this snap is: volume-a9b7aa14-0e48-4b1b-bee6-b959cb4b81d6.83cbdc9a-506b-47f1-a387-14e5a8216bb5 {{(pid=81771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 22 18:00:47 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[12ac04d9-64b9-4efe-8920-3f82e01a4603]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 18:00:47 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-8eb4c9b3-b201-42c8-a070-4a9b4bcfca76 tempest-VolumesGetTest-1664969689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a9b7aa14-0e48-4b1b-bee6-b959cb4b81d6.83cbdc9a-506b-47f1-a387-14e5a8216bb5 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:00:47 devstack sudo[90350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a9b7aa14-0e48-4b1b-bee6-b959cb4b81d6.83cbdc9a-506b-47f1-a387-14e5a8216bb5 Apr 22 18:00:47 devstack sudo[90350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:00:48 devstack sudo[90350]: pam_unix(sudo:session): session closed for user root Apr 22 18:00:48 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-8eb4c9b3-b201-42c8-a070-4a9b4bcfca76 tempest-VolumesGetTest-1664969689 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a9b7aa14-0e48-4b1b-bee6-b959cb4b81d6.83cbdc9a-506b-47f1-a387-14e5a8216bb5" returned: 0 in 0.516s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:00:48 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-8eb4c9b3-b201-42c8-a070-4a9b4bcfca76 tempest-VolumesGetTest-1664969689 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a9b7aa14-0e48-4b1b-bee6-b959cb4b81d6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81771) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 22 18:00:48 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c062a00-74b1-4369-bf74-b6d0cf4dcc9e]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 18:00:48 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-8eb4c9b3-b201-42c8-a070-4a9b4bcfca76 tempest-VolumesGetTest-1664969689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a9b7aa14-0e48-4b1b-bee6-b959cb4b81d6 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:00:48 devstack sudo[90355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a9b7aa14-0e48-4b1b-bee6-b959cb4b81d6 Apr 22 18:00:48 devstack sudo[90355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:00:48 devstack sudo[90355]: pam_unix(sudo:session): session closed for user root Apr 22 18:00:48 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-8eb4c9b3-b201-42c8-a070-4a9b4bcfca76 tempest-VolumesGetTest-1664969689 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a9b7aa14-0e48-4b1b-bee6-b959cb4b81d6" returned: 0 in 0.535s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:00:48 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-8eb4c9b3-b201-42c8-a070-4a9b4bcfca76 tempest-VolumesGetTest-1664969689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a9b7aa14-0e48-4b1b-bee6-b959cb4b81d6.83cbdc9a-506b-47f1-a387-14e5a8216bb5 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:00:48 devstack sudo[90360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a9b7aa14-0e48-4b1b-bee6-b959cb4b81d6.83cbdc9a-506b-47f1-a387-14e5a8216bb5 Apr 22 18:00:48 devstack sudo[90360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:00:49 devstack sudo[90360]: pam_unix(sudo:session): session closed for user root Apr 22 18:00:49 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-8eb4c9b3-b201-42c8-a070-4a9b4bcfca76 tempest-VolumesGetTest-1664969689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a9b7aa14-0e48-4b1b-bee6-b959cb4b81d6.83cbdc9a-506b-47f1-a387-14e5a8216bb5" returned: 0 in 0.535s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:00:49 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-8eb4c9b3-b201-42c8-a070-4a9b4bcfca76 tempest-VolumesGetTest-1664969689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a9b7aa14-0e48-4b1b-bee6-b959cb4b81d6.83cbdc9a-506b-47f1-a387-14e5a8216bb5 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:00:49 devstack sudo[90365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a9b7aa14-0e48-4b1b-bee6-b959cb4b81d6.83cbdc9a-506b-47f1-a387-14e5a8216bb5 Apr 22 18:00:49 devstack sudo[90365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:00:49 devstack sudo[90365]: pam_unix(sudo:session): session closed for user root Apr 22 18:00:49 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-8eb4c9b3-b201-42c8-a070-4a9b4bcfca76 tempest-VolumesGetTest-1664969689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a9b7aa14-0e48-4b1b-bee6-b959cb4b81d6.83cbdc9a-506b-47f1-a387-14e5a8216bb5" returned: 0 in 0.458s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:00:49 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-8eb4c9b3-b201-42c8-a070-4a9b4bcfca76 tempest-VolumesGetTest-1664969689 None] Lock "cinder-quobyte-83cbdc9a-506b-47f1-a387-14e5a8216bb5" released by "_delete_snapshot" :: held 2.130s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 18:00:49 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-8eb4c9b3-b201-42c8-a070-4a9b4bcfca76 tempest-VolumesGetTest-1664969689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.079s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 18:00:49 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-8eb4c9b3-b201-42c8-a070-4a9b4bcfca76 tempest-VolumesGetTest-1664969689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1db56fc8-55dd-4960-839a-5048b545cc36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b8226c8-4d12-45c0-af9f-5928ddb557b2', 'volume_size': 1, 'source_volid': 'a9b7aa14-0e48-4b1b-bee6-b959cb4b81d6', 'source_volstatus': 'available'}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:00:49 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-8eb4c9b3-b201-42c8-a070-4a9b4bcfca76 tempest-VolumesGetTest-1664969689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba8417ec-5071-4c0f-8fe9-980709fde1f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:00:49 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-8eb4c9b3-b201-42c8-a070-4a9b4bcfca76 tempest-VolumesGetTest-1664969689 None] Volume volume-2b8226c8-4d12-45c0-af9f-5928ddb557b2 (2b8226c8-4d12-45c0-af9f-5928ddb557b2): created successfully Apr 22 18:00:49 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-8eb4c9b3-b201-42c8-a070-4a9b4bcfca76 tempest-VolumesGetTest-1664969689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba8417ec-5071-4c0f-8fe9-980709fde1f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:00:49 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-8eb4c9b3-b201-42c8-a070-4a9b4bcfca76 tempest-VolumesGetTest-1664969689 None] Flow 'volume_create_manager' (dbeb38fe-217d-4d51-8d5f-da2e8f46f359) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 18:00:49 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-8eb4c9b3-b201-42c8-a070-4a9b4bcfca76 tempest-VolumesGetTest-1664969689 None] Created volume successfully. Apr 22 18:00:50 devstack cinder-volume[81771]: DEBUG cinder.volume.flows.manager.create_volume [None req-42d679ec-882b-406c-9a7d-6b68924b9e42 tempest-VolumesGetTest-1664969689 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 18:00:50 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-42d679ec-882b-406c-9a7d-6b68924b9e42 tempest-VolumesGetTest-1664969689 None] Flow 'volume_create_manager' (f303a5d6-fc05-488e-a6a3-d09c32073db6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 18:00:51 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-42d679ec-882b-406c-9a7d-6b68924b9e42 tempest-VolumesGetTest-1664969689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da405695-4547-4fcd-b498-afbc0590a97b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:00:51 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-42d679ec-882b-406c-9a7d-6b68924b9e42 tempest-VolumesGetTest-1664969689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da405695-4547-4fcd-b498-afbc0590a97b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T16:00:51Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1319520764',display_name='tempest-VolumesGetTest-Volume-2033707498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=252c9d46-703f-4fcb-8025-90deceb6b6e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0e7ec173cd3484986be993fbf902802',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T16:00:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T16:00:51Z,use_quota=True,user_id='30d5ce6c7a8843a2b191f01566e89dc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:00:51 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-42d679ec-882b-406c-9a7d-6b68924b9e42 tempest-VolumesGetTest-1664969689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70d390af-f575-4331-9fef-3721052637eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:00:51 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-42d679ec-882b-406c-9a7d-6b68924b9e42 tempest-VolumesGetTest-1664969689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70d390af-f575-4331-9fef-3721052637eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:00:51 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-42d679ec-882b-406c-9a7d-6b68924b9e42 tempest-VolumesGetTest-1664969689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4f0a894-036f-4cc4-b1f1-472e4356d531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:00:51 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-42d679ec-882b-406c-9a7d-6b68924b9e42 tempest-VolumesGetTest-1664969689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4f0a894-036f-4cc4-b1f1-472e4356d531) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '252c9d46-703f-4fcb-8025-90deceb6b6e9', 'volume_name': 'volume-252c9d46-703f-4fcb-8025-90deceb6b6e9', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:00:51 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-42d679ec-882b-406c-9a7d-6b68924b9e42 tempest-VolumesGetTest-1664969689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6da5cbdd-752f-48cb-98db-411331b5f71b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:00:51 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-42d679ec-882b-406c-9a7d-6b68924b9e42 tempest-VolumesGetTest-1664969689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6da5cbdd-752f-48cb-98db-411331b5f71b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:00:51 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-42d679ec-882b-406c-9a7d-6b68924b9e42 tempest-VolumesGetTest-1664969689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1eb98ff4-bab2-439c-9d60-072a64bd4949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:00:51 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-42d679ec-882b-406c-9a7d-6b68924b9e42 tempest-VolumesGetTest-1664969689 None] Volume 252c9d46-703f-4fcb-8025-90deceb6b6e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-252c9d46-703f-4fcb-8025-90deceb6b6e9', 'volume_size': 1} Apr 22 18:00:51 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-42d679ec-882b-406c-9a7d-6b68924b9e42 tempest-VolumesGetTest-1664969689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 18:00:51 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-42d679ec-882b-406c-9a7d-6b68924b9e42 tempest-VolumesGetTest-1664969689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 18:00:51 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-42d679ec-882b-406c-9a7d-6b68924b9e42 tempest-VolumesGetTest-1664969689 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T16:00:51Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1319520764',display_name='tempest-VolumesGetTest-Volume-2033707498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=252c9d46-703f-4fcb-8025-90deceb6b6e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0e7ec173cd3484986be993fbf902802',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T16:00:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T16:00:51Z,use_quota=True,user_id='30d5ce6c7a8843a2b191f01566e89dc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)}" {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 18:00:51 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-42d679ec-882b-406c-9a7d-6b68924b9e42 tempest-VolumesGetTest-1664969689 None] Creating volume 252c9d46-703f-4fcb-8025-90deceb6b6e9 {{(pid=81771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 18:00:51 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-42d679ec-882b-406c-9a7d-6b68924b9e42 tempest-VolumesGetTest-1664969689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 18:00:51 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-42d679ec-882b-406c-9a7d-6b68924b9e42 tempest-VolumesGetTest-1664969689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 18:00:51 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-42d679ec-882b-406c-9a7d-6b68924b9e42 tempest-VolumesGetTest-1664969689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 18:00:51 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-42d679ec-882b-406c-9a7d-6b68924b9e42 tempest-VolumesGetTest-1664969689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 18:00:51 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-42d679ec-882b-406c-9a7d-6b68924b9e42 tempest-VolumesGetTest-1664969689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 18:00:51 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-42d679ec-882b-406c-9a7d-6b68924b9e42 tempest-VolumesGetTest-1664969689 None] Selected osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 as target Quobyte volume. {{(pid=81771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 18:00:51 devstack cinder-volume[81771]: INFO cinder.volume.drivers.remotefs [None req-42d679ec-882b-406c-9a7d-6b68924b9e42 tempest-VolumesGetTest-1664969689 None] casted to osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 Apr 22 18:00:51 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-42d679ec-882b-406c-9a7d-6b68924b9e42 tempest-VolumesGetTest-1664969689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-252c9d46-703f-4fcb-8025-90deceb6b6e9 1073741824 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:00:51 devstack sudo[90368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-252c9d46-703f-4fcb-8025-90deceb6b6e9 1073741824 Apr 22 18:00:51 devstack sudo[90368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:00:51 devstack sudo[90368]: pam_unix(sudo:session): session closed for user root Apr 22 18:00:51 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-42d679ec-882b-406c-9a7d-6b68924b9e42 tempest-VolumesGetTest-1664969689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-252c9d46-703f-4fcb-8025-90deceb6b6e9 1073741824" returned: 0 in 0.597s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:00:51 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-42d679ec-882b-406c-9a7d-6b68924b9e42 tempest-VolumesGetTest-1664969689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-252c9d46-703f-4fcb-8025-90deceb6b6e9 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:00:51 devstack sudo[90373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-252c9d46-703f-4fcb-8025-90deceb6b6e9 Apr 22 18:00:51 devstack sudo[90373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:00:52 devstack sudo[90373]: pam_unix(sudo:session): session closed for user root Apr 22 18:00:52 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-42d679ec-882b-406c-9a7d-6b68924b9e42 tempest-VolumesGetTest-1664969689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-252c9d46-703f-4fcb-8025-90deceb6b6e9" returned: 0 in 0.426s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:00:52 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-42d679ec-882b-406c-9a7d-6b68924b9e42 tempest-VolumesGetTest-1664969689 None] <== create_volume: return (1063ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'} {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 18:00:52 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-42d679ec-882b-406c-9a7d-6b68924b9e42 tempest-VolumesGetTest-1664969689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.065s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 18:00:52 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-42d679ec-882b-406c-9a7d-6b68924b9e42 tempest-VolumesGetTest-1664969689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1eb98ff4-bab2-439c-9d60-072a64bd4949) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-252c9d46-703f-4fcb-8025-90deceb6b6e9', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:00:52 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-42d679ec-882b-406c-9a7d-6b68924b9e42 tempest-VolumesGetTest-1664969689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65ae3e48-5104-4cdc-8969-c48a21d6da2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:00:52 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-42d679ec-882b-406c-9a7d-6b68924b9e42 tempest-VolumesGetTest-1664969689 None] Volume volume-252c9d46-703f-4fcb-8025-90deceb6b6e9 (252c9d46-703f-4fcb-8025-90deceb6b6e9): created successfully Apr 22 18:00:52 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-42d679ec-882b-406c-9a7d-6b68924b9e42 tempest-VolumesGetTest-1664969689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65ae3e48-5104-4cdc-8969-c48a21d6da2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:00:52 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-42d679ec-882b-406c-9a7d-6b68924b9e42 tempest-VolumesGetTest-1664969689 None] Flow 'volume_create_manager' (f303a5d6-fc05-488e-a6a3-d09c32073db6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 18:00:52 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-42d679ec-882b-406c-9a7d-6b68924b9e42 tempest-VolumesGetTest-1664969689 None] Created volume successfully. Apr 22 18:00:53 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-21fba8aa-6ccf-4272-a03b-3ddcb3976d23 tempest-VolumesGetTest-1664969689 None] Acquiring lock "cinder-252c9d46-703f-4fcb-8025-90deceb6b6e9-delete_volume" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 18:00:53 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-21fba8aa-6ccf-4272-a03b-3ddcb3976d23 tempest-VolumesGetTest-1664969689 None] Lock "cinder-252c9d46-703f-4fcb-8025-90deceb6b6e9-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 18:00:53 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-21fba8aa-6ccf-4272-a03b-3ddcb3976d23 tempest-VolumesGetTest-1664969689 None] Acquiring lock "cinder-quobyte-252c9d46-703f-4fcb-8025-90deceb6b6e9" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 18:00:53 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-21fba8aa-6ccf-4272-a03b-3ddcb3976d23 tempest-VolumesGetTest-1664969689 None] Lock "cinder-quobyte-252c9d46-703f-4fcb-8025-90deceb6b6e9" acquired by "delete_volume" :: waited 0.016s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 18:00:53 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[7631a8aa-7f15-4b4f-aa15-b16529b04130]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 18:00:53 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-21fba8aa-6ccf-4272-a03b-3ddcb3976d23 tempest-VolumesGetTest-1664969689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-252c9d46-703f-4fcb-8025-90deceb6b6e9 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:00:53 devstack sudo[90376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-252c9d46-703f-4fcb-8025-90deceb6b6e9 Apr 22 18:00:53 devstack sudo[90376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:00:53 devstack sudo[90376]: pam_unix(sudo:session): session closed for user root Apr 22 18:00:53 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-21fba8aa-6ccf-4272-a03b-3ddcb3976d23 tempest-VolumesGetTest-1664969689 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-252c9d46-703f-4fcb-8025-90deceb6b6e9" returned: 0 in 0.517s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:00:53 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-21fba8aa-6ccf-4272-a03b-3ddcb3976d23 tempest-VolumesGetTest-1664969689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-252c9d46-703f-4fcb-8025-90deceb6b6e9 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:00:53 devstack sudo[90381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-252c9d46-703f-4fcb-8025-90deceb6b6e9 Apr 22 18:00:53 devstack sudo[90381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:00:54 devstack sudo[90381]: pam_unix(sudo:session): session closed for user root Apr 22 18:00:54 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-21fba8aa-6ccf-4272-a03b-3ddcb3976d23 tempest-VolumesGetTest-1664969689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-252c9d46-703f-4fcb-8025-90deceb6b6e9" returned: 0 in 0.483s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:00:54 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-21fba8aa-6ccf-4272-a03b-3ddcb3976d23 tempest-VolumesGetTest-1664969689 None] Lock "cinder-quobyte-252c9d46-703f-4fcb-8025-90deceb6b6e9" released by "delete_volume" :: held 1.042s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 18:00:54 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-21fba8aa-6ccf-4272-a03b-3ddcb3976d23 tempest-VolumesGetTest-1664969689 None] Created reservations ['144f5bc0-6c49-4fe0-ae2e-d117db1375e5', 'e6493265-eb14-49e2-b462-5d36c8c09d44', 'a5997d53-4d3c-4915-b758-ff7331b348d9', '19e2ca2b-8a46-49ff-a40f-3eb1db3b5e04'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 18:00:54 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-21fba8aa-6ccf-4272-a03b-3ddcb3976d23 tempest-VolumesGetTest-1664969689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 18:00:54 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-21fba8aa-6ccf-4272-a03b-3ddcb3976d23 tempest-VolumesGetTest-1664969689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 18:00:54 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-21fba8aa-6ccf-4272-a03b-3ddcb3976d23 tempest-VolumesGetTest-1664969689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 18:00:54 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-21fba8aa-6ccf-4272-a03b-3ddcb3976d23 tempest-VolumesGetTest-1664969689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 18:00:54 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-21fba8aa-6ccf-4272-a03b-3ddcb3976d23 tempest-VolumesGetTest-1664969689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 18:00:54 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-21fba8aa-6ccf-4272-a03b-3ddcb3976d23 tempest-VolumesGetTest-1664969689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:00:54 devstack sudo[90384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 Apr 22 18:00:54 devstack sudo[90384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:00:54 devstack sudo[90384]: pam_unix(sudo:session): session closed for user root Apr 22 18:00:54 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-21fba8aa-6ccf-4272-a03b-3ddcb3976d23 tempest-VolumesGetTest-1664969689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33" returned: 0 in 0.417s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:00:54 devstack cinder-volume[81771]: DEBUG cinder.manager [None req-21fba8aa-6ccf-4272-a03b-3ddcb3976d23 tempest-VolumesGetTest-1664969689 None] Notifying Schedulers of capabilities ... {{(pid=81771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 18:00:54 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-21fba8aa-6ccf-4272-a03b-3ddcb3976d23 tempest-VolumesGetTest-1664969689 None] Deleted volume successfully. Apr 22 18:00:54 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-21fba8aa-6ccf-4272-a03b-3ddcb3976d23 tempest-VolumesGetTest-1664969689 None] Lock "cinder-252c9d46-703f-4fcb-8025-90deceb6b6e9-delete_volume" released by "delete_volume" :: held 1.658s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 18:00:55 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-091addd8-f232-4c3b-8070-9b90332f99df tempest-VolumesGetTest-1664969689 None] Acquiring lock "cinder-2b8226c8-4d12-45c0-af9f-5928ddb557b2-delete_volume" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 18:00:55 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-091addd8-f232-4c3b-8070-9b90332f99df tempest-VolumesGetTest-1664969689 None] Lock "cinder-2b8226c8-4d12-45c0-af9f-5928ddb557b2-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 18:00:55 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-091addd8-f232-4c3b-8070-9b90332f99df tempest-VolumesGetTest-1664969689 None] Acquiring lock "cinder-quobyte-2b8226c8-4d12-45c0-af9f-5928ddb557b2" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 18:00:55 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-091addd8-f232-4c3b-8070-9b90332f99df tempest-VolumesGetTest-1664969689 None] Lock "cinder-quobyte-2b8226c8-4d12-45c0-af9f-5928ddb557b2" acquired by "delete_volume" :: waited 0.015s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 18:00:55 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[60f71023-e4c6-44c0-85e2-fcbb207da376]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 18:00:55 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-091addd8-f232-4c3b-8070-9b90332f99df tempest-VolumesGetTest-1664969689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-2b8226c8-4d12-45c0-af9f-5928ddb557b2 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:00:55 devstack sudo[90387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-2b8226c8-4d12-45c0-af9f-5928ddb557b2 Apr 22 18:00:55 devstack sudo[90387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:00:56 devstack sudo[90387]: pam_unix(sudo:session): session closed for user root Apr 22 18:00:56 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-091addd8-f232-4c3b-8070-9b90332f99df tempest-VolumesGetTest-1664969689 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-2b8226c8-4d12-45c0-af9f-5928ddb557b2" returned: 0 in 0.536s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:00:56 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-091addd8-f232-4c3b-8070-9b90332f99df tempest-VolumesGetTest-1664969689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-2b8226c8-4d12-45c0-af9f-5928ddb557b2 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:00:56 devstack sudo[90392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-2b8226c8-4d12-45c0-af9f-5928ddb557b2 Apr 22 18:00:56 devstack sudo[90392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:00:56 devstack sudo[90392]: pam_unix(sudo:session): session closed for user root Apr 22 18:00:56 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-091addd8-f232-4c3b-8070-9b90332f99df tempest-VolumesGetTest-1664969689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-2b8226c8-4d12-45c0-af9f-5928ddb557b2" returned: 0 in 0.448s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:00:56 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-091addd8-f232-4c3b-8070-9b90332f99df tempest-VolumesGetTest-1664969689 None] Lock "cinder-quobyte-2b8226c8-4d12-45c0-af9f-5928ddb557b2" released by "delete_volume" :: held 1.029s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 18:00:56 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-091addd8-f232-4c3b-8070-9b90332f99df tempest-VolumesGetTest-1664969689 None] Created reservations ['5c6faa2f-8e1c-4b0e-bdd1-89c16e79511a', '4d6454ee-29a8-47c5-bfcb-cf595d3f02e4', '9cbc4164-e28b-4089-bd77-0b70a668a907', '87ee29e0-ff10-43fc-802a-2ba54a74c530'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 18:00:56 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-091addd8-f232-4c3b-8070-9b90332f99df tempest-VolumesGetTest-1664969689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 18:00:56 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-091addd8-f232-4c3b-8070-9b90332f99df tempest-VolumesGetTest-1664969689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 18:00:56 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-091addd8-f232-4c3b-8070-9b90332f99df tempest-VolumesGetTest-1664969689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 18:00:56 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-091addd8-f232-4c3b-8070-9b90332f99df tempest-VolumesGetTest-1664969689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 18:00:56 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-091addd8-f232-4c3b-8070-9b90332f99df tempest-VolumesGetTest-1664969689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 18:00:56 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-091addd8-f232-4c3b-8070-9b90332f99df tempest-VolumesGetTest-1664969689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:00:56 devstack sudo[90395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 Apr 22 18:00:56 devstack sudo[90395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:00:57 devstack sudo[90395]: pam_unix(sudo:session): session closed for user root Apr 22 18:00:57 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-091addd8-f232-4c3b-8070-9b90332f99df tempest-VolumesGetTest-1664969689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33" returned: 0 in 0.439s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:00:57 devstack cinder-volume[81771]: DEBUG cinder.manager [None req-091addd8-f232-4c3b-8070-9b90332f99df tempest-VolumesGetTest-1664969689 None] Notifying Schedulers of capabilities ... {{(pid=81771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 18:00:57 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-091addd8-f232-4c3b-8070-9b90332f99df tempest-VolumesGetTest-1664969689 None] Deleted volume successfully. Apr 22 18:00:57 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-091addd8-f232-4c3b-8070-9b90332f99df tempest-VolumesGetTest-1664969689 None] Lock "cinder-2b8226c8-4d12-45c0-af9f-5928ddb557b2-delete_volume" released by "delete_volume" :: held 1.659s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 18:00:57 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-4dc0fe97-5671-4c9f-b575-85a170e23457 tempest-VolumesGetTest-1664969689 None] Acquiring lock "cinder-a9b7aa14-0e48-4b1b-bee6-b959cb4b81d6-delete_volume" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 18:00:57 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-4dc0fe97-5671-4c9f-b575-85a170e23457 tempest-VolumesGetTest-1664969689 None] Lock "cinder-a9b7aa14-0e48-4b1b-bee6-b959cb4b81d6-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 18:00:57 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-4dc0fe97-5671-4c9f-b575-85a170e23457 tempest-VolumesGetTest-1664969689 None] Acquiring lock "cinder-quobyte-a9b7aa14-0e48-4b1b-bee6-b959cb4b81d6" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 18:00:57 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-4dc0fe97-5671-4c9f-b575-85a170e23457 tempest-VolumesGetTest-1664969689 None] Lock "cinder-quobyte-a9b7aa14-0e48-4b1b-bee6-b959cb4b81d6" acquired by "delete_volume" :: waited 0.017s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 18:00:57 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[0316b343-335c-4ce0-8d97-be1c79be967f]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 18:00:57 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-4dc0fe97-5671-4c9f-b575-85a170e23457 tempest-VolumesGetTest-1664969689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a9b7aa14-0e48-4b1b-bee6-b959cb4b81d6 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:00:57 devstack sudo[90399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a9b7aa14-0e48-4b1b-bee6-b959cb4b81d6 Apr 22 18:00:57 devstack sudo[90399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:00:58 devstack sudo[90399]: pam_unix(sudo:session): session closed for user root Apr 22 18:00:58 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-4dc0fe97-5671-4c9f-b575-85a170e23457 tempest-VolumesGetTest-1664969689 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a9b7aa14-0e48-4b1b-bee6-b959cb4b81d6" returned: 0 in 0.532s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:00:58 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-4dc0fe97-5671-4c9f-b575-85a170e23457 tempest-VolumesGetTest-1664969689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a9b7aa14-0e48-4b1b-bee6-b959cb4b81d6 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:00:58 devstack sudo[90404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a9b7aa14-0e48-4b1b-bee6-b959cb4b81d6 Apr 22 18:00:58 devstack sudo[90404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:00:58 devstack sudo[90404]: pam_unix(sudo:session): session closed for user root Apr 22 18:00:58 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-4dc0fe97-5671-4c9f-b575-85a170e23457 tempest-VolumesGetTest-1664969689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-a9b7aa14-0e48-4b1b-bee6-b959cb4b81d6" returned: 0 in 0.426s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:00:58 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-4dc0fe97-5671-4c9f-b575-85a170e23457 tempest-VolumesGetTest-1664969689 None] Lock "cinder-quobyte-a9b7aa14-0e48-4b1b-bee6-b959cb4b81d6" released by "delete_volume" :: held 1.019s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 18:00:58 devstack cinder-volume[81771]: DEBUG dbcounter [-] [81771] Writing DB stats cinder:UPDATE=80,cinder:SELECT=71,cinder:INSERT=24,cinder:DELETE=6 {{(pid=81771) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 22 18:00:58 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-4dc0fe97-5671-4c9f-b575-85a170e23457 tempest-VolumesGetTest-1664969689 None] Created reservations ['19b31989-f244-470f-b136-408de23112fb', '1163a233-3940-4b9b-813d-b2e380af52a9', 'c881d8cc-f3f3-44ce-85dc-6e26c7567a42', '3415e865-f42c-4ed4-9316-7b033caab469'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 18:00:58 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-4dc0fe97-5671-4c9f-b575-85a170e23457 tempest-VolumesGetTest-1664969689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 18:00:58 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-4dc0fe97-5671-4c9f-b575-85a170e23457 tempest-VolumesGetTest-1664969689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 18:00:58 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-4dc0fe97-5671-4c9f-b575-85a170e23457 tempest-VolumesGetTest-1664969689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 18:00:58 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-4dc0fe97-5671-4c9f-b575-85a170e23457 tempest-VolumesGetTest-1664969689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 18:00:58 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-4dc0fe97-5671-4c9f-b575-85a170e23457 tempest-VolumesGetTest-1664969689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 18:00:58 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-4dc0fe97-5671-4c9f-b575-85a170e23457 tempest-VolumesGetTest-1664969689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:00:58 devstack sudo[90440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 Apr 22 18:00:58 devstack sudo[90440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:00:59 devstack sudo[90440]: pam_unix(sudo:session): session closed for user root Apr 22 18:00:59 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-4dc0fe97-5671-4c9f-b575-85a170e23457 tempest-VolumesGetTest-1664969689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33" returned: 0 in 0.439s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:00:59 devstack cinder-volume[81771]: DEBUG cinder.manager [None req-4dc0fe97-5671-4c9f-b575-85a170e23457 tempest-VolumesGetTest-1664969689 None] Notifying Schedulers of capabilities ... {{(pid=81771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 18:00:59 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-4dc0fe97-5671-4c9f-b575-85a170e23457 tempest-VolumesGetTest-1664969689 None] Deleted volume successfully. Apr 22 18:00:59 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-4dc0fe97-5671-4c9f-b575-85a170e23457 tempest-VolumesGetTest-1664969689 None] Lock "cinder-a9b7aa14-0e48-4b1b-bee6-b959cb4b81d6-delete_volume" released by "delete_volume" :: held 1.660s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 18:01:00 devstack cinder-volume[81771]: DEBUG dbcounter [-] [81771] Writing DB stats cinder:SELECT=65,cinder:INSERT=29,cinder:UPDATE=95,cinder:DELETE=8 {{(pid=81771) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 22 18:01:00 devstack cinder-volume[81771]: DEBUG cinder.volume.flows.manager.create_volume [None req-467093e4-e5d5-408e-ae2d-bd91dc3ff7de tempest-VolumesGetTest-1664969689 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 18:01:00 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-467093e4-e5d5-408e-ae2d-bd91dc3ff7de tempest-VolumesGetTest-1664969689 None] Flow 'volume_create_manager' (b0b7eb07-01ec-4b62-9c9d-56c200bd8d51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 18:01:00 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-467093e4-e5d5-408e-ae2d-bd91dc3ff7de tempest-VolumesGetTest-1664969689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e92ce0e-7fc6-499b-8dfd-904ff2a92605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:01:00 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-467093e4-e5d5-408e-ae2d-bd91dc3ff7de tempest-VolumesGetTest-1664969689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e92ce0e-7fc6-499b-8dfd-904ff2a92605) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T16:01:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1692446441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=355a2396-60e1-486d-9e18-9b071b52db53,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a0e7ec173cd3484986be993fbf902802',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T16:01:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T16:01:01Z,use_quota=True,user_id='30d5ce6c7a8843a2b191f01566e89dc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:01:00 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-467093e4-e5d5-408e-ae2d-bd91dc3ff7de tempest-VolumesGetTest-1664969689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e234e4a-602b-40a1-9fb5-28c5226c1bcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:01:00 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-467093e4-e5d5-408e-ae2d-bd91dc3ff7de tempest-VolumesGetTest-1664969689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e234e4a-602b-40a1-9fb5-28c5226c1bcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:01:00 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-467093e4-e5d5-408e-ae2d-bd91dc3ff7de tempest-VolumesGetTest-1664969689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1082884c-5f38-4f4f-acdb-bbd2dd3283d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:01:00 devstack cinder-volume[81771]: DEBUG cinder.image.glance [None req-467093e4-e5d5-408e-ae2d-bd91dc3ff7de tempest-VolumesGetTest-1664969689 None] Creating Keystone auth plugin from conf {{(pid=81771) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 22 18:01:00 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-467093e4-e5d5-408e-ae2d-bd91dc3ff7de tempest-VolumesGetTest-1664969689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1082884c-5f38-4f4f-acdb-bbd2dd3283d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '355a2396-60e1-486d-9e18-9b071b52db53', 'volume_name': 'volume-355a2396-60e1-486d-9e18-9b071b52db53', 'volume_size': 1, 'image_id': '9e076047-8ac8-4bf8-88ea-602aa20d3c9e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9e076047-8ac8-4bf8-88ea-602aa20d3c9e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '39e18fb0fde242f68d38bed6963e8744', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9e076047-8ac8-4bf8-88ea-602aa20d3c9e', 'created_at': datetime.datetime(2026, 4, 22, 15, 44, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 22, 15, 44, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9e076047-8ac8-4bf8-88ea-602aa20d3c9e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:01:00 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-467093e4-e5d5-408e-ae2d-bd91dc3ff7de tempest-VolumesGetTest-1664969689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5099f1b-ebe8-44d2-86df-f53179deb88b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:01:00 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-467093e4-e5d5-408e-ae2d-bd91dc3ff7de tempest-VolumesGetTest-1664969689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5099f1b-ebe8-44d2-86df-f53179deb88b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:01:00 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-467093e4-e5d5-408e-ae2d-bd91dc3ff7de tempest-VolumesGetTest-1664969689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39c87adb-9778-4fc7-834a-9fa557e167a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:01:00 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-467093e4-e5d5-408e-ae2d-bd91dc3ff7de tempest-VolumesGetTest-1664969689 None] Volume 355a2396-60e1-486d-9e18-9b071b52db53: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-355a2396-60e1-486d-9e18-9b071b52db53', 'volume_size': 1, 'image_id': '9e076047-8ac8-4bf8-88ea-602aa20d3c9e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9e076047-8ac8-4bf8-88ea-602aa20d3c9e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '39e18fb0fde242f68d38bed6963e8744', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9e076047-8ac8-4bf8-88ea-602aa20d3c9e', 'created_at': datetime.datetime(2026, 4, 22, 15, 44, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 22, 15, 44, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9e076047-8ac8-4bf8-88ea-602aa20d3c9e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 22 18:01:00 devstack cinder-volume[81771]: DEBUG cinder.volume.flows.manager.create_volume [None req-467093e4-e5d5-408e-ae2d-bd91dc3ff7de tempest-VolumesGetTest-1664969689 None] Trying to clone 355a2396-60e1-486d-9e18-9b071b52db53 from image 9e076047-8ac8-4bf8-88ea-602aa20d3c9e at location (None, [{'url': 'file:///opt/stack/data/glance/images/9e076047-8ac8-4bf8-88ea-602aa20d3c9e', 'metadata': {}}]). {{(pid=81771) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 22 18:01:01 devstack cinder-volume[81771]: DEBUG cinder.image.image_utils [None req-467093e4-e5d5-408e-ae2d-bd91dc3ff7de tempest-VolumesGetTest-1664969689 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9e076047-8ac8-4bf8-88ea-602aa20d3c9e_e9l31kk9devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=81771) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 22 18:01:01 devstack cinder-volume[81771]: INFO cinder.image.image_utils [None req-467093e4-e5d5-408e-ae2d-bd91dc3ff7de tempest-VolumesGetTest-1664969689 None] Image download 20.69 MB at 20.69 MB/s Apr 22 18:01:01 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[45f91763-45fd-4620-9444-659dfa97a344]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 18:01:01 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-467093e4-e5d5-408e-ae2d-bd91dc3ff7de tempest-VolumesGetTest-1664969689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9e076047-8ac8-4bf8-88ea-602aa20d3c9e_e9l31kk9devstack@QuobyteHD {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:01:01 devstack sudo[90445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9e076047-8ac8-4bf8-88ea-602aa20d3c9e_e9l31kk9devstack@QuobyteHD Apr 22 18:01:01 devstack sudo[90445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:01:01 devstack sudo[90445]: pam_unix(sudo:session): session closed for user root Apr 22 18:01:01 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-467093e4-e5d5-408e-ae2d-bd91dc3ff7de tempest-VolumesGetTest-1664969689 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9e076047-8ac8-4bf8-88ea-602aa20d3c9e_e9l31kk9devstack@QuobyteHD" returned: 0 in 0.503s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:01:01 devstack cinder-volume[81771]: DEBUG cinder.image.image_utils [None req-467093e4-e5d5-408e-ae2d-bd91dc3ff7de tempest-VolumesGetTest-1664969689 None] Temporary image 9e076047-8ac8-4bf8-88ea-602aa20d3c9e is fetched for user 30d5ce6c7a8843a2b191f01566e89dc3. {{(pid=81771) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 22 18:01:01 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e953a39-4487-4b9d-9973-d6fe50f002a8]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 18:01:01 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-467093e4-e5d5-408e-ae2d-bd91dc3ff7de tempest-VolumesGetTest-1664969689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9e076047-8ac8-4bf8-88ea-602aa20d3c9e_e9l31kk9devstack@QuobyteHD {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:01:01 devstack sudo[90450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9e076047-8ac8-4bf8-88ea-602aa20d3c9e_e9l31kk9devstack@QuobyteHD Apr 22 18:01:01 devstack sudo[90450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:01:02 devstack sudo[90450]: pam_unix(sudo:session): session closed for user root Apr 22 18:01:02 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-467093e4-e5d5-408e-ae2d-bd91dc3ff7de tempest-VolumesGetTest-1664969689 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9e076047-8ac8-4bf8-88ea-602aa20d3c9e_e9l31kk9devstack@QuobyteHD" returned: 0 in 0.476s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:01:02 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-467093e4-e5d5-408e-ae2d-bd91dc3ff7de tempest-VolumesGetTest-1664969689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 18:01:02 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-467093e4-e5d5-408e-ae2d-bd91dc3ff7de tempest-VolumesGetTest-1664969689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 18:01:02 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-467093e4-e5d5-408e-ae2d-bd91dc3ff7de tempest-VolumesGetTest-1664969689 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T16:01:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1692446441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=355a2396-60e1-486d-9e18-9b071b52db53,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a0e7ec173cd3484986be993fbf902802',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T16:01:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T16:01:01Z,use_quota=True,user_id='30d5ce6c7a8843a2b191f01566e89dc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)}" {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 18:01:02 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-467093e4-e5d5-408e-ae2d-bd91dc3ff7de tempest-VolumesGetTest-1664969689 None] Creating volume 355a2396-60e1-486d-9e18-9b071b52db53 {{(pid=81771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 18:01:02 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-467093e4-e5d5-408e-ae2d-bd91dc3ff7de tempest-VolumesGetTest-1664969689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 18:01:02 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-467093e4-e5d5-408e-ae2d-bd91dc3ff7de tempest-VolumesGetTest-1664969689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 18:01:02 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-467093e4-e5d5-408e-ae2d-bd91dc3ff7de tempest-VolumesGetTest-1664969689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 18:01:02 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-467093e4-e5d5-408e-ae2d-bd91dc3ff7de tempest-VolumesGetTest-1664969689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 18:01:02 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-467093e4-e5d5-408e-ae2d-bd91dc3ff7de tempest-VolumesGetTest-1664969689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 18:01:02 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-467093e4-e5d5-408e-ae2d-bd91dc3ff7de tempest-VolumesGetTest-1664969689 None] Selected osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 as target Quobyte volume. {{(pid=81771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 18:01:02 devstack cinder-volume[81771]: INFO cinder.volume.drivers.remotefs [None req-467093e4-e5d5-408e-ae2d-bd91dc3ff7de tempest-VolumesGetTest-1664969689 None] casted to osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 Apr 22 18:01:02 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-467093e4-e5d5-408e-ae2d-bd91dc3ff7de tempest-VolumesGetTest-1664969689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-355a2396-60e1-486d-9e18-9b071b52db53 1073741824 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:01:02 devstack sudo[90455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-355a2396-60e1-486d-9e18-9b071b52db53 1073741824 Apr 22 18:01:02 devstack sudo[90455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:01:02 devstack sudo[90455]: pam_unix(sudo:session): session closed for user root Apr 22 18:01:02 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-467093e4-e5d5-408e-ae2d-bd91dc3ff7de tempest-VolumesGetTest-1664969689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-355a2396-60e1-486d-9e18-9b071b52db53 1073741824" returned: 0 in 0.599s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:01:02 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-467093e4-e5d5-408e-ae2d-bd91dc3ff7de tempest-VolumesGetTest-1664969689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-355a2396-60e1-486d-9e18-9b071b52db53 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:01:02 devstack sudo[90460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-355a2396-60e1-486d-9e18-9b071b52db53 Apr 22 18:01:02 devstack sudo[90460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:01:03 devstack sudo[90460]: pam_unix(sudo:session): session closed for user root Apr 22 18:01:03 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-467093e4-e5d5-408e-ae2d-bd91dc3ff7de tempest-VolumesGetTest-1664969689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-355a2396-60e1-486d-9e18-9b071b52db53" returned: 0 in 0.445s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:01:03 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-467093e4-e5d5-408e-ae2d-bd91dc3ff7de tempest-VolumesGetTest-1664969689 None] <== create_volume: return (1085ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'} {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 18:01:03 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-467093e4-e5d5-408e-ae2d-bd91dc3ff7de tempest-VolumesGetTest-1664969689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.088s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 18:01:03 devstack cinder-volume[81771]: DEBUG cinder.volume.volume_utils [None req-467093e4-e5d5-408e-ae2d-bd91dc3ff7de tempest-VolumesGetTest-1664969689 None] Attempting download of 9e076047-8ac8-4bf8-88ea-602aa20d3c9e ((None, [{'url': 'file:///opt/stack/data/glance/images/9e076047-8ac8-4bf8-88ea-602aa20d3c9e', 'metadata': {}}])) to volume 355a2396-60e1-486d-9e18-9b071b52db53. {{(pid=81771) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 22 18:01:03 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1ce4b16-7f20-4e77-a2ca-c670d964aa21]: (4, 'raw') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 18:01:03 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-467093e4-e5d5-408e-ae2d-bd91dc3ff7de tempest-VolumesGetTest-1664969689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9e076047-8ac8-4bf8-88ea-602aa20d3c9e_b88idtag {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:01:03 devstack sudo[90463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9e076047-8ac8-4bf8-88ea-602aa20d3c9e_b88idtag Apr 22 18:01:03 devstack sudo[90463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:01:03 devstack sudo[90463]: pam_unix(sudo:session): session closed for user root Apr 22 18:01:03 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-467093e4-e5d5-408e-ae2d-bd91dc3ff7de tempest-VolumesGetTest-1664969689 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9e076047-8ac8-4bf8-88ea-602aa20d3c9e_b88idtag" returned: 0 in 0.502s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:01:03 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-467093e4-e5d5-408e-ae2d-bd91dc3ff7de tempest-VolumesGetTest-1664969689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9e076047-8ac8-4bf8-88ea-602aa20d3c9e_b88idtag {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:01:04 devstack sudo[90467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9e076047-8ac8-4bf8-88ea-602aa20d3c9e_b88idtag Apr 22 18:01:04 devstack sudo[90467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:01:04 devstack sudo[90467]: pam_unix(sudo:session): session closed for user root Apr 22 18:01:04 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-467093e4-e5d5-408e-ae2d-bd91dc3ff7de tempest-VolumesGetTest-1664969689 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9e076047-8ac8-4bf8-88ea-602aa20d3c9e_b88idtag" returned: 1 in 0.482s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:01:04 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-467093e4-e5d5-408e-ae2d-bd91dc3ff7de tempest-VolumesGetTest-1664969689 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9e076047-8ac8-4bf8-88ea-602aa20d3c9e_b88idtag' failed. Not Retrying. {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 22 18:01:04 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[c47fc3e9-a6fa-43a4-9983-36407359d827]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 18:01:04 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-467093e4-e5d5-408e-ae2d-bd91dc3ff7de tempest-VolumesGetTest-1664969689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9e076047-8ac8-4bf8-88ea-602aa20d3c9e_e9l31kk9devstack@QuobyteHD {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:01:04 devstack sudo[90471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9e076047-8ac8-4bf8-88ea-602aa20d3c9e_e9l31kk9devstack@QuobyteHD Apr 22 18:01:04 devstack sudo[90471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:01:04 devstack sudo[90471]: pam_unix(sudo:session): session closed for user root Apr 22 18:01:04 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-467093e4-e5d5-408e-ae2d-bd91dc3ff7de tempest-VolumesGetTest-1664969689 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9e076047-8ac8-4bf8-88ea-602aa20d3c9e_e9l31kk9devstack@QuobyteHD" returned: 0 in 0.501s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:01:04 devstack cinder-volume[81771]: DEBUG cinder.image.image_utils [None req-467093e4-e5d5-408e-ae2d-bd91dc3ff7de tempest-VolumesGetTest-1664969689 None] 9e076047-8ac8-4bf8-88ea-602aa20d3c9e was qcow2, converting to raw {{(pid=81771) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 22 18:01:04 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-467093e4-e5d5-408e-ae2d-bd91dc3ff7de tempest-VolumesGetTest-1664969689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9e076047-8ac8-4bf8-88ea-602aa20d3c9e_e9l31kk9devstack@QuobyteHD /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-355a2396-60e1-486d-9e18-9b071b52db53 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:01:04 devstack sudo[90476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9e076047-8ac8-4bf8-88ea-602aa20d3c9e_e9l31kk9devstack@QuobyteHD /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-355a2396-60e1-486d-9e18-9b071b52db53 Apr 22 18:01:04 devstack sudo[90476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:01:06 devstack sudo[90476]: pam_unix(sudo:session): session closed for user root Apr 22 18:01:06 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-467093e4-e5d5-408e-ae2d-bd91dc3ff7de tempest-VolumesGetTest-1664969689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9e076047-8ac8-4bf8-88ea-602aa20d3c9e_e9l31kk9devstack@QuobyteHD /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-355a2396-60e1-486d-9e18-9b071b52db53" returned: 0 in 1.276s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:01:06 devstack cinder-volume[81771]: DEBUG cinder.image.image_utils [None req-467093e4-e5d5-408e-ae2d-bd91dc3ff7de tempest-VolumesGetTest-1664969689 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9e076047-8ac8-4bf8-88ea-602aa20d3c9e_e9l31kk9devstack@QuobyteHD, size 112.00 MB, duration 1.28 sec, destination /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-355a2396-60e1-486d-9e18-9b071b52db53 {{(pid=81771) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 22 18:01:06 devstack cinder-volume[81771]: INFO cinder.image.image_utils [None req-467093e4-e5d5-408e-ae2d-bd91dc3ff7de tempest-VolumesGetTest-1664969689 None] Converted 112.00 MB image at 87.65 MB/s Apr 22 18:01:06 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-467093e4-e5d5-408e-ae2d-bd91dc3ff7de tempest-VolumesGetTest-1664969689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-355a2396-60e1-486d-9e18-9b071b52db53 1G {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:01:06 devstack sudo[90484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-355a2396-60e1-486d-9e18-9b071b52db53 1G Apr 22 18:01:06 devstack sudo[90484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:01:06 devstack sudo[90484]: pam_unix(sudo:session): session closed for user root Apr 22 18:01:06 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-467093e4-e5d5-408e-ae2d-bd91dc3ff7de tempest-VolumesGetTest-1664969689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-355a2396-60e1-486d-9e18-9b071b52db53 1G" returned: 0 in 0.473s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:01:06 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[4522c807-bdfe-4efd-aa35-b3a672c087f0]: (4, 'raw') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 18:01:06 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-467093e4-e5d5-408e-ae2d-bd91dc3ff7de tempest-VolumesGetTest-1664969689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-355a2396-60e1-486d-9e18-9b071b52db53 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:01:06 devstack sudo[90489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-355a2396-60e1-486d-9e18-9b071b52db53 Apr 22 18:01:06 devstack sudo[90489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:01:07 devstack sudo[90489]: pam_unix(sudo:session): session closed for user root Apr 22 18:01:07 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-467093e4-e5d5-408e-ae2d-bd91dc3ff7de tempest-VolumesGetTest-1664969689 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-355a2396-60e1-486d-9e18-9b071b52db53" returned: 0 in 0.530s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:01:07 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-467093e4-e5d5-408e-ae2d-bd91dc3ff7de tempest-VolumesGetTest-1664969689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-355a2396-60e1-486d-9e18-9b071b52db53 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:01:07 devstack sudo[90494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-355a2396-60e1-486d-9e18-9b071b52db53 Apr 22 18:01:07 devstack sudo[90494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:01:07 devstack sudo[90494]: pam_unix(sudo:session): session closed for user root Apr 22 18:01:07 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-467093e4-e5d5-408e-ae2d-bd91dc3ff7de tempest-VolumesGetTest-1664969689 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-355a2396-60e1-486d-9e18-9b071b52db53" returned: 1 in 0.543s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:01:07 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-467093e4-e5d5-408e-ae2d-bd91dc3ff7de tempest-VolumesGetTest-1664969689 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-355a2396-60e1-486d-9e18-9b071b52db53' failed. Not Retrying. {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 22 18:01:07 devstack cinder-volume[81771]: DEBUG cinder.volume.volume_utils [None req-467093e4-e5d5-408e-ae2d-bd91dc3ff7de tempest-VolumesGetTest-1664969689 None] Downloaded image 9e076047-8ac8-4bf8-88ea-602aa20d3c9e ((None, [{'url': 'file:///opt/stack/data/glance/images/9e076047-8ac8-4bf8-88ea-602aa20d3c9e', 'metadata': {}}])) to volume 355a2396-60e1-486d-9e18-9b071b52db53 successfully. {{(pid=81771) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 22 18:01:07 devstack cinder-volume[81771]: DEBUG cinder.image.image_utils [None req-467093e4-e5d5-408e-ae2d-bd91dc3ff7de tempest-VolumesGetTest-1664969689 None] Temporary image 9e076047-8ac8-4bf8-88ea-602aa20d3c9e for user 30d5ce6c7a8843a2b191f01566e89dc3 is deleted. {{(pid=81771) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 22 18:01:07 devstack cinder-volume[81771]: DEBUG cinder.volume.volume_utils [None req-467093e4-e5d5-408e-ae2d-bd91dc3ff7de tempest-VolumesGetTest-1664969689 None] Marking volume 355a2396-60e1-486d-9e18-9b071b52db53 as bootable. {{(pid=81771) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 22 18:01:07 devstack cinder-volume[81771]: DEBUG cinder.volume.flows.manager.create_volume [None req-467093e4-e5d5-408e-ae2d-bd91dc3ff7de tempest-VolumesGetTest-1664969689 None] Copying metadata from image 9e076047-8ac8-4bf8-88ea-602aa20d3c9e to 355a2396-60e1-486d-9e18-9b071b52db53. {{(pid=81771) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 22 18:01:07 devstack cinder-volume[81771]: DEBUG cinder.volume.flows.manager.create_volume [None req-467093e4-e5d5-408e-ae2d-bd91dc3ff7de tempest-VolumesGetTest-1664969689 None] Creating volume glance metadata for volume 355a2396-60e1-486d-9e18-9b071b52db53 backed by image 9e076047-8ac8-4bf8-88ea-602aa20d3c9e with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '9e076047-8ac8-4bf8-88ea-602aa20d3c9e', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=81771) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 22 18:01:07 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-467093e4-e5d5-408e-ae2d-bd91dc3ff7de tempest-VolumesGetTest-1664969689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39c87adb-9778-4fc7-834a-9fa557e167a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-355a2396-60e1-486d-9e18-9b071b52db53', 'volume_size': 1, 'image_id': '9e076047-8ac8-4bf8-88ea-602aa20d3c9e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9e076047-8ac8-4bf8-88ea-602aa20d3c9e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '39e18fb0fde242f68d38bed6963e8744', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9e076047-8ac8-4bf8-88ea-602aa20d3c9e', 'created_at': datetime.datetime(2026, 4, 22, 15, 44, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 22, 15, 44, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9e076047-8ac8-4bf8-88ea-602aa20d3c9e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:01:07 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-467093e4-e5d5-408e-ae2d-bd91dc3ff7de tempest-VolumesGetTest-1664969689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9647aea-2c83-4811-9c71-6871d597401d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:01:07 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-467093e4-e5d5-408e-ae2d-bd91dc3ff7de tempest-VolumesGetTest-1664969689 None] Volume volume-355a2396-60e1-486d-9e18-9b071b52db53 (355a2396-60e1-486d-9e18-9b071b52db53): created successfully Apr 22 18:01:07 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-467093e4-e5d5-408e-ae2d-bd91dc3ff7de tempest-VolumesGetTest-1664969689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9647aea-2c83-4811-9c71-6871d597401d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:01:07 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-467093e4-e5d5-408e-ae2d-bd91dc3ff7de tempest-VolumesGetTest-1664969689 None] Flow 'volume_create_manager' (b0b7eb07-01ec-4b62-9c9d-56c200bd8d51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 18:01:07 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-467093e4-e5d5-408e-ae2d-bd91dc3ff7de tempest-VolumesGetTest-1664969689 None] Created volume successfully. Apr 22 18:01:08 devstack cinder-volume[81771]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e2985d7-ad89-438f-8dba-819c5a8a7019 tempest-VolumesGetTest-1664969689 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 18:01:08 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-2e2985d7-ad89-438f-8dba-819c5a8a7019 tempest-VolumesGetTest-1664969689 None] Flow 'volume_create_manager' (85a34a7b-8975-42c5-be8a-3680d8136e67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 18:01:08 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-2e2985d7-ad89-438f-8dba-819c5a8a7019 tempest-VolumesGetTest-1664969689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48f02ad3-e6f0-4887-b04e-e0a01dd76f50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:01:08 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-2e2985d7-ad89-438f-8dba-819c5a8a7019 tempest-VolumesGetTest-1664969689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48f02ad3-e6f0-4887-b04e-e0a01dd76f50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T16:01:08Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-843406288',display_name='tempest-VolumesGetTest-Volume-49921400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd4629c0-1366-49fd-8b0f-8233fc6292cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0e7ec173cd3484986be993fbf902802',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T16:01:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T16:01:09Z,use_quota=True,user_id='30d5ce6c7a8843a2b191f01566e89dc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:01:08 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-2e2985d7-ad89-438f-8dba-819c5a8a7019 tempest-VolumesGetTest-1664969689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17316a69-6116-4c71-9267-598912ea9c21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:01:08 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-2e2985d7-ad89-438f-8dba-819c5a8a7019 tempest-VolumesGetTest-1664969689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17316a69-6116-4c71-9267-598912ea9c21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:01:08 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-2e2985d7-ad89-438f-8dba-819c5a8a7019 tempest-VolumesGetTest-1664969689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ebff82c-f745-4cf4-b05a-a637752b9237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:01:08 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-2e2985d7-ad89-438f-8dba-819c5a8a7019 tempest-VolumesGetTest-1664969689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ebff82c-f745-4cf4-b05a-a637752b9237) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd4629c0-1366-49fd-8b0f-8233fc6292cf', 'volume_name': 'volume-dd4629c0-1366-49fd-8b0f-8233fc6292cf', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:01:08 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-2e2985d7-ad89-438f-8dba-819c5a8a7019 tempest-VolumesGetTest-1664969689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c591fe4b-4718-4cc6-9114-31ac19592075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:01:08 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-2e2985d7-ad89-438f-8dba-819c5a8a7019 tempest-VolumesGetTest-1664969689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c591fe4b-4718-4cc6-9114-31ac19592075) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:01:08 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-2e2985d7-ad89-438f-8dba-819c5a8a7019 tempest-VolumesGetTest-1664969689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd406bf0-5136-4dff-af19-63315a58cd4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:01:08 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-2e2985d7-ad89-438f-8dba-819c5a8a7019 tempest-VolumesGetTest-1664969689 None] Volume dd4629c0-1366-49fd-8b0f-8233fc6292cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd4629c0-1366-49fd-8b0f-8233fc6292cf', 'volume_size': 1} Apr 22 18:01:08 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-2e2985d7-ad89-438f-8dba-819c5a8a7019 tempest-VolumesGetTest-1664969689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 18:01:08 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-2e2985d7-ad89-438f-8dba-819c5a8a7019 tempest-VolumesGetTest-1664969689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 18:01:08 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-2e2985d7-ad89-438f-8dba-819c5a8a7019 tempest-VolumesGetTest-1664969689 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T16:01:08Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-843406288',display_name='tempest-VolumesGetTest-Volume-49921400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd4629c0-1366-49fd-8b0f-8233fc6292cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0e7ec173cd3484986be993fbf902802',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T16:01:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T16:01:09Z,use_quota=True,user_id='30d5ce6c7a8843a2b191f01566e89dc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)}" {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 18:01:08 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-2e2985d7-ad89-438f-8dba-819c5a8a7019 tempest-VolumesGetTest-1664969689 None] Creating volume dd4629c0-1366-49fd-8b0f-8233fc6292cf {{(pid=81771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 18:01:08 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-2e2985d7-ad89-438f-8dba-819c5a8a7019 tempest-VolumesGetTest-1664969689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 18:01:08 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-2e2985d7-ad89-438f-8dba-819c5a8a7019 tempest-VolumesGetTest-1664969689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 18:01:08 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-2e2985d7-ad89-438f-8dba-819c5a8a7019 tempest-VolumesGetTest-1664969689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 18:01:08 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-2e2985d7-ad89-438f-8dba-819c5a8a7019 tempest-VolumesGetTest-1664969689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 18:01:08 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-2e2985d7-ad89-438f-8dba-819c5a8a7019 tempest-VolumesGetTest-1664969689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 18:01:08 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-2e2985d7-ad89-438f-8dba-819c5a8a7019 tempest-VolumesGetTest-1664969689 None] Selected osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 as target Quobyte volume. {{(pid=81771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 18:01:08 devstack cinder-volume[81771]: INFO cinder.volume.drivers.remotefs [None req-2e2985d7-ad89-438f-8dba-819c5a8a7019 tempest-VolumesGetTest-1664969689 None] casted to osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 Apr 22 18:01:08 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-2e2985d7-ad89-438f-8dba-819c5a8a7019 tempest-VolumesGetTest-1664969689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-dd4629c0-1366-49fd-8b0f-8233fc6292cf 1073741824 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:01:08 devstack sudo[90499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-dd4629c0-1366-49fd-8b0f-8233fc6292cf 1073741824 Apr 22 18:01:08 devstack sudo[90499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:01:09 devstack sudo[90499]: pam_unix(sudo:session): session closed for user root Apr 22 18:01:09 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-2e2985d7-ad89-438f-8dba-819c5a8a7019 tempest-VolumesGetTest-1664969689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-dd4629c0-1366-49fd-8b0f-8233fc6292cf 1073741824" returned: 0 in 0.594s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:01:09 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-2e2985d7-ad89-438f-8dba-819c5a8a7019 tempest-VolumesGetTest-1664969689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-dd4629c0-1366-49fd-8b0f-8233fc6292cf {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:01:09 devstack sudo[90504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-dd4629c0-1366-49fd-8b0f-8233fc6292cf Apr 22 18:01:09 devstack sudo[90504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:01:09 devstack sudo[90504]: pam_unix(sudo:session): session closed for user root Apr 22 18:01:09 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-2e2985d7-ad89-438f-8dba-819c5a8a7019 tempest-VolumesGetTest-1664969689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-dd4629c0-1366-49fd-8b0f-8233fc6292cf" returned: 0 in 0.445s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:01:09 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-2e2985d7-ad89-438f-8dba-819c5a8a7019 tempest-VolumesGetTest-1664969689 None] <== create_volume: return (1077ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'} {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 18:01:09 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-2e2985d7-ad89-438f-8dba-819c5a8a7019 tempest-VolumesGetTest-1664969689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.079s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 18:01:09 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-2e2985d7-ad89-438f-8dba-819c5a8a7019 tempest-VolumesGetTest-1664969689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd406bf0-5136-4dff-af19-63315a58cd4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd4629c0-1366-49fd-8b0f-8233fc6292cf', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:01:09 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-2e2985d7-ad89-438f-8dba-819c5a8a7019 tempest-VolumesGetTest-1664969689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73b45310-40d8-45b5-a3bc-919faea4d0cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:01:09 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-2e2985d7-ad89-438f-8dba-819c5a8a7019 tempest-VolumesGetTest-1664969689 None] Volume volume-dd4629c0-1366-49fd-8b0f-8233fc6292cf (dd4629c0-1366-49fd-8b0f-8233fc6292cf): created successfully Apr 22 18:01:09 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-2e2985d7-ad89-438f-8dba-819c5a8a7019 tempest-VolumesGetTest-1664969689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73b45310-40d8-45b5-a3bc-919faea4d0cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:01:09 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-2e2985d7-ad89-438f-8dba-819c5a8a7019 tempest-VolumesGetTest-1664969689 None] Flow 'volume_create_manager' (85a34a7b-8975-42c5-be8a-3680d8136e67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 18:01:09 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-2e2985d7-ad89-438f-8dba-819c5a8a7019 tempest-VolumesGetTest-1664969689 None] Created volume successfully. Apr 22 18:01:10 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-0064142e-5957-4592-b42e-3ad1831d2b8d tempest-VolumesGetTest-1664969689 None] Acquiring lock "cinder-dd4629c0-1366-49fd-8b0f-8233fc6292cf-delete_volume" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 18:01:10 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-0064142e-5957-4592-b42e-3ad1831d2b8d tempest-VolumesGetTest-1664969689 None] Lock "cinder-dd4629c0-1366-49fd-8b0f-8233fc6292cf-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 18:01:11 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-0064142e-5957-4592-b42e-3ad1831d2b8d tempest-VolumesGetTest-1664969689 None] Acquiring lock "cinder-quobyte-dd4629c0-1366-49fd-8b0f-8233fc6292cf" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 18:01:11 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-0064142e-5957-4592-b42e-3ad1831d2b8d tempest-VolumesGetTest-1664969689 None] Lock "cinder-quobyte-dd4629c0-1366-49fd-8b0f-8233fc6292cf" acquired by "delete_volume" :: waited 0.015s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 18:01:11 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[3722ef37-ac84-4589-aa49-1828c4945680]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 18:01:11 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-0064142e-5957-4592-b42e-3ad1831d2b8d tempest-VolumesGetTest-1664969689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-dd4629c0-1366-49fd-8b0f-8233fc6292cf {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:01:11 devstack sudo[90507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-dd4629c0-1366-49fd-8b0f-8233fc6292cf Apr 22 18:01:11 devstack sudo[90507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:01:11 devstack sudo[90507]: pam_unix(sudo:session): session closed for user root Apr 22 18:01:11 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-0064142e-5957-4592-b42e-3ad1831d2b8d tempest-VolumesGetTest-1664969689 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-dd4629c0-1366-49fd-8b0f-8233fc6292cf" returned: 0 in 0.545s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:01:11 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-0064142e-5957-4592-b42e-3ad1831d2b8d tempest-VolumesGetTest-1664969689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-dd4629c0-1366-49fd-8b0f-8233fc6292cf {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:01:11 devstack sudo[90512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-dd4629c0-1366-49fd-8b0f-8233fc6292cf Apr 22 18:01:11 devstack sudo[90512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:01:12 devstack sudo[90512]: pam_unix(sudo:session): session closed for user root Apr 22 18:01:12 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-0064142e-5957-4592-b42e-3ad1831d2b8d tempest-VolumesGetTest-1664969689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-dd4629c0-1366-49fd-8b0f-8233fc6292cf" returned: 0 in 0.449s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:01:12 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-0064142e-5957-4592-b42e-3ad1831d2b8d tempest-VolumesGetTest-1664969689 None] Lock "cinder-quobyte-dd4629c0-1366-49fd-8b0f-8233fc6292cf" released by "delete_volume" :: held 1.035s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 18:01:12 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-0064142e-5957-4592-b42e-3ad1831d2b8d tempest-VolumesGetTest-1664969689 None] Created reservations ['4fb492f6-ea3d-4e9f-98df-c8aa4901dc88', '07bfc299-cb17-4730-8562-3667fa6fe6e2', '27a959bc-5797-4a49-9c2c-41788bacddc8', 'f827d063-76b8-4ea4-8ed1-b7342b4ffa51'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 18:01:12 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-0064142e-5957-4592-b42e-3ad1831d2b8d tempest-VolumesGetTest-1664969689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 18:01:12 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-0064142e-5957-4592-b42e-3ad1831d2b8d tempest-VolumesGetTest-1664969689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 18:01:12 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-0064142e-5957-4592-b42e-3ad1831d2b8d tempest-VolumesGetTest-1664969689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 18:01:12 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-0064142e-5957-4592-b42e-3ad1831d2b8d tempest-VolumesGetTest-1664969689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 18:01:12 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-0064142e-5957-4592-b42e-3ad1831d2b8d tempest-VolumesGetTest-1664969689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 18:01:12 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-0064142e-5957-4592-b42e-3ad1831d2b8d tempest-VolumesGetTest-1664969689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:01:12 devstack sudo[90515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 Apr 22 18:01:12 devstack sudo[90515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:01:12 devstack sudo[90515]: pam_unix(sudo:session): session closed for user root Apr 22 18:01:12 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-0064142e-5957-4592-b42e-3ad1831d2b8d tempest-VolumesGetTest-1664969689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33" returned: 0 in 0.442s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:01:12 devstack cinder-volume[81771]: DEBUG cinder.manager [None req-0064142e-5957-4592-b42e-3ad1831d2b8d tempest-VolumesGetTest-1664969689 None] Notifying Schedulers of capabilities ... {{(pid=81771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 18:01:12 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-0064142e-5957-4592-b42e-3ad1831d2b8d tempest-VolumesGetTest-1664969689 None] Deleted volume successfully. Apr 22 18:01:12 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-0064142e-5957-4592-b42e-3ad1831d2b8d tempest-VolumesGetTest-1664969689 None] Lock "cinder-dd4629c0-1366-49fd-8b0f-8233fc6292cf-delete_volume" released by "delete_volume" :: held 1.667s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 18:01:13 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-0bdb5020-e44b-485a-b7ef-77ca6dcda86f tempest-VolumesGetTest-1664969689 None] Acquiring lock "cinder-355a2396-60e1-486d-9e18-9b071b52db53-delete_volume" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 18:01:13 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-0bdb5020-e44b-485a-b7ef-77ca6dcda86f tempest-VolumesGetTest-1664969689 None] Lock "cinder-355a2396-60e1-486d-9e18-9b071b52db53-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 18:01:13 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-0bdb5020-e44b-485a-b7ef-77ca6dcda86f tempest-VolumesGetTest-1664969689 None] Acquiring lock "cinder-quobyte-355a2396-60e1-486d-9e18-9b071b52db53" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 18:01:13 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-0bdb5020-e44b-485a-b7ef-77ca6dcda86f tempest-VolumesGetTest-1664969689 None] Lock "cinder-quobyte-355a2396-60e1-486d-9e18-9b071b52db53" acquired by "delete_volume" :: waited 0.015s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 18:01:13 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[93e5fe60-bba5-4ce3-ac7f-ef10928faa47]: (4, 'raw') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 18:01:13 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-0bdb5020-e44b-485a-b7ef-77ca6dcda86f tempest-VolumesGetTest-1664969689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-355a2396-60e1-486d-9e18-9b071b52db53 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:01:13 devstack sudo[90518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-355a2396-60e1-486d-9e18-9b071b52db53 Apr 22 18:01:13 devstack sudo[90518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:01:13 devstack sudo[90518]: pam_unix(sudo:session): session closed for user root Apr 22 18:01:13 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-0bdb5020-e44b-485a-b7ef-77ca6dcda86f tempest-VolumesGetTest-1664969689 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-355a2396-60e1-486d-9e18-9b071b52db53" returned: 0 in 0.525s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:01:13 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-0bdb5020-e44b-485a-b7ef-77ca6dcda86f tempest-VolumesGetTest-1664969689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-355a2396-60e1-486d-9e18-9b071b52db53 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:01:13 devstack sudo[90522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-355a2396-60e1-486d-9e18-9b071b52db53 Apr 22 18:01:13 devstack sudo[90522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:01:14 devstack sudo[90522]: pam_unix(sudo:session): session closed for user root Apr 22 18:01:14 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-0bdb5020-e44b-485a-b7ef-77ca6dcda86f tempest-VolumesGetTest-1664969689 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-355a2396-60e1-486d-9e18-9b071b52db53" returned: 1 in 0.515s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:01:14 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-0bdb5020-e44b-485a-b7ef-77ca6dcda86f tempest-VolumesGetTest-1664969689 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-355a2396-60e1-486d-9e18-9b071b52db53' failed. Not Retrying. {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 22 18:01:14 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-0bdb5020-e44b-485a-b7ef-77ca6dcda86f tempest-VolumesGetTest-1664969689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-355a2396-60e1-486d-9e18-9b071b52db53 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:01:14 devstack sudo[90527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-355a2396-60e1-486d-9e18-9b071b52db53 Apr 22 18:01:14 devstack sudo[90527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:01:14 devstack sudo[90527]: pam_unix(sudo:session): session closed for user root Apr 22 18:01:14 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-0bdb5020-e44b-485a-b7ef-77ca6dcda86f tempest-VolumesGetTest-1664969689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-355a2396-60e1-486d-9e18-9b071b52db53" returned: 0 in 0.454s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:01:14 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-0bdb5020-e44b-485a-b7ef-77ca6dcda86f tempest-VolumesGetTest-1664969689 None] Lock "cinder-quobyte-355a2396-60e1-486d-9e18-9b071b52db53" released by "delete_volume" :: held 1.559s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 18:01:14 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-0bdb5020-e44b-485a-b7ef-77ca6dcda86f tempest-VolumesGetTest-1664969689 None] Created reservations ['e344e43a-f6e7-47c6-b8e1-e78bfaf94a17', 'c7e9ad97-ef04-4131-9439-a948ea36e2f0', 'e91342cb-2562-4a46-b300-6c5d2f80c5b9', 'c87f26a0-2a6e-46a2-8c7f-efc45e4d074b'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 18:01:14 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-0bdb5020-e44b-485a-b7ef-77ca6dcda86f tempest-VolumesGetTest-1664969689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 18:01:14 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-0bdb5020-e44b-485a-b7ef-77ca6dcda86f tempest-VolumesGetTest-1664969689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 18:01:14 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-0bdb5020-e44b-485a-b7ef-77ca6dcda86f tempest-VolumesGetTest-1664969689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 18:01:15 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-0bdb5020-e44b-485a-b7ef-77ca6dcda86f tempest-VolumesGetTest-1664969689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 18:01:15 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-0bdb5020-e44b-485a-b7ef-77ca6dcda86f tempest-VolumesGetTest-1664969689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 18:01:15 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-0bdb5020-e44b-485a-b7ef-77ca6dcda86f tempest-VolumesGetTest-1664969689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:01:15 devstack sudo[90530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 Apr 22 18:01:15 devstack sudo[90530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:01:15 devstack sudo[90530]: pam_unix(sudo:session): session closed for user root Apr 22 18:01:15 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-0bdb5020-e44b-485a-b7ef-77ca6dcda86f tempest-VolumesGetTest-1664969689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33" returned: 0 in 0.435s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:01:15 devstack cinder-volume[81771]: DEBUG cinder.manager [None req-0bdb5020-e44b-485a-b7ef-77ca6dcda86f tempest-VolumesGetTest-1664969689 None] Notifying Schedulers of capabilities ... {{(pid=81771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 18:01:15 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-0bdb5020-e44b-485a-b7ef-77ca6dcda86f tempest-VolumesGetTest-1664969689 None] Deleted volume successfully. Apr 22 18:01:15 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-0bdb5020-e44b-485a-b7ef-77ca6dcda86f tempest-VolumesGetTest-1664969689 None] Lock "cinder-355a2396-60e1-486d-9e18-9b071b52db53-delete_volume" released by "delete_volume" :: held 2.186s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 18:01:24 devstack cinder-volume[81771]: DEBUG dbcounter [-] [81771] Writing DB stats cinder:UPDATE=23,cinder:INSERT=12,cinder:SELECT=14,cinder:DELETE=1 {{(pid=81771) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 22 18:01:25 devstack cinder-volume[81771]: DEBUG dbcounter [-] [81771] Writing DB stats cinder:SELECT=31,cinder:UPDATE=30,cinder:DELETE=4,cinder:INSERT=11 {{(pid=81771) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 22 18:01:26 devstack cinder-volume[81771]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a4b13b6-3233-43b7-9a11-6536fadb1e1a tempest-CreateVolumesFromImageTest-569648132 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 18:01:26 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-6a4b13b6-3233-43b7-9a11-6536fadb1e1a tempest-CreateVolumesFromImageTest-569648132 None] Flow 'volume_create_manager' (69dac437-af66-4c31-a773-c63fed62f751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 18:01:26 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-6a4b13b6-3233-43b7-9a11-6536fadb1e1a tempest-CreateVolumesFromImageTest-569648132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ed37766-efa7-4bf5-b6d7-a83f09757805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:01:26 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-6a4b13b6-3233-43b7-9a11-6536fadb1e1a tempest-CreateVolumesFromImageTest-569648132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ed37766-efa7-4bf5-b6d7-a83f09757805) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T16:01:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-798893186',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d35ccc2-3ecd-4dac-845a-d2918866c299,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5a2349e6f714286ac4a6a220f078040',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T16:01:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T16:01:26Z,use_quota=True,user_id='8ae0ab8cc432424db58505b685a22014',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:01:26 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-6a4b13b6-3233-43b7-9a11-6536fadb1e1a tempest-CreateVolumesFromImageTest-569648132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd1d655b-ef98-404f-b678-cf6c6f6c5834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:01:26 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-6a4b13b6-3233-43b7-9a11-6536fadb1e1a tempest-CreateVolumesFromImageTest-569648132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd1d655b-ef98-404f-b678-cf6c6f6c5834) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:01:26 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-6a4b13b6-3233-43b7-9a11-6536fadb1e1a tempest-CreateVolumesFromImageTest-569648132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (565e923a-9cbe-4d89-b081-bf49f5e4dbe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:01:26 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-6a4b13b6-3233-43b7-9a11-6536fadb1e1a tempest-CreateVolumesFromImageTest-569648132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (565e923a-9cbe-4d89-b081-bf49f5e4dbe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d35ccc2-3ecd-4dac-845a-d2918866c299', 'volume_name': 'volume-2d35ccc2-3ecd-4dac-845a-d2918866c299', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:01:26 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-6a4b13b6-3233-43b7-9a11-6536fadb1e1a tempest-CreateVolumesFromImageTest-569648132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c7157a2-dd54-4cc2-8268-e0600d49ddb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:01:26 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-6a4b13b6-3233-43b7-9a11-6536fadb1e1a tempest-CreateVolumesFromImageTest-569648132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c7157a2-dd54-4cc2-8268-e0600d49ddb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:01:26 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-6a4b13b6-3233-43b7-9a11-6536fadb1e1a tempest-CreateVolumesFromImageTest-569648132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddf12217-b9a9-4d04-8bb4-909018666618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:01:26 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-6a4b13b6-3233-43b7-9a11-6536fadb1e1a tempest-CreateVolumesFromImageTest-569648132 None] Volume 2d35ccc2-3ecd-4dac-845a-d2918866c299: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d35ccc2-3ecd-4dac-845a-d2918866c299', 'volume_size': 1} Apr 22 18:01:26 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-6a4b13b6-3233-43b7-9a11-6536fadb1e1a tempest-CreateVolumesFromImageTest-569648132 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 18:01:26 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-6a4b13b6-3233-43b7-9a11-6536fadb1e1a tempest-CreateVolumesFromImageTest-569648132 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 18:01:26 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-6a4b13b6-3233-43b7-9a11-6536fadb1e1a tempest-CreateVolumesFromImageTest-569648132 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T16:01:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-798893186',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d35ccc2-3ecd-4dac-845a-d2918866c299,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5a2349e6f714286ac4a6a220f078040',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T16:01:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T16:01:26Z,use_quota=True,user_id='8ae0ab8cc432424db58505b685a22014',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)}" {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 18:01:26 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-6a4b13b6-3233-43b7-9a11-6536fadb1e1a tempest-CreateVolumesFromImageTest-569648132 None] Creating volume 2d35ccc2-3ecd-4dac-845a-d2918866c299 {{(pid=81771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 18:01:26 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-6a4b13b6-3233-43b7-9a11-6536fadb1e1a tempest-CreateVolumesFromImageTest-569648132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 18:01:26 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-6a4b13b6-3233-43b7-9a11-6536fadb1e1a tempest-CreateVolumesFromImageTest-569648132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 18:01:26 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-6a4b13b6-3233-43b7-9a11-6536fadb1e1a tempest-CreateVolumesFromImageTest-569648132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 18:01:26 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-6a4b13b6-3233-43b7-9a11-6536fadb1e1a tempest-CreateVolumesFromImageTest-569648132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 18:01:26 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-6a4b13b6-3233-43b7-9a11-6536fadb1e1a tempest-CreateVolumesFromImageTest-569648132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 18:01:26 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-6a4b13b6-3233-43b7-9a11-6536fadb1e1a tempest-CreateVolumesFromImageTest-569648132 None] Selected osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 as target Quobyte volume. {{(pid=81771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 18:01:26 devstack cinder-volume[81771]: INFO cinder.volume.drivers.remotefs [None req-6a4b13b6-3233-43b7-9a11-6536fadb1e1a tempest-CreateVolumesFromImageTest-569648132 None] casted to osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 Apr 22 18:01:26 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-6a4b13b6-3233-43b7-9a11-6536fadb1e1a tempest-CreateVolumesFromImageTest-569648132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-2d35ccc2-3ecd-4dac-845a-d2918866c299 1073741824 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:01:26 devstack cinder-volume[81771]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3b18fe0-eb38-4a41-b494-f9a85d339dbb tempest-VolumeDependencyTests-158100058 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 18:01:26 devstack sudo[90574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-2d35ccc2-3ecd-4dac-845a-d2918866c299 1073741824 Apr 22 18:01:26 devstack sudo[90574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:01:26 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-a3b18fe0-eb38-4a41-b494-f9a85d339dbb tempest-VolumeDependencyTests-158100058 None] Flow 'volume_create_manager' (5cdcc495-1f19-44e3-aad6-7e8dfd694295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 18:01:26 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-a3b18fe0-eb38-4a41-b494-f9a85d339dbb tempest-VolumeDependencyTests-158100058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1514db4-d054-4485-885e-320b9656a096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:01:26 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-a3b18fe0-eb38-4a41-b494-f9a85d339dbb tempest-VolumeDependencyTests-158100058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1514db4-d054-4485-885e-320b9656a096) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T16:01:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1449173079',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30ad2fa6-823a-48c4-a1d5-951ad2bc78f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='536299bc187146e6aafa6018c45d2513',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T16:01:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T16:01:26Z,use_quota=True,user_id='4f97ef6588be415596a71e15e94c99cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:01:26 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-a3b18fe0-eb38-4a41-b494-f9a85d339dbb tempest-VolumeDependencyTests-158100058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f547d10-77b8-4929-b213-c4864a95a3c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:01:26 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-a3b18fe0-eb38-4a41-b494-f9a85d339dbb tempest-VolumeDependencyTests-158100058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f547d10-77b8-4929-b213-c4864a95a3c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:01:26 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-a3b18fe0-eb38-4a41-b494-f9a85d339dbb tempest-VolumeDependencyTests-158100058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37e6ecb3-ac4d-43e2-9ab4-f8a59c91c8dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:01:26 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-a3b18fe0-eb38-4a41-b494-f9a85d339dbb tempest-VolumeDependencyTests-158100058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37e6ecb3-ac4d-43e2-9ab4-f8a59c91c8dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30ad2fa6-823a-48c4-a1d5-951ad2bc78f5', 'volume_name': 'volume-30ad2fa6-823a-48c4-a1d5-951ad2bc78f5', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:01:26 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-a3b18fe0-eb38-4a41-b494-f9a85d339dbb tempest-VolumeDependencyTests-158100058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0dd203a9-d7dd-4086-a113-680aabd71f40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:01:26 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-a3b18fe0-eb38-4a41-b494-f9a85d339dbb tempest-VolumeDependencyTests-158100058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0dd203a9-d7dd-4086-a113-680aabd71f40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:01:26 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-a3b18fe0-eb38-4a41-b494-f9a85d339dbb tempest-VolumeDependencyTests-158100058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b34dcea-290f-45a6-b733-e320fcc65542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:01:26 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-a3b18fe0-eb38-4a41-b494-f9a85d339dbb tempest-VolumeDependencyTests-158100058 None] Volume 30ad2fa6-823a-48c4-a1d5-951ad2bc78f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30ad2fa6-823a-48c4-a1d5-951ad2bc78f5', 'volume_size': 1} Apr 22 18:01:26 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-a3b18fe0-eb38-4a41-b494-f9a85d339dbb tempest-VolumeDependencyTests-158100058 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 18:01:26 devstack cinder-volume[81771]: DEBUG cinder.volume.flows.manager.create_volume [None req-db4a5f95-c714-41e5-96da-24cfd616927c tempest-CreateVolumesFromSnapshotTest-540484731 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 18:01:26 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-db4a5f95-c714-41e5-96da-24cfd616927c tempest-CreateVolumesFromSnapshotTest-540484731 None] Flow 'volume_create_manager' (a7cb72ae-4564-47e3-bd97-744ffb7fd263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 18:01:26 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-db4a5f95-c714-41e5-96da-24cfd616927c tempest-CreateVolumesFromSnapshotTest-540484731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa94e6fb-a540-43a3-a868-dbdcf1382a64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:01:26 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-db4a5f95-c714-41e5-96da-24cfd616927c tempest-CreateVolumesFromSnapshotTest-540484731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa94e6fb-a540-43a3-a868-dbdcf1382a64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T16:01:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-787077048',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55ffe258-4252-4fe1-a9d0-5200bd52bc4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ad058daf3dd47faa77e8d9cfd2b7b9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T16:01:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T16:01:26Z,use_quota=True,user_id='6cf81a539f0d43779bb0d619864d130a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:01:26 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-db4a5f95-c714-41e5-96da-24cfd616927c tempest-CreateVolumesFromSnapshotTest-540484731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da6ad815-b8f6-409e-93d2-41e24ea4a8d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:01:26 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-db4a5f95-c714-41e5-96da-24cfd616927c tempest-CreateVolumesFromSnapshotTest-540484731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da6ad815-b8f6-409e-93d2-41e24ea4a8d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:01:26 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-db4a5f95-c714-41e5-96da-24cfd616927c tempest-CreateVolumesFromSnapshotTest-540484731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c848964-4f56-40e2-a0be-dd73e8190a79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:01:26 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-db4a5f95-c714-41e5-96da-24cfd616927c tempest-CreateVolumesFromSnapshotTest-540484731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c848964-4f56-40e2-a0be-dd73e8190a79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55ffe258-4252-4fe1-a9d0-5200bd52bc4d', 'volume_name': 'volume-55ffe258-4252-4fe1-a9d0-5200bd52bc4d', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:01:26 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-db4a5f95-c714-41e5-96da-24cfd616927c tempest-CreateVolumesFromSnapshotTest-540484731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3845b68-78df-44dc-964d-b1e0569ff464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:01:26 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-db4a5f95-c714-41e5-96da-24cfd616927c tempest-CreateVolumesFromSnapshotTest-540484731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3845b68-78df-44dc-964d-b1e0569ff464) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:01:26 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-db4a5f95-c714-41e5-96da-24cfd616927c tempest-CreateVolumesFromSnapshotTest-540484731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48b0472b-a2a3-4890-bd4b-154018cacc25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:01:26 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-db4a5f95-c714-41e5-96da-24cfd616927c tempest-CreateVolumesFromSnapshotTest-540484731 None] Volume 55ffe258-4252-4fe1-a9d0-5200bd52bc4d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55ffe258-4252-4fe1-a9d0-5200bd52bc4d', 'volume_size': 1} Apr 22 18:01:26 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-db4a5f95-c714-41e5-96da-24cfd616927c tempest-CreateVolumesFromSnapshotTest-540484731 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 18:01:26 devstack cinder-volume[81771]: DEBUG cinder.volume.flows.manager.create_volume [None req-46f2e3e7-57f2-48a7-90f4-1feae9aebe45 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 18:01:26 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-46f2e3e7-57f2-48a7-90f4-1feae9aebe45 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Flow 'volume_create_manager' (80003dd8-fb68-46f4-8de1-19dd926e6491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 18:01:26 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-46f2e3e7-57f2-48a7-90f4-1feae9aebe45 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (430f9247-d926-4310-9479-6dbaee1fac12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:01:26 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-46f2e3e7-57f2-48a7-90f4-1feae9aebe45 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (430f9247-d926-4310-9479-6dbaee1fac12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T16:01:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-611651754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65691bb2-4668-4f12-8e78-134a22b2fc7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3ace5ef0e324f26a416db8aa339250a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T16:01:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T16:01:27Z,use_quota=True,user_id='7ca1e0b101e94628a5bab89043e2705b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:01:26 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-46f2e3e7-57f2-48a7-90f4-1feae9aebe45 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b377fe2f-3d98-4bbe-89ff-2287704a9228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:01:26 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-46f2e3e7-57f2-48a7-90f4-1feae9aebe45 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b377fe2f-3d98-4bbe-89ff-2287704a9228) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:01:26 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-46f2e3e7-57f2-48a7-90f4-1feae9aebe45 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f102ff1b-0de3-43db-a37e-03fe5239853f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:01:26 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-46f2e3e7-57f2-48a7-90f4-1feae9aebe45 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f102ff1b-0de3-43db-a37e-03fe5239853f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65691bb2-4668-4f12-8e78-134a22b2fc7b', 'volume_name': 'volume-65691bb2-4668-4f12-8e78-134a22b2fc7b', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:01:26 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-46f2e3e7-57f2-48a7-90f4-1feae9aebe45 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5125871d-c42a-42a4-8cea-7c9fbbc8329a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:01:26 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-46f2e3e7-57f2-48a7-90f4-1feae9aebe45 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5125871d-c42a-42a4-8cea-7c9fbbc8329a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:01:26 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-46f2e3e7-57f2-48a7-90f4-1feae9aebe45 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5123fe0a-745f-40d1-8457-986276268508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:01:26 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-46f2e3e7-57f2-48a7-90f4-1feae9aebe45 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Volume 65691bb2-4668-4f12-8e78-134a22b2fc7b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65691bb2-4668-4f12-8e78-134a22b2fc7b', 'volume_size': 1} Apr 22 18:01:26 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-46f2e3e7-57f2-48a7-90f4-1feae9aebe45 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 18:01:26 devstack cinder-volume[81771]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3eff88b-6a9a-4682-a25b-0f4469b7c9cc tempest-CreateVolumesFromImageTest-569648132 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 18:01:26 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-b3eff88b-6a9a-4682-a25b-0f4469b7c9cc tempest-CreateVolumesFromImageTest-569648132 None] Flow 'volume_create_manager' (eddd4dc3-2f70-498c-994b-c55a0867ff0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 18:01:26 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-b3eff88b-6a9a-4682-a25b-0f4469b7c9cc tempest-CreateVolumesFromImageTest-569648132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a83aaf6a-e311-471c-9bff-06ee64cca4c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:01:26 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-b3eff88b-6a9a-4682-a25b-0f4469b7c9cc tempest-CreateVolumesFromImageTest-569648132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a83aaf6a-e311-471c-9bff-06ee64cca4c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T16:01:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1088649145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b59b7459-24ba-4b27-bb60-e150169a41a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5a2349e6f714286ac4a6a220f078040',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T16:01:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T16:01:27Z,use_quota=True,user_id='8ae0ab8cc432424db58505b685a22014',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:01:26 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-b3eff88b-6a9a-4682-a25b-0f4469b7c9cc tempest-CreateVolumesFromImageTest-569648132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc1e85e5-0e31-4ce1-aeab-6a65c7ab150a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:01:26 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-b3eff88b-6a9a-4682-a25b-0f4469b7c9cc tempest-CreateVolumesFromImageTest-569648132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc1e85e5-0e31-4ce1-aeab-6a65c7ab150a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:01:26 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-b3eff88b-6a9a-4682-a25b-0f4469b7c9cc tempest-CreateVolumesFromImageTest-569648132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4946e8cb-3a49-4d4e-a8a4-62947136bebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:01:26 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-b3eff88b-6a9a-4682-a25b-0f4469b7c9cc tempest-CreateVolumesFromImageTest-569648132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4946e8cb-3a49-4d4e-a8a4-62947136bebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b59b7459-24ba-4b27-bb60-e150169a41a8', 'volume_name': 'volume-b59b7459-24ba-4b27-bb60-e150169a41a8', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:01:26 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-b3eff88b-6a9a-4682-a25b-0f4469b7c9cc tempest-CreateVolumesFromImageTest-569648132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efaee47a-a392-4890-a2b1-221b7543de06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:01:26 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-b3eff88b-6a9a-4682-a25b-0f4469b7c9cc tempest-CreateVolumesFromImageTest-569648132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efaee47a-a392-4890-a2b1-221b7543de06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:01:26 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-b3eff88b-6a9a-4682-a25b-0f4469b7c9cc tempest-CreateVolumesFromImageTest-569648132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afb4c8e3-0ba5-4d3f-97e9-7e1811a2b4c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:01:26 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-b3eff88b-6a9a-4682-a25b-0f4469b7c9cc tempest-CreateVolumesFromImageTest-569648132 None] Volume b59b7459-24ba-4b27-bb60-e150169a41a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b59b7459-24ba-4b27-bb60-e150169a41a8', 'volume_size': 1} Apr 22 18:01:26 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-b3eff88b-6a9a-4682-a25b-0f4469b7c9cc tempest-CreateVolumesFromImageTest-569648132 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 18:01:26 devstack sudo[90574]: pam_unix(sudo:session): session closed for user root Apr 22 18:01:26 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-6a4b13b6-3233-43b7-9a11-6536fadb1e1a tempest-CreateVolumesFromImageTest-569648132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-2d35ccc2-3ecd-4dac-845a-d2918866c299 1073741824" returned: 0 in 0.773s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:01:27 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-6a4b13b6-3233-43b7-9a11-6536fadb1e1a tempest-CreateVolumesFromImageTest-569648132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-2d35ccc2-3ecd-4dac-845a-d2918866c299 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:01:27 devstack sudo[90580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-2d35ccc2-3ecd-4dac-845a-d2918866c299 Apr 22 18:01:27 devstack sudo[90580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:01:27 devstack cinder-volume[81771]: DEBUG cinder.volume.flows.manager.create_volume [None req-16069ac3-2862-44ff-816e-f8107b0e7370 tempest-CreateVolumesFromImageTest-569648132 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 18:01:27 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-16069ac3-2862-44ff-816e-f8107b0e7370 tempest-CreateVolumesFromImageTest-569648132 None] Flow 'volume_create_manager' (0c083673-ffdc-4c93-87cf-137c0d3384d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 18:01:27 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-16069ac3-2862-44ff-816e-f8107b0e7370 tempest-CreateVolumesFromImageTest-569648132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e04f68a-af41-4640-884f-68bbc78a0510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:01:27 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-16069ac3-2862-44ff-816e-f8107b0e7370 tempest-CreateVolumesFromImageTest-569648132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e04f68a-af41-4640-884f-68bbc78a0510) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T16:01:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1114966287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8807a12f-8b83-464f-aec2-059b520ae1fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5a2349e6f714286ac4a6a220f078040',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T16:01:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T16:01:27Z,use_quota=True,user_id='8ae0ab8cc432424db58505b685a22014',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:01:27 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-16069ac3-2862-44ff-816e-f8107b0e7370 tempest-CreateVolumesFromImageTest-569648132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3b6f0fa-e670-4283-a2b8-5e4d2a150d33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:01:27 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-16069ac3-2862-44ff-816e-f8107b0e7370 tempest-CreateVolumesFromImageTest-569648132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3b6f0fa-e670-4283-a2b8-5e4d2a150d33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:01:27 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-16069ac3-2862-44ff-816e-f8107b0e7370 tempest-CreateVolumesFromImageTest-569648132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68316e0a-cdea-41ae-bf20-02685b9bde72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:01:27 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-16069ac3-2862-44ff-816e-f8107b0e7370 tempest-CreateVolumesFromImageTest-569648132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68316e0a-cdea-41ae-bf20-02685b9bde72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8807a12f-8b83-464f-aec2-059b520ae1fc', 'volume_name': 'volume-8807a12f-8b83-464f-aec2-059b520ae1fc', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:01:27 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-16069ac3-2862-44ff-816e-f8107b0e7370 tempest-CreateVolumesFromImageTest-569648132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1e6a272-c465-45a4-a2c6-802a06386388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:01:27 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-16069ac3-2862-44ff-816e-f8107b0e7370 tempest-CreateVolumesFromImageTest-569648132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1e6a272-c465-45a4-a2c6-802a06386388) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:01:27 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-16069ac3-2862-44ff-816e-f8107b0e7370 tempest-CreateVolumesFromImageTest-569648132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (436a63b0-e5be-4765-8b8c-318fdae96f00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:01:27 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-16069ac3-2862-44ff-816e-f8107b0e7370 tempest-CreateVolumesFromImageTest-569648132 None] Volume 8807a12f-8b83-464f-aec2-059b520ae1fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8807a12f-8b83-464f-aec2-059b520ae1fc', 'volume_size': 1} Apr 22 18:01:27 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-16069ac3-2862-44ff-816e-f8107b0e7370 tempest-CreateVolumesFromImageTest-569648132 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 18:01:27 devstack cinder-volume[81771]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fc2142b-146a-4db1-a6a1-be8fcce062d0 tempest-CreateVolumesFromImageTest-569648132 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 18:01:27 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-6fc2142b-146a-4db1-a6a1-be8fcce062d0 tempest-CreateVolumesFromImageTest-569648132 None] Flow 'volume_create_manager' (309e4fdf-4053-4622-8ffc-0367022f5d5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 18:01:27 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-6fc2142b-146a-4db1-a6a1-be8fcce062d0 tempest-CreateVolumesFromImageTest-569648132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cf79fd9-a78c-4cce-8dd9-cb366f5e5cfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:01:27 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-6fc2142b-146a-4db1-a6a1-be8fcce062d0 tempest-CreateVolumesFromImageTest-569648132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cf79fd9-a78c-4cce-8dd9-cb366f5e5cfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T16:01:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2063898568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f05792d2-7004-4af3-b7e3-f6269dad0750,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5a2349e6f714286ac4a6a220f078040',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T16:01:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T16:01:27Z,use_quota=True,user_id='8ae0ab8cc432424db58505b685a22014',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:01:27 devstack sudo[90580]: pam_unix(sudo:session): session closed for user root Apr 22 18:01:27 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-6fc2142b-146a-4db1-a6a1-be8fcce062d0 tempest-CreateVolumesFromImageTest-569648132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7804646-aba7-4d38-8d9b-19fca4ba984b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:01:27 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-6fc2142b-146a-4db1-a6a1-be8fcce062d0 tempest-CreateVolumesFromImageTest-569648132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7804646-aba7-4d38-8d9b-19fca4ba984b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:01:27 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-6fc2142b-146a-4db1-a6a1-be8fcce062d0 tempest-CreateVolumesFromImageTest-569648132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6f42219-ee5a-439d-958e-41a835def7a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:01:27 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-6fc2142b-146a-4db1-a6a1-be8fcce062d0 tempest-CreateVolumesFromImageTest-569648132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6f42219-ee5a-439d-958e-41a835def7a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f05792d2-7004-4af3-b7e3-f6269dad0750', 'volume_name': 'volume-f05792d2-7004-4af3-b7e3-f6269dad0750', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:01:27 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-6fc2142b-146a-4db1-a6a1-be8fcce062d0 tempest-CreateVolumesFromImageTest-569648132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eae8422b-d877-4873-b7bb-9419fbbc7e30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:01:27 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-6fc2142b-146a-4db1-a6a1-be8fcce062d0 tempest-CreateVolumesFromImageTest-569648132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eae8422b-d877-4873-b7bb-9419fbbc7e30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:01:27 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-6fc2142b-146a-4db1-a6a1-be8fcce062d0 tempest-CreateVolumesFromImageTest-569648132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d65ae6cd-5415-412a-9672-aecf520aba6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:01:27 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-6fc2142b-146a-4db1-a6a1-be8fcce062d0 tempest-CreateVolumesFromImageTest-569648132 None] Volume f05792d2-7004-4af3-b7e3-f6269dad0750: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f05792d2-7004-4af3-b7e3-f6269dad0750', 'volume_size': 1} Apr 22 18:01:27 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-6fc2142b-146a-4db1-a6a1-be8fcce062d0 tempest-CreateVolumesFromImageTest-569648132 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 18:01:27 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-6a4b13b6-3233-43b7-9a11-6536fadb1e1a tempest-CreateVolumesFromImageTest-569648132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-2d35ccc2-3ecd-4dac-845a-d2918866c299" returned: 0 in 0.576s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:01:27 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-6a4b13b6-3233-43b7-9a11-6536fadb1e1a tempest-CreateVolumesFromImageTest-569648132 None] <== create_volume: return (1398ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'} {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 18:01:27 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-6a4b13b6-3233-43b7-9a11-6536fadb1e1a tempest-CreateVolumesFromImageTest-569648132 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.401s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 18:01:27 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-a3b18fe0-eb38-4a41-b494-f9a85d339dbb tempest-VolumeDependencyTests-158100058 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.284s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 18:01:27 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-a3b18fe0-eb38-4a41-b494-f9a85d339dbb tempest-VolumeDependencyTests-158100058 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T16:01:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1449173079',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30ad2fa6-823a-48c4-a1d5-951ad2bc78f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='536299bc187146e6aafa6018c45d2513',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T16:01:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T16:01:26Z,use_quota=True,user_id='4f97ef6588be415596a71e15e94c99cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)}" {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 18:01:27 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-a3b18fe0-eb38-4a41-b494-f9a85d339dbb tempest-VolumeDependencyTests-158100058 None] Creating volume 30ad2fa6-823a-48c4-a1d5-951ad2bc78f5 {{(pid=81771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 18:01:27 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-a3b18fe0-eb38-4a41-b494-f9a85d339dbb tempest-VolumeDependencyTests-158100058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 18:01:27 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-a3b18fe0-eb38-4a41-b494-f9a85d339dbb tempest-VolumeDependencyTests-158100058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 18:01:27 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-a3b18fe0-eb38-4a41-b494-f9a85d339dbb tempest-VolumeDependencyTests-158100058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 18:01:27 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-a3b18fe0-eb38-4a41-b494-f9a85d339dbb tempest-VolumeDependencyTests-158100058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 18:01:27 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-a3b18fe0-eb38-4a41-b494-f9a85d339dbb tempest-VolumeDependencyTests-158100058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 18:01:27 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-a3b18fe0-eb38-4a41-b494-f9a85d339dbb tempest-VolumeDependencyTests-158100058 None] Selected osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 as target Quobyte volume. {{(pid=81771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 18:01:27 devstack cinder-volume[81771]: INFO cinder.volume.drivers.remotefs [None req-a3b18fe0-eb38-4a41-b494-f9a85d339dbb tempest-VolumeDependencyTests-158100058 None] casted to osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 Apr 22 18:01:27 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-a3b18fe0-eb38-4a41-b494-f9a85d339dbb tempest-VolumeDependencyTests-158100058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-30ad2fa6-823a-48c4-a1d5-951ad2bc78f5 1073741824 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:01:27 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-6a4b13b6-3233-43b7-9a11-6536fadb1e1a tempest-CreateVolumesFromImageTest-569648132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddf12217-b9a9-4d04-8bb4-909018666618) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d35ccc2-3ecd-4dac-845a-d2918866c299', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:01:27 devstack sudo[90584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-30ad2fa6-823a-48c4-a1d5-951ad2bc78f5 1073741824 Apr 22 18:01:27 devstack sudo[90584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:01:27 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-6a4b13b6-3233-43b7-9a11-6536fadb1e1a tempest-CreateVolumesFromImageTest-569648132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92db7085-2b08-4b00-9a0a-0986f28dae6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:01:27 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-6a4b13b6-3233-43b7-9a11-6536fadb1e1a tempest-CreateVolumesFromImageTest-569648132 None] Volume volume-2d35ccc2-3ecd-4dac-845a-d2918866c299 (2d35ccc2-3ecd-4dac-845a-d2918866c299): created successfully Apr 22 18:01:27 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-6a4b13b6-3233-43b7-9a11-6536fadb1e1a tempest-CreateVolumesFromImageTest-569648132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92db7085-2b08-4b00-9a0a-0986f28dae6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:01:27 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-6a4b13b6-3233-43b7-9a11-6536fadb1e1a tempest-CreateVolumesFromImageTest-569648132 None] Flow 'volume_create_manager' (69dac437-af66-4c31-a773-c63fed62f751) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 18:01:27 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-6a4b13b6-3233-43b7-9a11-6536fadb1e1a tempest-CreateVolumesFromImageTest-569648132 None] Created volume successfully. Apr 22 18:01:27 devstack cinder-volume[81771]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb12c05f-0213-43d1-b592-e468d348b9e6 tempest-CreateVolumesFromImageTest-569648132 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 18:01:27 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-bb12c05f-0213-43d1-b592-e468d348b9e6 tempest-CreateVolumesFromImageTest-569648132 None] Flow 'volume_create_manager' (2fe29549-50c2-482d-8db5-eea0286c2cd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 18:01:27 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-bb12c05f-0213-43d1-b592-e468d348b9e6 tempest-CreateVolumesFromImageTest-569648132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b63038fa-de70-4e8e-9c40-29bc5c74ff8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:01:27 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-bb12c05f-0213-43d1-b592-e468d348b9e6 tempest-CreateVolumesFromImageTest-569648132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b63038fa-de70-4e8e-9c40-29bc5c74ff8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T16:01:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-427853419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6217730a-5ecb-4f5c-b2c3-82e9d6e872f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5a2349e6f714286ac4a6a220f078040',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T16:01:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T16:01:28Z,use_quota=True,user_id='8ae0ab8cc432424db58505b685a22014',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:01:27 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-bb12c05f-0213-43d1-b592-e468d348b9e6 tempest-CreateVolumesFromImageTest-569648132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c04d7cb-b684-4664-95aa-2169b38d8619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:01:27 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-bb12c05f-0213-43d1-b592-e468d348b9e6 tempest-CreateVolumesFromImageTest-569648132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c04d7cb-b684-4664-95aa-2169b38d8619) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:01:27 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-bb12c05f-0213-43d1-b592-e468d348b9e6 tempest-CreateVolumesFromImageTest-569648132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0db67f85-3ec6-46ee-b4e6-133c00fa0580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:01:27 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-bb12c05f-0213-43d1-b592-e468d348b9e6 tempest-CreateVolumesFromImageTest-569648132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0db67f85-3ec6-46ee-b4e6-133c00fa0580) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6217730a-5ecb-4f5c-b2c3-82e9d6e872f8', 'volume_name': 'volume-6217730a-5ecb-4f5c-b2c3-82e9d6e872f8', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:01:27 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-bb12c05f-0213-43d1-b592-e468d348b9e6 tempest-CreateVolumesFromImageTest-569648132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0982787-bb1a-41a4-a4b0-239e987f3f02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:01:27 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-bb12c05f-0213-43d1-b592-e468d348b9e6 tempest-CreateVolumesFromImageTest-569648132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0982787-bb1a-41a4-a4b0-239e987f3f02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:01:27 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-bb12c05f-0213-43d1-b592-e468d348b9e6 tempest-CreateVolumesFromImageTest-569648132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cdf5ad4-5b17-4dbc-9b4a-da936d8f74a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:01:27 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-bb12c05f-0213-43d1-b592-e468d348b9e6 tempest-CreateVolumesFromImageTest-569648132 None] Volume 6217730a-5ecb-4f5c-b2c3-82e9d6e872f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6217730a-5ecb-4f5c-b2c3-82e9d6e872f8', 'volume_size': 1} Apr 22 18:01:27 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-bb12c05f-0213-43d1-b592-e468d348b9e6 tempest-CreateVolumesFromImageTest-569648132 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 18:01:28 devstack sudo[90584]: pam_unix(sudo:session): session closed for user root Apr 22 18:01:28 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-a3b18fe0-eb38-4a41-b494-f9a85d339dbb tempest-VolumeDependencyTests-158100058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-30ad2fa6-823a-48c4-a1d5-951ad2bc78f5 1073741824" returned: 0 in 0.686s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:01:28 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-a3b18fe0-eb38-4a41-b494-f9a85d339dbb tempest-VolumeDependencyTests-158100058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-30ad2fa6-823a-48c4-a1d5-951ad2bc78f5 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:01:28 devstack sudo[90589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-30ad2fa6-823a-48c4-a1d5-951ad2bc78f5 Apr 22 18:01:28 devstack sudo[90589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:01:28 devstack sudo[90589]: pam_unix(sudo:session): session closed for user root Apr 22 18:01:28 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-a3b18fe0-eb38-4a41-b494-f9a85d339dbb tempest-VolumeDependencyTests-158100058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-30ad2fa6-823a-48c4-a1d5-951ad2bc78f5" returned: 0 in 0.496s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:01:28 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-a3b18fe0-eb38-4a41-b494-f9a85d339dbb tempest-VolumeDependencyTests-158100058 None] <== create_volume: return (1224ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'} {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 18:01:28 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-a3b18fe0-eb38-4a41-b494-f9a85d339dbb tempest-VolumeDependencyTests-158100058 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.228s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 18:01:28 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-db4a5f95-c714-41e5-96da-24cfd616927c tempest-CreateVolumesFromSnapshotTest-540484731 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.203s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 18:01:28 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-db4a5f95-c714-41e5-96da-24cfd616927c tempest-CreateVolumesFromSnapshotTest-540484731 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T16:01:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-787077048',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55ffe258-4252-4fe1-a9d0-5200bd52bc4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ad058daf3dd47faa77e8d9cfd2b7b9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T16:01:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T16:01:26Z,use_quota=True,user_id='6cf81a539f0d43779bb0d619864d130a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)}" {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 18:01:28 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-db4a5f95-c714-41e5-96da-24cfd616927c tempest-CreateVolumesFromSnapshotTest-540484731 None] Creating volume 55ffe258-4252-4fe1-a9d0-5200bd52bc4d {{(pid=81771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 18:01:28 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-db4a5f95-c714-41e5-96da-24cfd616927c tempest-CreateVolumesFromSnapshotTest-540484731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 18:01:28 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-db4a5f95-c714-41e5-96da-24cfd616927c tempest-CreateVolumesFromSnapshotTest-540484731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 18:01:28 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-db4a5f95-c714-41e5-96da-24cfd616927c tempest-CreateVolumesFromSnapshotTest-540484731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 18:01:28 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-db4a5f95-c714-41e5-96da-24cfd616927c tempest-CreateVolumesFromSnapshotTest-540484731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 18:01:28 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-db4a5f95-c714-41e5-96da-24cfd616927c tempest-CreateVolumesFromSnapshotTest-540484731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 18:01:28 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-db4a5f95-c714-41e5-96da-24cfd616927c tempest-CreateVolumesFromSnapshotTest-540484731 None] Selected osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 as target Quobyte volume. {{(pid=81771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 18:01:28 devstack cinder-volume[81771]: INFO cinder.volume.drivers.remotefs [None req-db4a5f95-c714-41e5-96da-24cfd616927c tempest-CreateVolumesFromSnapshotTest-540484731 None] casted to osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 Apr 22 18:01:28 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-db4a5f95-c714-41e5-96da-24cfd616927c tempest-CreateVolumesFromSnapshotTest-540484731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-55ffe258-4252-4fe1-a9d0-5200bd52bc4d 1073741824 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:01:28 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-a3b18fe0-eb38-4a41-b494-f9a85d339dbb tempest-VolumeDependencyTests-158100058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b34dcea-290f-45a6-b733-e320fcc65542) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30ad2fa6-823a-48c4-a1d5-951ad2bc78f5', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:01:28 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-a3b18fe0-eb38-4a41-b494-f9a85d339dbb tempest-VolumeDependencyTests-158100058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f9fc2df-59d2-45af-8ed3-283852f7e642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:01:28 devstack sudo[90592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-55ffe258-4252-4fe1-a9d0-5200bd52bc4d 1073741824 Apr 22 18:01:28 devstack sudo[90592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:01:28 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-a3b18fe0-eb38-4a41-b494-f9a85d339dbb tempest-VolumeDependencyTests-158100058 None] Volume volume-30ad2fa6-823a-48c4-a1d5-951ad2bc78f5 (30ad2fa6-823a-48c4-a1d5-951ad2bc78f5): created successfully Apr 22 18:01:28 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-a3b18fe0-eb38-4a41-b494-f9a85d339dbb tempest-VolumeDependencyTests-158100058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f9fc2df-59d2-45af-8ed3-283852f7e642) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:01:28 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-a3b18fe0-eb38-4a41-b494-f9a85d339dbb tempest-VolumeDependencyTests-158100058 None] Flow 'volume_create_manager' (5cdcc495-1f19-44e3-aad6-7e8dfd694295) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 18:01:28 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-a3b18fe0-eb38-4a41-b494-f9a85d339dbb tempest-VolumeDependencyTests-158100058 None] Created volume successfully. Apr 22 18:01:29 devstack sudo[90592]: pam_unix(sudo:session): session closed for user root Apr 22 18:01:29 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-db4a5f95-c714-41e5-96da-24cfd616927c tempest-CreateVolumesFromSnapshotTest-540484731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-55ffe258-4252-4fe1-a9d0-5200bd52bc4d 1073741824" returned: 0 in 0.616s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:01:29 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-db4a5f95-c714-41e5-96da-24cfd616927c tempest-CreateVolumesFromSnapshotTest-540484731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-55ffe258-4252-4fe1-a9d0-5200bd52bc4d {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:01:29 devstack sudo[90597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-55ffe258-4252-4fe1-a9d0-5200bd52bc4d Apr 22 18:01:29 devstack sudo[90597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:01:29 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-b10677b7-38c9-4a3e-b56d-145598e84793 tempest-VolumeDependencyTests-158100058 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 18:01:29 devstack cinder-volume[81771]: DEBUG oslo_service.periodic_task [None req-1a7bdab5-8190-4e00-a2e2-843e5894ab49 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81771) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 22 18:01:29 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-1a7bdab5-8190-4e00-a2e2-843e5894ab49 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 18:01:29 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-1a7bdab5-8190-4e00-a2e2-843e5894ab49 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 18:01:29 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-1a7bdab5-8190-4e00-a2e2-843e5894ab49 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 18:01:29 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-1a7bdab5-8190-4e00-a2e2-843e5894ab49 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 18:01:29 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-1a7bdab5-8190-4e00-a2e2-843e5894ab49 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 18:01:29 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-1a7bdab5-8190-4e00-a2e2-843e5894ab49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:01:29 devstack sudo[90606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 Apr 22 18:01:29 devstack sudo[90606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:01:29 devstack sudo[90597]: pam_unix(sudo:session): session closed for user root Apr 22 18:01:29 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-db4a5f95-c714-41e5-96da-24cfd616927c tempest-CreateVolumesFromSnapshotTest-540484731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-55ffe258-4252-4fe1-a9d0-5200bd52bc4d" returned: 0 in 0.504s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:01:29 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-db4a5f95-c714-41e5-96da-24cfd616927c tempest-CreateVolumesFromSnapshotTest-540484731 None] <== create_volume: return (1158ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'} {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 18:01:29 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-db4a5f95-c714-41e5-96da-24cfd616927c tempest-CreateVolumesFromSnapshotTest-540484731 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.162s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 18:01:29 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-46f2e3e7-57f2-48a7-90f4-1feae9aebe45 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.267s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 18:01:29 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-46f2e3e7-57f2-48a7-90f4-1feae9aebe45 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T16:01:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-611651754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65691bb2-4668-4f12-8e78-134a22b2fc7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3ace5ef0e324f26a416db8aa339250a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T16:01:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T16:01:27Z,use_quota=True,user_id='7ca1e0b101e94628a5bab89043e2705b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)}" {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 18:01:29 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-46f2e3e7-57f2-48a7-90f4-1feae9aebe45 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Creating volume 65691bb2-4668-4f12-8e78-134a22b2fc7b {{(pid=81771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 18:01:29 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-46f2e3e7-57f2-48a7-90f4-1feae9aebe45 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 18:01:29 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-46f2e3e7-57f2-48a7-90f4-1feae9aebe45 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 18:01:29 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-46f2e3e7-57f2-48a7-90f4-1feae9aebe45 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 18:01:30 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-46f2e3e7-57f2-48a7-90f4-1feae9aebe45 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 18:01:30 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-46f2e3e7-57f2-48a7-90f4-1feae9aebe45 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 18:01:30 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-46f2e3e7-57f2-48a7-90f4-1feae9aebe45 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Selected osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 as target Quobyte volume. {{(pid=81771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 18:01:30 devstack cinder-volume[81771]: INFO cinder.volume.drivers.remotefs [None req-46f2e3e7-57f2-48a7-90f4-1feae9aebe45 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] casted to osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 Apr 22 18:01:30 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-46f2e3e7-57f2-48a7-90f4-1feae9aebe45 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-65691bb2-4668-4f12-8e78-134a22b2fc7b 1073741824 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:01:30 devstack sudo[90608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-65691bb2-4668-4f12-8e78-134a22b2fc7b 1073741824 Apr 22 18:01:30 devstack sudo[90608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:01:30 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-db4a5f95-c714-41e5-96da-24cfd616927c tempest-CreateVolumesFromSnapshotTest-540484731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48b0472b-a2a3-4890-bd4b-154018cacc25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55ffe258-4252-4fe1-a9d0-5200bd52bc4d', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:01:30 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-db4a5f95-c714-41e5-96da-24cfd616927c tempest-CreateVolumesFromSnapshotTest-540484731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b09b620-cba7-49c5-8160-1dfbd2837087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:01:30 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-db4a5f95-c714-41e5-96da-24cfd616927c tempest-CreateVolumesFromSnapshotTest-540484731 None] Volume volume-55ffe258-4252-4fe1-a9d0-5200bd52bc4d (55ffe258-4252-4fe1-a9d0-5200bd52bc4d): created successfully Apr 22 18:01:30 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-db4a5f95-c714-41e5-96da-24cfd616927c tempest-CreateVolumesFromSnapshotTest-540484731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b09b620-cba7-49c5-8160-1dfbd2837087) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:01:30 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-db4a5f95-c714-41e5-96da-24cfd616927c tempest-CreateVolumesFromSnapshotTest-540484731 None] Flow 'volume_create_manager' (a7cb72ae-4564-47e3-bd97-744ffb7fd263) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 18:01:30 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-db4a5f95-c714-41e5-96da-24cfd616927c tempest-CreateVolumesFromSnapshotTest-540484731 None] Created volume successfully. Apr 22 18:01:30 devstack sudo[90606]: pam_unix(sudo:session): session closed for user root Apr 22 18:01:30 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-1a7bdab5-8190-4e00-a2e2-843e5894ab49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33" returned: 0 in 0.487s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:01:30 devstack cinder-volume[81771]: DEBUG cinder.manager [None req-1a7bdab5-8190-4e00-a2e2-843e5894ab49 None None] Notifying Schedulers of capabilities ... {{(pid=81771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 18:01:30 devstack sudo[90608]: pam_unix(sudo:session): session closed for user root Apr 22 18:01:30 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-46f2e3e7-57f2-48a7-90f4-1feae9aebe45 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-65691bb2-4668-4f12-8e78-134a22b2fc7b 1073741824" returned: 0 in 0.605s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:01:30 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-46f2e3e7-57f2-48a7-90f4-1feae9aebe45 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-65691bb2-4668-4f12-8e78-134a22b2fc7b {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:01:30 devstack sudo[90614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-65691bb2-4668-4f12-8e78-134a22b2fc7b Apr 22 18:01:30 devstack sudo[90614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:01:31 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-467b0a8b-8e24-4660-a248-c521b2bf2a40 tempest-CreateVolumesFromSnapshotTest-540484731 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 18:01:31 devstack sudo[90614]: pam_unix(sudo:session): session closed for user root Apr 22 18:01:31 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-46f2e3e7-57f2-48a7-90f4-1feae9aebe45 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-65691bb2-4668-4f12-8e78-134a22b2fc7b" returned: 0 in 0.507s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:01:31 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-46f2e3e7-57f2-48a7-90f4-1feae9aebe45 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] <== create_volume: return (1152ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'} {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 18:01:31 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-46f2e3e7-57f2-48a7-90f4-1feae9aebe45 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.157s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 18:01:31 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-b3eff88b-6a9a-4682-a25b-0f4469b7c9cc tempest-CreateVolumesFromImageTest-569648132 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.259s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 18:01:31 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-b3eff88b-6a9a-4682-a25b-0f4469b7c9cc tempest-CreateVolumesFromImageTest-569648132 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T16:01:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1088649145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b59b7459-24ba-4b27-bb60-e150169a41a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5a2349e6f714286ac4a6a220f078040',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T16:01:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T16:01:27Z,use_quota=True,user_id='8ae0ab8cc432424db58505b685a22014',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)}" {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 18:01:31 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-b3eff88b-6a9a-4682-a25b-0f4469b7c9cc tempest-CreateVolumesFromImageTest-569648132 None] Creating volume b59b7459-24ba-4b27-bb60-e150169a41a8 {{(pid=81771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 18:01:31 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-b3eff88b-6a9a-4682-a25b-0f4469b7c9cc tempest-CreateVolumesFromImageTest-569648132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 18:01:31 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-b3eff88b-6a9a-4682-a25b-0f4469b7c9cc tempest-CreateVolumesFromImageTest-569648132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 18:01:31 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-b3eff88b-6a9a-4682-a25b-0f4469b7c9cc tempest-CreateVolumesFromImageTest-569648132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 18:01:31 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-b3eff88b-6a9a-4682-a25b-0f4469b7c9cc tempest-CreateVolumesFromImageTest-569648132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 18:01:31 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-b3eff88b-6a9a-4682-a25b-0f4469b7c9cc tempest-CreateVolumesFromImageTest-569648132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 18:01:31 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-b3eff88b-6a9a-4682-a25b-0f4469b7c9cc tempest-CreateVolumesFromImageTest-569648132 None] Selected osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 as target Quobyte volume. {{(pid=81771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 18:01:31 devstack cinder-volume[81771]: INFO cinder.volume.drivers.remotefs [None req-b3eff88b-6a9a-4682-a25b-0f4469b7c9cc tempest-CreateVolumesFromImageTest-569648132 None] casted to osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 Apr 22 18:01:31 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-b3eff88b-6a9a-4682-a25b-0f4469b7c9cc tempest-CreateVolumesFromImageTest-569648132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b59b7459-24ba-4b27-bb60-e150169a41a8 1073741824 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:01:31 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-46f2e3e7-57f2-48a7-90f4-1feae9aebe45 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5123fe0a-745f-40d1-8457-986276268508) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65691bb2-4668-4f12-8e78-134a22b2fc7b', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:01:31 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-46f2e3e7-57f2-48a7-90f4-1feae9aebe45 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffca13c8-c1e9-4bed-b5bf-63820aae6a48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:01:31 devstack sudo[90617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b59b7459-24ba-4b27-bb60-e150169a41a8 1073741824 Apr 22 18:01:31 devstack sudo[90617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:01:31 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-46f2e3e7-57f2-48a7-90f4-1feae9aebe45 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Volume volume-65691bb2-4668-4f12-8e78-134a22b2fc7b (65691bb2-4668-4f12-8e78-134a22b2fc7b): created successfully Apr 22 18:01:31 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-46f2e3e7-57f2-48a7-90f4-1feae9aebe45 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffca13c8-c1e9-4bed-b5bf-63820aae6a48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:01:31 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-46f2e3e7-57f2-48a7-90f4-1feae9aebe45 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Flow 'volume_create_manager' (80003dd8-fb68-46f4-8de1-19dd926e6491) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 18:01:31 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-46f2e3e7-57f2-48a7-90f4-1feae9aebe45 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Created volume successfully. Apr 22 18:01:31 devstack sudo[90617]: pam_unix(sudo:session): session closed for user root Apr 22 18:01:31 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-b3eff88b-6a9a-4682-a25b-0f4469b7c9cc tempest-CreateVolumesFromImageTest-569648132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b59b7459-24ba-4b27-bb60-e150169a41a8 1073741824" returned: 0 in 0.626s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:01:31 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-b3eff88b-6a9a-4682-a25b-0f4469b7c9cc tempest-CreateVolumesFromImageTest-569648132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b59b7459-24ba-4b27-bb60-e150169a41a8 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:01:31 devstack sudo[90622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b59b7459-24ba-4b27-bb60-e150169a41a8 Apr 22 18:01:31 devstack sudo[90622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:01:32 devstack cinder-volume[81771]: DEBUG cinder.volume.flows.manager.create_volume [None req-031e1254-37d9-44d2-9250-553afdd7e801 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 18:01:32 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-031e1254-37d9-44d2-9250-553afdd7e801 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Flow 'volume_create_manager' (ed53ace2-566d-4552-99d1-9cc24974f774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 18:01:32 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-031e1254-37d9-44d2-9250-553afdd7e801 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (633cbb85-35cf-41bf-8bc1-fb1ebd4e14fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:01:32 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-031e1254-37d9-44d2-9250-553afdd7e801 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (633cbb85-35cf-41bf-8bc1-fb1ebd4e14fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T16:01:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-666291396',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=006fbbb7-2b8a-4508-90ec-16b2a515007c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3ace5ef0e324f26a416db8aa339250a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T16:01:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T16:01:32Z,use_quota=True,user_id='7ca1e0b101e94628a5bab89043e2705b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:01:32 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-031e1254-37d9-44d2-9250-553afdd7e801 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cca730f1-d9ba-408e-af92-1012d4595d23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:01:32 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-031e1254-37d9-44d2-9250-553afdd7e801 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cca730f1-d9ba-408e-af92-1012d4595d23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:01:32 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-031e1254-37d9-44d2-9250-553afdd7e801 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cdf8237-b68c-46fb-8d64-be9d4125bb20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:01:32 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-031e1254-37d9-44d2-9250-553afdd7e801 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cdf8237-b68c-46fb-8d64-be9d4125bb20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '006fbbb7-2b8a-4508-90ec-16b2a515007c', 'volume_name': 'volume-006fbbb7-2b8a-4508-90ec-16b2a515007c', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:01:32 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-031e1254-37d9-44d2-9250-553afdd7e801 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c0dd2f9-a43a-4402-9452-a39726a114d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:01:32 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-031e1254-37d9-44d2-9250-553afdd7e801 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c0dd2f9-a43a-4402-9452-a39726a114d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:01:32 devstack sudo[90622]: pam_unix(sudo:session): session closed for user root Apr 22 18:01:32 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-031e1254-37d9-44d2-9250-553afdd7e801 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af3065d8-8317-4389-a887-cfa6588efa5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:01:32 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-031e1254-37d9-44d2-9250-553afdd7e801 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Volume 006fbbb7-2b8a-4508-90ec-16b2a515007c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-006fbbb7-2b8a-4508-90ec-16b2a515007c', 'volume_size': 1} Apr 22 18:01:32 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-031e1254-37d9-44d2-9250-553afdd7e801 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 18:01:32 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-b3eff88b-6a9a-4682-a25b-0f4469b7c9cc tempest-CreateVolumesFromImageTest-569648132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b59b7459-24ba-4b27-bb60-e150169a41a8" returned: 0 in 0.551s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:01:32 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-b3eff88b-6a9a-4682-a25b-0f4469b7c9cc tempest-CreateVolumesFromImageTest-569648132 None] <== create_volume: return (1216ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'} {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 18:01:32 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-b3eff88b-6a9a-4682-a25b-0f4469b7c9cc tempest-CreateVolumesFromImageTest-569648132 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.218s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 18:01:32 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-16069ac3-2862-44ff-816e-f8107b0e7370 tempest-CreateVolumesFromImageTest-569648132 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.159s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 18:01:32 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-16069ac3-2862-44ff-816e-f8107b0e7370 tempest-CreateVolumesFromImageTest-569648132 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T16:01:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1114966287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8807a12f-8b83-464f-aec2-059b520ae1fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5a2349e6f714286ac4a6a220f078040',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T16:01:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T16:01:27Z,use_quota=True,user_id='8ae0ab8cc432424db58505b685a22014',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)}" {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 18:01:32 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-16069ac3-2862-44ff-816e-f8107b0e7370 tempest-CreateVolumesFromImageTest-569648132 None] Creating volume 8807a12f-8b83-464f-aec2-059b520ae1fc {{(pid=81771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 18:01:32 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-16069ac3-2862-44ff-816e-f8107b0e7370 tempest-CreateVolumesFromImageTest-569648132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 18:01:32 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-16069ac3-2862-44ff-816e-f8107b0e7370 tempest-CreateVolumesFromImageTest-569648132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 18:01:32 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-16069ac3-2862-44ff-816e-f8107b0e7370 tempest-CreateVolumesFromImageTest-569648132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 18:01:32 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-16069ac3-2862-44ff-816e-f8107b0e7370 tempest-CreateVolumesFromImageTest-569648132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 18:01:32 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-16069ac3-2862-44ff-816e-f8107b0e7370 tempest-CreateVolumesFromImageTest-569648132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 18:01:32 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-16069ac3-2862-44ff-816e-f8107b0e7370 tempest-CreateVolumesFromImageTest-569648132 None] Selected osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 as target Quobyte volume. {{(pid=81771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 18:01:32 devstack cinder-volume[81771]: INFO cinder.volume.drivers.remotefs [None req-16069ac3-2862-44ff-816e-f8107b0e7370 tempest-CreateVolumesFromImageTest-569648132 None] casted to osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 Apr 22 18:01:32 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-16069ac3-2862-44ff-816e-f8107b0e7370 tempest-CreateVolumesFromImageTest-569648132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-8807a12f-8b83-464f-aec2-059b520ae1fc 1073741824 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:01:32 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-b3eff88b-6a9a-4682-a25b-0f4469b7c9cc tempest-CreateVolumesFromImageTest-569648132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afb4c8e3-0ba5-4d3f-97e9-7e1811a2b4c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b59b7459-24ba-4b27-bb60-e150169a41a8', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:01:32 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-b3eff88b-6a9a-4682-a25b-0f4469b7c9cc tempest-CreateVolumesFromImageTest-569648132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16774531-8dc6-4fc1-8181-8db5efa1656c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:01:32 devstack sudo[90625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-8807a12f-8b83-464f-aec2-059b520ae1fc 1073741824 Apr 22 18:01:32 devstack sudo[90625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:01:32 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-b3eff88b-6a9a-4682-a25b-0f4469b7c9cc tempest-CreateVolumesFromImageTest-569648132 None] Volume volume-b59b7459-24ba-4b27-bb60-e150169a41a8 (b59b7459-24ba-4b27-bb60-e150169a41a8): created successfully Apr 22 18:01:32 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-b3eff88b-6a9a-4682-a25b-0f4469b7c9cc tempest-CreateVolumesFromImageTest-569648132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16774531-8dc6-4fc1-8181-8db5efa1656c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:01:32 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-b3eff88b-6a9a-4682-a25b-0f4469b7c9cc tempest-CreateVolumesFromImageTest-569648132 None] Flow 'volume_create_manager' (eddd4dc3-2f70-498c-994b-c55a0867ff0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 18:01:32 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-b3eff88b-6a9a-4682-a25b-0f4469b7c9cc tempest-CreateVolumesFromImageTest-569648132 None] Created volume successfully. Apr 22 18:01:32 devstack cinder-volume[81771]: DEBUG cinder.volume.flows.manager.create_volume [None req-efce5a4a-dec8-4b99-ad9a-8900d1efdae5 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 18:01:32 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-efce5a4a-dec8-4b99-ad9a-8900d1efdae5 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Flow 'volume_create_manager' (ec656864-1c70-4cd9-9fb1-addae2525f9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 18:01:32 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-efce5a4a-dec8-4b99-ad9a-8900d1efdae5 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79f34f99-d9d6-49af-a753-66d322cd6cea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:01:32 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-efce5a4a-dec8-4b99-ad9a-8900d1efdae5 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79f34f99-d9d6-49af-a753-66d322cd6cea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T16:01:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-133949857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f0ae989-4db5-433f-8050-b471b212e992,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3ace5ef0e324f26a416db8aa339250a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T16:01:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T16:01:33Z,use_quota=True,user_id='7ca1e0b101e94628a5bab89043e2705b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:01:32 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-efce5a4a-dec8-4b99-ad9a-8900d1efdae5 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0a531ee-8b27-451f-be69-affbdef2b466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:01:32 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-efce5a4a-dec8-4b99-ad9a-8900d1efdae5 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0a531ee-8b27-451f-be69-affbdef2b466) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:01:32 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-efce5a4a-dec8-4b99-ad9a-8900d1efdae5 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f28fba54-2904-4659-80a1-e867b5ee3d25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:01:32 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-efce5a4a-dec8-4b99-ad9a-8900d1efdae5 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f28fba54-2904-4659-80a1-e867b5ee3d25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f0ae989-4db5-433f-8050-b471b212e992', 'volume_name': 'volume-7f0ae989-4db5-433f-8050-b471b212e992', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:01:32 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-efce5a4a-dec8-4b99-ad9a-8900d1efdae5 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb8346af-2b88-4510-bd22-5f225bf200ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:01:32 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-efce5a4a-dec8-4b99-ad9a-8900d1efdae5 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb8346af-2b88-4510-bd22-5f225bf200ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:01:32 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-efce5a4a-dec8-4b99-ad9a-8900d1efdae5 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af8a6c3c-996c-44ce-b2b3-824a2cc3d159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:01:32 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-efce5a4a-dec8-4b99-ad9a-8900d1efdae5 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Volume 7f0ae989-4db5-433f-8050-b471b212e992: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f0ae989-4db5-433f-8050-b471b212e992', 'volume_size': 1} Apr 22 18:01:32 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-efce5a4a-dec8-4b99-ad9a-8900d1efdae5 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 18:01:32 devstack cinder-volume[81771]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e498327-668a-424e-838c-13e1b89c6a27 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 18:01:32 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-2e498327-668a-424e-838c-13e1b89c6a27 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Flow 'volume_create_manager' (fb1b0259-8e1e-4e99-bfee-f79a57c281c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 18:01:32 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-2e498327-668a-424e-838c-13e1b89c6a27 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f91a399-aae7-4182-bb64-ab6bdafde9b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:01:32 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-2e498327-668a-424e-838c-13e1b89c6a27 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f91a399-aae7-4182-bb64-ab6bdafde9b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T16:01:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-160235006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92b992fc-e7be-425d-aa6b-9439469b00ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3ace5ef0e324f26a416db8aa339250a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T16:01:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T16:01:33Z,use_quota=True,user_id='7ca1e0b101e94628a5bab89043e2705b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:01:32 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-2e498327-668a-424e-838c-13e1b89c6a27 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a074fa1-7b29-4d54-8b8c-0ea1f2ed2048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:01:32 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-2e498327-668a-424e-838c-13e1b89c6a27 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a074fa1-7b29-4d54-8b8c-0ea1f2ed2048) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:01:32 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-2e498327-668a-424e-838c-13e1b89c6a27 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1cc37ef-4b79-40b9-851c-d5aea1164bf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:01:32 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-2e498327-668a-424e-838c-13e1b89c6a27 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1cc37ef-4b79-40b9-851c-d5aea1164bf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92b992fc-e7be-425d-aa6b-9439469b00ac', 'volume_name': 'volume-92b992fc-e7be-425d-aa6b-9439469b00ac', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:01:32 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-2e498327-668a-424e-838c-13e1b89c6a27 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be2e1a27-ccbc-431d-8814-ea75f6fa2cba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:01:32 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-2e498327-668a-424e-838c-13e1b89c6a27 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be2e1a27-ccbc-431d-8814-ea75f6fa2cba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:01:32 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-2e498327-668a-424e-838c-13e1b89c6a27 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3936be1e-9eb5-434a-8b08-9e2c7858ff34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:01:32 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-2e498327-668a-424e-838c-13e1b89c6a27 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Volume 92b992fc-e7be-425d-aa6b-9439469b00ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92b992fc-e7be-425d-aa6b-9439469b00ac', 'volume_size': 1} Apr 22 18:01:32 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-2e498327-668a-424e-838c-13e1b89c6a27 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 18:01:33 devstack sudo[90625]: pam_unix(sudo:session): session closed for user root Apr 22 18:01:33 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-16069ac3-2862-44ff-816e-f8107b0e7370 tempest-CreateVolumesFromImageTest-569648132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-8807a12f-8b83-464f-aec2-059b520ae1fc 1073741824" returned: 0 in 0.784s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:01:33 devstack cinder-volume[81771]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c26e9c0-847a-4f7f-84ad-1489b0668851 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 18:01:33 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-9c26e9c0-847a-4f7f-84ad-1489b0668851 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Flow 'volume_create_manager' (5bed5b19-2a8e-472d-86e6-22cd931a0b94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 18:01:33 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-9c26e9c0-847a-4f7f-84ad-1489b0668851 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82fd0227-74e9-4af7-a732-e125bee6c98b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:01:33 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-9c26e9c0-847a-4f7f-84ad-1489b0668851 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82fd0227-74e9-4af7-a732-e125bee6c98b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T16:01:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1967112556',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8019d1d3-1406-4f8d-8c82-6256a9fd32fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3ace5ef0e324f26a416db8aa339250a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T16:01:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T16:01:33Z,use_quota=True,user_id='7ca1e0b101e94628a5bab89043e2705b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:01:33 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-9c26e9c0-847a-4f7f-84ad-1489b0668851 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5bbeb68-1d91-459b-9cee-ec9c98caa255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:01:33 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-9c26e9c0-847a-4f7f-84ad-1489b0668851 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5bbeb68-1d91-459b-9cee-ec9c98caa255) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:01:33 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-9c26e9c0-847a-4f7f-84ad-1489b0668851 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c4b81b1-fdbb-4e39-a12e-6d2504b6f30e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:01:33 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-9c26e9c0-847a-4f7f-84ad-1489b0668851 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c4b81b1-fdbb-4e39-a12e-6d2504b6f30e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8019d1d3-1406-4f8d-8c82-6256a9fd32fd', 'volume_name': 'volume-8019d1d3-1406-4f8d-8c82-6256a9fd32fd', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:01:33 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-9c26e9c0-847a-4f7f-84ad-1489b0668851 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee454e1e-f11f-4e55-8696-0906759281cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:01:33 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-9c26e9c0-847a-4f7f-84ad-1489b0668851 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee454e1e-f11f-4e55-8696-0906759281cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:01:33 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-9c26e9c0-847a-4f7f-84ad-1489b0668851 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5c1b4eb-0e04-493b-a098-6860a1a7d808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:01:33 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-9c26e9c0-847a-4f7f-84ad-1489b0668851 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Volume 8019d1d3-1406-4f8d-8c82-6256a9fd32fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8019d1d3-1406-4f8d-8c82-6256a9fd32fd', 'volume_size': 1} Apr 22 18:01:33 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-9c26e9c0-847a-4f7f-84ad-1489b0668851 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 18:01:33 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-16069ac3-2862-44ff-816e-f8107b0e7370 tempest-CreateVolumesFromImageTest-569648132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-8807a12f-8b83-464f-aec2-059b520ae1fc {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:01:33 devstack sudo[90630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-8807a12f-8b83-464f-aec2-059b520ae1fc Apr 22 18:01:33 devstack sudo[90630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:01:33 devstack cinder-volume[81771]: DEBUG cinder.volume.flows.manager.create_volume [None req-82fa2a11-ed7f-47ce-b21b-9a4b8cf0b900 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 18:01:33 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-82fa2a11-ed7f-47ce-b21b-9a4b8cf0b900 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Flow 'volume_create_manager' (8548f5a5-f3c3-4caa-a8bb-4269fb8df5f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 18:01:33 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-82fa2a11-ed7f-47ce-b21b-9a4b8cf0b900 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b67c77fb-ea64-4070-a8f7-36c1be98d6b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:01:33 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-82fa2a11-ed7f-47ce-b21b-9a4b8cf0b900 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b67c77fb-ea64-4070-a8f7-36c1be98d6b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T16:01:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-84808493',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aebeecc6-ff1f-49e5-83e0-70d3f3e23314,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3ace5ef0e324f26a416db8aa339250a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T16:01:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T16:01:33Z,use_quota=True,user_id='7ca1e0b101e94628a5bab89043e2705b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:01:33 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-82fa2a11-ed7f-47ce-b21b-9a4b8cf0b900 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82aef11f-f5b0-47d1-afdf-3248a1d721c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:01:33 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-82fa2a11-ed7f-47ce-b21b-9a4b8cf0b900 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82aef11f-f5b0-47d1-afdf-3248a1d721c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:01:33 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-82fa2a11-ed7f-47ce-b21b-9a4b8cf0b900 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9d3914b-dd2b-4b79-ac1e-950787a21c08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:01:33 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-82fa2a11-ed7f-47ce-b21b-9a4b8cf0b900 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9d3914b-dd2b-4b79-ac1e-950787a21c08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aebeecc6-ff1f-49e5-83e0-70d3f3e23314', 'volume_name': 'volume-aebeecc6-ff1f-49e5-83e0-70d3f3e23314', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:01:33 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-82fa2a11-ed7f-47ce-b21b-9a4b8cf0b900 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b3a3bd3-c6d1-4cf0-8e39-ef49f7e386af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:01:33 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-82fa2a11-ed7f-47ce-b21b-9a4b8cf0b900 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b3a3bd3-c6d1-4cf0-8e39-ef49f7e386af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:01:33 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-82fa2a11-ed7f-47ce-b21b-9a4b8cf0b900 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0c4be9c-f426-41a1-9fd3-751363843a88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:01:33 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-82fa2a11-ed7f-47ce-b21b-9a4b8cf0b900 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Volume aebeecc6-ff1f-49e5-83e0-70d3f3e23314: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aebeecc6-ff1f-49e5-83e0-70d3f3e23314', 'volume_size': 1} Apr 22 18:01:33 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-82fa2a11-ed7f-47ce-b21b-9a4b8cf0b900 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 18:01:33 devstack sudo[90630]: pam_unix(sudo:session): session closed for user root Apr 22 18:01:33 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-16069ac3-2862-44ff-816e-f8107b0e7370 tempest-CreateVolumesFromImageTest-569648132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-8807a12f-8b83-464f-aec2-059b520ae1fc" returned: 0 in 0.475s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:01:33 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-16069ac3-2862-44ff-816e-f8107b0e7370 tempest-CreateVolumesFromImageTest-569648132 None] <== create_volume: return (1393ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'} {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 18:01:33 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-16069ac3-2862-44ff-816e-f8107b0e7370 tempest-CreateVolumesFromImageTest-569648132 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.397s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 18:01:33 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-6fc2142b-146a-4db1-a6a1-be8fcce062d0 tempest-CreateVolumesFromImageTest-569648132 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.197s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 18:01:33 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-6fc2142b-146a-4db1-a6a1-be8fcce062d0 tempest-CreateVolumesFromImageTest-569648132 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T16:01:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2063898568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f05792d2-7004-4af3-b7e3-f6269dad0750,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5a2349e6f714286ac4a6a220f078040',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T16:01:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T16:01:27Z,use_quota=True,user_id='8ae0ab8cc432424db58505b685a22014',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)}" {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 18:01:33 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-6fc2142b-146a-4db1-a6a1-be8fcce062d0 tempest-CreateVolumesFromImageTest-569648132 None] Creating volume f05792d2-7004-4af3-b7e3-f6269dad0750 {{(pid=81771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 18:01:33 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-6fc2142b-146a-4db1-a6a1-be8fcce062d0 tempest-CreateVolumesFromImageTest-569648132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 18:01:33 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-6fc2142b-146a-4db1-a6a1-be8fcce062d0 tempest-CreateVolumesFromImageTest-569648132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 18:01:33 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-6fc2142b-146a-4db1-a6a1-be8fcce062d0 tempest-CreateVolumesFromImageTest-569648132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 18:01:33 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-6fc2142b-146a-4db1-a6a1-be8fcce062d0 tempest-CreateVolumesFromImageTest-569648132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 18:01:33 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-6fc2142b-146a-4db1-a6a1-be8fcce062d0 tempest-CreateVolumesFromImageTest-569648132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 18:01:33 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-6fc2142b-146a-4db1-a6a1-be8fcce062d0 tempest-CreateVolumesFromImageTest-569648132 None] Selected osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 as target Quobyte volume. {{(pid=81771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 18:01:33 devstack cinder-volume[81771]: INFO cinder.volume.drivers.remotefs [None req-6fc2142b-146a-4db1-a6a1-be8fcce062d0 tempest-CreateVolumesFromImageTest-569648132 None] casted to osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 Apr 22 18:01:33 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-6fc2142b-146a-4db1-a6a1-be8fcce062d0 tempest-CreateVolumesFromImageTest-569648132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-f05792d2-7004-4af3-b7e3-f6269dad0750 1073741824 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:01:33 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-16069ac3-2862-44ff-816e-f8107b0e7370 tempest-CreateVolumesFromImageTest-569648132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (436a63b0-e5be-4765-8b8c-318fdae96f00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8807a12f-8b83-464f-aec2-059b520ae1fc', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:01:33 devstack sudo[90633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-f05792d2-7004-4af3-b7e3-f6269dad0750 1073741824 Apr 22 18:01:33 devstack sudo[90633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:01:33 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-16069ac3-2862-44ff-816e-f8107b0e7370 tempest-CreateVolumesFromImageTest-569648132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb251a41-e2f6-433d-ac15-b8128b4beed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:01:33 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-16069ac3-2862-44ff-816e-f8107b0e7370 tempest-CreateVolumesFromImageTest-569648132 None] Volume volume-8807a12f-8b83-464f-aec2-059b520ae1fc (8807a12f-8b83-464f-aec2-059b520ae1fc): created successfully Apr 22 18:01:33 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-16069ac3-2862-44ff-816e-f8107b0e7370 tempest-CreateVolumesFromImageTest-569648132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb251a41-e2f6-433d-ac15-b8128b4beed5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:01:33 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-16069ac3-2862-44ff-816e-f8107b0e7370 tempest-CreateVolumesFromImageTest-569648132 None] Flow 'volume_create_manager' (0c083673-ffdc-4c93-87cf-137c0d3384d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 18:01:33 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-16069ac3-2862-44ff-816e-f8107b0e7370 tempest-CreateVolumesFromImageTest-569648132 None] Created volume successfully. Apr 22 18:01:34 devstack sudo[90633]: pam_unix(sudo:session): session closed for user root Apr 22 18:01:34 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-6fc2142b-146a-4db1-a6a1-be8fcce062d0 tempest-CreateVolumesFromImageTest-569648132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-f05792d2-7004-4af3-b7e3-f6269dad0750 1073741824" returned: 0 in 0.613s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:01:34 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-6fc2142b-146a-4db1-a6a1-be8fcce062d0 tempest-CreateVolumesFromImageTest-569648132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-f05792d2-7004-4af3-b7e3-f6269dad0750 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:01:34 devstack sudo[90638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-f05792d2-7004-4af3-b7e3-f6269dad0750 Apr 22 18:01:34 devstack sudo[90638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:01:34 devstack sudo[90638]: pam_unix(sudo:session): session closed for user root Apr 22 18:01:34 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-6fc2142b-146a-4db1-a6a1-be8fcce062d0 tempest-CreateVolumesFromImageTest-569648132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-f05792d2-7004-4af3-b7e3-f6269dad0750" returned: 0 in 0.406s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:01:34 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-6fc2142b-146a-4db1-a6a1-be8fcce062d0 tempest-CreateVolumesFromImageTest-569648132 None] <== create_volume: return (1060ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'} {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 18:01:34 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-6fc2142b-146a-4db1-a6a1-be8fcce062d0 tempest-CreateVolumesFromImageTest-569648132 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.062s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 18:01:34 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-bb12c05f-0213-43d1-b592-e468d348b9e6 tempest-CreateVolumesFromImageTest-569648132 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.020s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 18:01:34 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-bb12c05f-0213-43d1-b592-e468d348b9e6 tempest-CreateVolumesFromImageTest-569648132 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T16:01:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-427853419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6217730a-5ecb-4f5c-b2c3-82e9d6e872f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5a2349e6f714286ac4a6a220f078040',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T16:01:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T16:01:28Z,use_quota=True,user_id='8ae0ab8cc432424db58505b685a22014',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)}" {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 18:01:34 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-bb12c05f-0213-43d1-b592-e468d348b9e6 tempest-CreateVolumesFromImageTest-569648132 None] Creating volume 6217730a-5ecb-4f5c-b2c3-82e9d6e872f8 {{(pid=81771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 18:01:34 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-bb12c05f-0213-43d1-b592-e468d348b9e6 tempest-CreateVolumesFromImageTest-569648132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 18:01:34 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-bb12c05f-0213-43d1-b592-e468d348b9e6 tempest-CreateVolumesFromImageTest-569648132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 18:01:34 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-bb12c05f-0213-43d1-b592-e468d348b9e6 tempest-CreateVolumesFromImageTest-569648132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 18:01:34 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-bb12c05f-0213-43d1-b592-e468d348b9e6 tempest-CreateVolumesFromImageTest-569648132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 18:01:34 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-bb12c05f-0213-43d1-b592-e468d348b9e6 tempest-CreateVolumesFromImageTest-569648132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 18:01:34 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-bb12c05f-0213-43d1-b592-e468d348b9e6 tempest-CreateVolumesFromImageTest-569648132 None] Selected osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 as target Quobyte volume. {{(pid=81771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 18:01:34 devstack cinder-volume[81771]: INFO cinder.volume.drivers.remotefs [None req-bb12c05f-0213-43d1-b592-e468d348b9e6 tempest-CreateVolumesFromImageTest-569648132 None] casted to osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 Apr 22 18:01:34 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-bb12c05f-0213-43d1-b592-e468d348b9e6 tempest-CreateVolumesFromImageTest-569648132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-6217730a-5ecb-4f5c-b2c3-82e9d6e872f8 1073741824 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:01:34 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-6fc2142b-146a-4db1-a6a1-be8fcce062d0 tempest-CreateVolumesFromImageTest-569648132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d65ae6cd-5415-412a-9672-aecf520aba6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f05792d2-7004-4af3-b7e3-f6269dad0750', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:01:34 devstack sudo[90641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-6217730a-5ecb-4f5c-b2c3-82e9d6e872f8 1073741824 Apr 22 18:01:34 devstack sudo[90641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:01:34 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-6fc2142b-146a-4db1-a6a1-be8fcce062d0 tempest-CreateVolumesFromImageTest-569648132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ca813e0-32ea-4c6d-82ff-0c1a6d19b742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:01:34 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-6fc2142b-146a-4db1-a6a1-be8fcce062d0 tempest-CreateVolumesFromImageTest-569648132 None] Volume volume-f05792d2-7004-4af3-b7e3-f6269dad0750 (f05792d2-7004-4af3-b7e3-f6269dad0750): created successfully Apr 22 18:01:34 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-6fc2142b-146a-4db1-a6a1-be8fcce062d0 tempest-CreateVolumesFromImageTest-569648132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ca813e0-32ea-4c6d-82ff-0c1a6d19b742) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:01:34 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-6fc2142b-146a-4db1-a6a1-be8fcce062d0 tempest-CreateVolumesFromImageTest-569648132 None] Flow 'volume_create_manager' (309e4fdf-4053-4622-8ffc-0367022f5d5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 18:01:34 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-6fc2142b-146a-4db1-a6a1-be8fcce062d0 tempest-CreateVolumesFromImageTest-569648132 None] Created volume successfully. Apr 22 18:01:35 devstack sudo[90641]: pam_unix(sudo:session): session closed for user root Apr 22 18:01:35 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-bb12c05f-0213-43d1-b592-e468d348b9e6 tempest-CreateVolumesFromImageTest-569648132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-6217730a-5ecb-4f5c-b2c3-82e9d6e872f8 1073741824" returned: 0 in 0.627s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:01:35 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-bb12c05f-0213-43d1-b592-e468d348b9e6 tempest-CreateVolumesFromImageTest-569648132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-6217730a-5ecb-4f5c-b2c3-82e9d6e872f8 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:01:35 devstack sudo[90646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-6217730a-5ecb-4f5c-b2c3-82e9d6e872f8 Apr 22 18:01:35 devstack sudo[90646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:01:35 devstack sudo[90646]: pam_unix(sudo:session): session closed for user root Apr 22 18:01:35 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-bb12c05f-0213-43d1-b592-e468d348b9e6 tempest-CreateVolumesFromImageTest-569648132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-6217730a-5ecb-4f5c-b2c3-82e9d6e872f8" returned: 0 in 0.410s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:01:35 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-bb12c05f-0213-43d1-b592-e468d348b9e6 tempest-CreateVolumesFromImageTest-569648132 None] <== create_volume: return (1077ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'} {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 18:01:35 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-bb12c05f-0213-43d1-b592-e468d348b9e6 tempest-CreateVolumesFromImageTest-569648132 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.080s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 18:01:35 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-b10677b7-38c9-4a3e-b56d-145598e84793 tempest-VolumeDependencyTests-158100058 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.043s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 18:01:35 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-bb12c05f-0213-43d1-b592-e468d348b9e6 tempest-CreateVolumesFromImageTest-569648132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cdf5ad4-5b17-4dbc-9b4a-da936d8f74a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6217730a-5ecb-4f5c-b2c3-82e9d6e872f8', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:01:35 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-bb12c05f-0213-43d1-b592-e468d348b9e6 tempest-CreateVolumesFromImageTest-569648132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf78393d-e82e-4a3d-bae4-98a557a0fc45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:01:35 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-b10677b7-38c9-4a3e-b56d-145598e84793 tempest-VolumeDependencyTests-158100058 None] Creating offline snapshot 720c2c8e-73a4-4b98-8ffb-37cede92e24c of volume 30ad2fa6-823a-48c4-a1d5-951ad2bc78f5 {{(pid=81771) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 22 18:01:35 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-bb12c05f-0213-43d1-b592-e468d348b9e6 tempest-CreateVolumesFromImageTest-569648132 None] Volume volume-6217730a-5ecb-4f5c-b2c3-82e9d6e872f8 (6217730a-5ecb-4f5c-b2c3-82e9d6e872f8): created successfully Apr 22 18:01:35 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-bb12c05f-0213-43d1-b592-e468d348b9e6 tempest-CreateVolumesFromImageTest-569648132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf78393d-e82e-4a3d-bae4-98a557a0fc45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:01:36 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-bb12c05f-0213-43d1-b592-e468d348b9e6 tempest-CreateVolumesFromImageTest-569648132 None] Flow 'volume_create_manager' (2fe29549-50c2-482d-8db5-eea0286c2cd5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 18:01:36 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[487b3986-8757-471a-97e1-37c4c4c90c3f]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 18:01:36 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-b10677b7-38c9-4a3e-b56d-145598e84793 tempest-VolumeDependencyTests-158100058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-30ad2fa6-823a-48c4-a1d5-951ad2bc78f5 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:01:36 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-bb12c05f-0213-43d1-b592-e468d348b9e6 tempest-CreateVolumesFromImageTest-569648132 None] Created volume successfully. Apr 22 18:01:36 devstack sudo[90649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-30ad2fa6-823a-48c4-a1d5-951ad2bc78f5 Apr 22 18:01:36 devstack sudo[90649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:01:36 devstack sudo[90649]: pam_unix(sudo:session): session closed for user root Apr 22 18:01:36 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-b10677b7-38c9-4a3e-b56d-145598e84793 tempest-VolumeDependencyTests-158100058 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-30ad2fa6-823a-48c4-a1d5-951ad2bc78f5" returned: 0 in 0.551s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:01:36 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-b10677b7-38c9-4a3e-b56d-145598e84793 tempest-VolumeDependencyTests-158100058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-30ad2fa6-823a-48c4-a1d5-951ad2bc78f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-30ad2fa6-823a-48c4-a1d5-951ad2bc78f5.720c2c8e-73a4-4b98-8ffb-37cede92e24c 1G {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:01:36 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-5199ac58-db1d-4d2e-b308-17175154566c tempest-CreateVolumesFromImageTest-569648132 None] Acquiring lock "cinder-6217730a-5ecb-4f5c-b2c3-82e9d6e872f8-delete_volume" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 18:01:36 devstack sudo[90654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-30ad2fa6-823a-48c4-a1d5-951ad2bc78f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-30ad2fa6-823a-48c4-a1d5-951ad2bc78f5.720c2c8e-73a4-4b98-8ffb-37cede92e24c 1G Apr 22 18:01:36 devstack sudo[90654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:01:36 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-5199ac58-db1d-4d2e-b308-17175154566c tempest-CreateVolumesFromImageTest-569648132 None] Lock "cinder-6217730a-5ecb-4f5c-b2c3-82e9d6e872f8-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 18:01:36 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-5199ac58-db1d-4d2e-b308-17175154566c tempest-CreateVolumesFromImageTest-569648132 None] Acquiring lock "cinder-quobyte-6217730a-5ecb-4f5c-b2c3-82e9d6e872f8" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 18:01:36 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-5199ac58-db1d-4d2e-b308-17175154566c tempest-CreateVolumesFromImageTest-569648132 None] Lock "cinder-quobyte-6217730a-5ecb-4f5c-b2c3-82e9d6e872f8" acquired by "delete_volume" :: waited 0.026s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 18:01:36 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f3d6b18-b59c-4d47-ac02-66a8dbedb443]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 18:01:36 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-5199ac58-db1d-4d2e-b308-17175154566c tempest-CreateVolumesFromImageTest-569648132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-6217730a-5ecb-4f5c-b2c3-82e9d6e872f8 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:01:36 devstack sudo[90656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-6217730a-5ecb-4f5c-b2c3-82e9d6e872f8 Apr 22 18:01:36 devstack sudo[90656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:01:37 devstack sudo[90654]: pam_unix(sudo:session): session closed for user root Apr 22 18:01:37 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-b10677b7-38c9-4a3e-b56d-145598e84793 tempest-VolumeDependencyTests-158100058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-30ad2fa6-823a-48c4-a1d5-951ad2bc78f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-30ad2fa6-823a-48c4-a1d5-951ad2bc78f5.720c2c8e-73a4-4b98-8ffb-37cede92e24c 1G" returned: 0 in 0.593s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:01:37 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-b10677b7-38c9-4a3e-b56d-145598e84793 tempest-VolumeDependencyTests-158100058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30ad2fa6-823a-48c4-a1d5-951ad2bc78f5 -F qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-30ad2fa6-823a-48c4-a1d5-951ad2bc78f5.720c2c8e-73a4-4b98-8ffb-37cede92e24c {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:01:37 devstack sudo[90663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30ad2fa6-823a-48c4-a1d5-951ad2bc78f5 -F qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-30ad2fa6-823a-48c4-a1d5-951ad2bc78f5.720c2c8e-73a4-4b98-8ffb-37cede92e24c Apr 22 18:01:37 devstack sudo[90663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:01:37 devstack sudo[90656]: pam_unix(sudo:session): session closed for user root Apr 22 18:01:37 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-5199ac58-db1d-4d2e-b308-17175154566c tempest-CreateVolumesFromImageTest-569648132 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-6217730a-5ecb-4f5c-b2c3-82e9d6e872f8" returned: 0 in 0.580s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:01:37 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-5199ac58-db1d-4d2e-b308-17175154566c tempest-CreateVolumesFromImageTest-569648132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-6217730a-5ecb-4f5c-b2c3-82e9d6e872f8 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:01:37 devstack sudo[90667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-6217730a-5ecb-4f5c-b2c3-82e9d6e872f8 Apr 22 18:01:37 devstack sudo[90667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:01:37 devstack sudo[90663]: pam_unix(sudo:session): session closed for user root Apr 22 18:01:37 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-b10677b7-38c9-4a3e-b56d-145598e84793 tempest-VolumeDependencyTests-158100058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30ad2fa6-823a-48c4-a1d5-951ad2bc78f5 -F qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-30ad2fa6-823a-48c4-a1d5-951ad2bc78f5.720c2c8e-73a4-4b98-8ffb-37cede92e24c" returned: 0 in 0.550s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:01:37 devstack cinder-volume[81771]: WARNING cinder.volume.drivers.remotefs [None req-b10677b7-38c9-4a3e-b56d-145598e84793 tempest-VolumeDependencyTests-158100058 None] /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-30ad2fa6-823a-48c4-a1d5-951ad2bc78f5.720c2c8e-73a4-4b98-8ffb-37cede92e24c is being set with open permissions: ugo+rw Apr 22 18:01:37 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-b10677b7-38c9-4a3e-b56d-145598e84793 tempest-VolumeDependencyTests-158100058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-30ad2fa6-823a-48c4-a1d5-951ad2bc78f5.720c2c8e-73a4-4b98-8ffb-37cede92e24c {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:01:37 devstack sudo[90673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-30ad2fa6-823a-48c4-a1d5-951ad2bc78f5.720c2c8e-73a4-4b98-8ffb-37cede92e24c Apr 22 18:01:37 devstack sudo[90673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:01:37 devstack sudo[90667]: pam_unix(sudo:session): session closed for user root Apr 22 18:01:37 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-5199ac58-db1d-4d2e-b308-17175154566c tempest-CreateVolumesFromImageTest-569648132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-6217730a-5ecb-4f5c-b2c3-82e9d6e872f8" returned: 0 in 0.486s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:01:37 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-5199ac58-db1d-4d2e-b308-17175154566c tempest-CreateVolumesFromImageTest-569648132 None] Lock "cinder-quobyte-6217730a-5ecb-4f5c-b2c3-82e9d6e872f8" released by "delete_volume" :: held 1.107s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 18:01:37 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-5199ac58-db1d-4d2e-b308-17175154566c tempest-CreateVolumesFromImageTest-569648132 None] Created reservations ['56c3a9c6-bfed-46c8-b8a2-6e4e9f383bf1', '7836a321-93ab-49c6-abd5-6a2ae26a083b', '0444f955-b50b-4a89-9b48-c847020cc702', 'fad20808-dc6e-4ebc-aa74-08fe40a2e1ab'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 18:01:37 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-5199ac58-db1d-4d2e-b308-17175154566c tempest-CreateVolumesFromImageTest-569648132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 18:01:37 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-5199ac58-db1d-4d2e-b308-17175154566c tempest-CreateVolumesFromImageTest-569648132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 18:01:37 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-5199ac58-db1d-4d2e-b308-17175154566c tempest-CreateVolumesFromImageTest-569648132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 18:01:37 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-5199ac58-db1d-4d2e-b308-17175154566c tempest-CreateVolumesFromImageTest-569648132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 18:01:37 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-5199ac58-db1d-4d2e-b308-17175154566c tempest-CreateVolumesFromImageTest-569648132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 18:01:37 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-5199ac58-db1d-4d2e-b308-17175154566c tempest-CreateVolumesFromImageTest-569648132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:01:37 devstack sudo[90675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 Apr 22 18:01:37 devstack sudo[90675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:01:38 devstack sudo[90673]: pam_unix(sudo:session): session closed for user root Apr 22 18:01:38 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-b10677b7-38c9-4a3e-b56d-145598e84793 tempest-VolumeDependencyTests-158100058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-30ad2fa6-823a-48c4-a1d5-951ad2bc78f5.720c2c8e-73a4-4b98-8ffb-37cede92e24c" returned: 0 in 0.414s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:01:38 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-b10677b7-38c9-4a3e-b56d-145598e84793 tempest-VolumeDependencyTests-158100058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-30ad2fa6-823a-48c4-a1d5-951ad2bc78f5.info {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:01:38 devstack sudo[90678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-30ad2fa6-823a-48c4-a1d5-951ad2bc78f5.info Apr 22 18:01:38 devstack sudo[90678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:01:38 devstack sudo[90675]: pam_unix(sudo:session): session closed for user root Apr 22 18:01:38 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-5199ac58-db1d-4d2e-b308-17175154566c tempest-CreateVolumesFromImageTest-569648132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33" returned: 0 in 0.452s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:01:38 devstack cinder-volume[81771]: DEBUG cinder.manager [None req-5199ac58-db1d-4d2e-b308-17175154566c tempest-CreateVolumesFromImageTest-569648132 None] Notifying Schedulers of capabilities ... {{(pid=81771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 18:01:38 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-5199ac58-db1d-4d2e-b308-17175154566c tempest-CreateVolumesFromImageTest-569648132 None] Deleted volume successfully. Apr 22 18:01:38 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-5199ac58-db1d-4d2e-b308-17175154566c tempest-CreateVolumesFromImageTest-569648132 None] Lock "cinder-6217730a-5ecb-4f5c-b2c3-82e9d6e872f8-delete_volume" released by "delete_volume" :: held 1.766s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 18:01:38 devstack sudo[90678]: pam_unix(sudo:session): session closed for user root Apr 22 18:01:38 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-b10677b7-38c9-4a3e-b56d-145598e84793 tempest-VolumeDependencyTests-158100058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-30ad2fa6-823a-48c4-a1d5-951ad2bc78f5.info" returned: 0 in 0.481s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:01:38 devstack cinder-volume[81771]: WARNING cinder.volume.drivers.remotefs [None req-b10677b7-38c9-4a3e-b56d-145598e84793 tempest-VolumeDependencyTests-158100058 None] /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-30ad2fa6-823a-48c4-a1d5-951ad2bc78f5.info is being set with open permissions: ugo+rw Apr 22 18:01:38 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-b10677b7-38c9-4a3e-b56d-145598e84793 tempest-VolumeDependencyTests-158100058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-30ad2fa6-823a-48c4-a1d5-951ad2bc78f5.info {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:01:38 devstack sudo[90682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-30ad2fa6-823a-48c4-a1d5-951ad2bc78f5.info Apr 22 18:01:38 devstack sudo[90682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:01:38 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-2376b8bd-b7c7-42c0-8f51-26d5646bc3e5 tempest-CreateVolumesFromImageTest-569648132 None] Acquiring lock "cinder-f05792d2-7004-4af3-b7e3-f6269dad0750-delete_volume" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 18:01:38 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-2376b8bd-b7c7-42c0-8f51-26d5646bc3e5 tempest-CreateVolumesFromImageTest-569648132 None] Lock "cinder-f05792d2-7004-4af3-b7e3-f6269dad0750-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 18:01:38 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-2376b8bd-b7c7-42c0-8f51-26d5646bc3e5 tempest-CreateVolumesFromImageTest-569648132 None] Acquiring lock "cinder-quobyte-f05792d2-7004-4af3-b7e3-f6269dad0750" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 18:01:38 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-2376b8bd-b7c7-42c0-8f51-26d5646bc3e5 tempest-CreateVolumesFromImageTest-569648132 None] Lock "cinder-quobyte-f05792d2-7004-4af3-b7e3-f6269dad0750" acquired by "delete_volume" :: waited 0.015s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 18:01:38 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[cca7dea5-e9a3-4af9-a50e-9cba1009222b]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 18:01:38 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-2376b8bd-b7c7-42c0-8f51-26d5646bc3e5 tempest-CreateVolumesFromImageTest-569648132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-f05792d2-7004-4af3-b7e3-f6269dad0750 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:01:39 devstack sudo[90684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-f05792d2-7004-4af3-b7e3-f6269dad0750 Apr 22 18:01:39 devstack sudo[90684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:01:39 devstack sudo[90682]: pam_unix(sudo:session): session closed for user root Apr 22 18:01:39 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-b10677b7-38c9-4a3e-b56d-145598e84793 tempest-VolumeDependencyTests-158100058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-30ad2fa6-823a-48c4-a1d5-951ad2bc78f5.info" returned: 0 in 0.471s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:01:39 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-b10677b7-38c9-4a3e-b56d-145598e84793 tempest-VolumeDependencyTests-158100058 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.189s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 18:01:39 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-467b0a8b-8e24-4660-a248-c521b2bf2a40 tempest-CreateVolumesFromSnapshotTest-540484731 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.090s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 18:01:39 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-467b0a8b-8e24-4660-a248-c521b2bf2a40 tempest-CreateVolumesFromSnapshotTest-540484731 None] Creating offline snapshot 6cd77635-8e8b-4129-be92-1fc6b569dc59 of volume 55ffe258-4252-4fe1-a9d0-5200bd52bc4d {{(pid=81771) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 22 18:01:39 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-b10677b7-38c9-4a3e-b56d-145598e84793 tempest-VolumeDependencyTests-158100058 None] Create snapshot completed successfully Apr 22 18:01:39 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c236d5d-ff48-4582-9ec4-140432360889]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 18:01:39 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-467b0a8b-8e24-4660-a248-c521b2bf2a40 tempest-CreateVolumesFromSnapshotTest-540484731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-55ffe258-4252-4fe1-a9d0-5200bd52bc4d {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:01:39 devstack sudo[90687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-55ffe258-4252-4fe1-a9d0-5200bd52bc4d Apr 22 18:01:39 devstack sudo[90687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:01:39 devstack sudo[90684]: pam_unix(sudo:session): session closed for user root Apr 22 18:01:39 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-2376b8bd-b7c7-42c0-8f51-26d5646bc3e5 tempest-CreateVolumesFromImageTest-569648132 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-f05792d2-7004-4af3-b7e3-f6269dad0750" returned: 0 in 0.560s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:01:39 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-2376b8bd-b7c7-42c0-8f51-26d5646bc3e5 tempest-CreateVolumesFromImageTest-569648132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-f05792d2-7004-4af3-b7e3-f6269dad0750 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:01:39 devstack sudo[90692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-f05792d2-7004-4af3-b7e3-f6269dad0750 Apr 22 18:01:39 devstack sudo[90692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:01:39 devstack sudo[90687]: pam_unix(sudo:session): session closed for user root Apr 22 18:01:39 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-467b0a8b-8e24-4660-a248-c521b2bf2a40 tempest-CreateVolumesFromSnapshotTest-540484731 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-55ffe258-4252-4fe1-a9d0-5200bd52bc4d" returned: 0 in 0.546s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:01:39 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-467b0a8b-8e24-4660-a248-c521b2bf2a40 tempest-CreateVolumesFromSnapshotTest-540484731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-55ffe258-4252-4fe1-a9d0-5200bd52bc4d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-55ffe258-4252-4fe1-a9d0-5200bd52bc4d.6cd77635-8e8b-4129-be92-1fc6b569dc59 1G {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:01:39 devstack sudo[90697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-55ffe258-4252-4fe1-a9d0-5200bd52bc4d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-55ffe258-4252-4fe1-a9d0-5200bd52bc4d.6cd77635-8e8b-4129-be92-1fc6b569dc59 1G Apr 22 18:01:39 devstack sudo[90697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:01:39 devstack sudo[90692]: pam_unix(sudo:session): session closed for user root Apr 22 18:01:39 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-2376b8bd-b7c7-42c0-8f51-26d5646bc3e5 tempest-CreateVolumesFromImageTest-569648132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-f05792d2-7004-4af3-b7e3-f6269dad0750" returned: 0 in 0.462s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:01:39 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-2376b8bd-b7c7-42c0-8f51-26d5646bc3e5 tempest-CreateVolumesFromImageTest-569648132 None] Lock "cinder-quobyte-f05792d2-7004-4af3-b7e3-f6269dad0750" released by "delete_volume" :: held 1.061s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 18:01:40 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-2376b8bd-b7c7-42c0-8f51-26d5646bc3e5 tempest-CreateVolumesFromImageTest-569648132 None] Created reservations ['09969047-8d31-4126-b179-364647240ce9', '27ee4c7e-64ed-4cdf-abb9-20888cb62bb7', '806aafc6-6289-4813-a6e2-1d85044c302a', '7d1b1aae-a6c4-4414-8d78-ccf4084d4a89'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 18:01:40 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-2376b8bd-b7c7-42c0-8f51-26d5646bc3e5 tempest-CreateVolumesFromImageTest-569648132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 18:01:40 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-2376b8bd-b7c7-42c0-8f51-26d5646bc3e5 tempest-CreateVolumesFromImageTest-569648132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 18:01:40 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-2376b8bd-b7c7-42c0-8f51-26d5646bc3e5 tempest-CreateVolumesFromImageTest-569648132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 18:01:40 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-2376b8bd-b7c7-42c0-8f51-26d5646bc3e5 tempest-CreateVolumesFromImageTest-569648132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 18:01:40 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-2376b8bd-b7c7-42c0-8f51-26d5646bc3e5 tempest-CreateVolumesFromImageTest-569648132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 18:01:40 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-2376b8bd-b7c7-42c0-8f51-26d5646bc3e5 tempest-CreateVolumesFromImageTest-569648132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:01:40 devstack sudo[90700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 Apr 22 18:01:40 devstack sudo[90700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:01:40 devstack sudo[90697]: pam_unix(sudo:session): session closed for user root Apr 22 18:01:40 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-467b0a8b-8e24-4660-a248-c521b2bf2a40 tempest-CreateVolumesFromSnapshotTest-540484731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-55ffe258-4252-4fe1-a9d0-5200bd52bc4d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-55ffe258-4252-4fe1-a9d0-5200bd52bc4d.6cd77635-8e8b-4129-be92-1fc6b569dc59 1G" returned: 0 in 0.624s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:01:40 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-467b0a8b-8e24-4660-a248-c521b2bf2a40 tempest-CreateVolumesFromSnapshotTest-540484731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55ffe258-4252-4fe1-a9d0-5200bd52bc4d -F qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-55ffe258-4252-4fe1-a9d0-5200bd52bc4d.6cd77635-8e8b-4129-be92-1fc6b569dc59 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:01:40 devstack sudo[90705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55ffe258-4252-4fe1-a9d0-5200bd52bc4d -F qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-55ffe258-4252-4fe1-a9d0-5200bd52bc4d.6cd77635-8e8b-4129-be92-1fc6b569dc59 Apr 22 18:01:40 devstack sudo[90705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:01:40 devstack sudo[90700]: pam_unix(sudo:session): session closed for user root Apr 22 18:01:40 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-2376b8bd-b7c7-42c0-8f51-26d5646bc3e5 tempest-CreateVolumesFromImageTest-569648132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33" returned: 0 in 0.499s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:01:40 devstack cinder-volume[81771]: DEBUG cinder.manager [None req-2376b8bd-b7c7-42c0-8f51-26d5646bc3e5 tempest-CreateVolumesFromImageTest-569648132 None] Notifying Schedulers of capabilities ... {{(pid=81771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 18:01:40 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-2376b8bd-b7c7-42c0-8f51-26d5646bc3e5 tempest-CreateVolumesFromImageTest-569648132 None] Deleted volume successfully. Apr 22 18:01:40 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-2376b8bd-b7c7-42c0-8f51-26d5646bc3e5 tempest-CreateVolumesFromImageTest-569648132 None] Lock "cinder-f05792d2-7004-4af3-b7e3-f6269dad0750-delete_volume" released by "delete_volume" :: held 1.774s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 18:01:40 devstack cinder-volume[81771]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6f2c112-9998-4696-a420-0564f665260d tempest-VolumeDependencyTests-158100058 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 18:01:40 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-b6f2c112-9998-4696-a420-0564f665260d tempest-VolumeDependencyTests-158100058 None] Flow 'volume_create_manager' (eeae1b20-7c77-495f-b990-1684b8f9db8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 18:01:40 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-b6f2c112-9998-4696-a420-0564f665260d tempest-VolumeDependencyTests-158100058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88563a3b-50df-453f-a06d-3b34a14da695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:01:40 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-b6f2c112-9998-4696-a420-0564f665260d tempest-VolumeDependencyTests-158100058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88563a3b-50df-453f-a06d-3b34a14da695) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T16:01:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-979371493',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6542b28f-52d6-43da-bee8-a7fa1b970636,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='536299bc187146e6aafa6018c45d2513',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T16:01:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=720c2c8e-73a4-4b98-8ffb-37cede92e24c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T16:01:41Z,use_quota=True,user_id='4f97ef6588be415596a71e15e94c99cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:01:40 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-b6f2c112-9998-4696-a420-0564f665260d tempest-VolumeDependencyTests-158100058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97024ebd-ac9b-45c7-86d6-2af81142b234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:01:40 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-b6f2c112-9998-4696-a420-0564f665260d tempest-VolumeDependencyTests-158100058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97024ebd-ac9b-45c7-86d6-2af81142b234) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:01:40 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-b6f2c112-9998-4696-a420-0564f665260d tempest-VolumeDependencyTests-158100058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5af838d9-6763-4cb0-bb58-65037ca99f2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:01:40 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-b6f2c112-9998-4696-a420-0564f665260d tempest-VolumeDependencyTests-158100058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5af838d9-6763-4cb0-bb58-65037ca99f2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6542b28f-52d6-43da-bee8-a7fa1b970636', 'volume_name': 'volume-6542b28f-52d6-43da-bee8-a7fa1b970636', 'volume_size': 1, 'snapshot_id': '720c2c8e-73a4-4b98-8ffb-37cede92e24c'}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:01:40 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-b6f2c112-9998-4696-a420-0564f665260d tempest-VolumeDependencyTests-158100058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (267b9a36-2cdd-4e13-a973-5215a3e28138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:01:40 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-b6f2c112-9998-4696-a420-0564f665260d tempest-VolumeDependencyTests-158100058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (267b9a36-2cdd-4e13-a973-5215a3e28138) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:01:40 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-b6f2c112-9998-4696-a420-0564f665260d tempest-VolumeDependencyTests-158100058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5a71cc5-e4ca-4dcf-bed5-81827f9729b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:01:40 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-b6f2c112-9998-4696-a420-0564f665260d tempest-VolumeDependencyTests-158100058 None] Volume 6542b28f-52d6-43da-bee8-a7fa1b970636: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6542b28f-52d6-43da-bee8-a7fa1b970636', 'volume_size': 1, 'snapshot_id': '720c2c8e-73a4-4b98-8ffb-37cede92e24c'} Apr 22 18:01:40 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-b6f2c112-9998-4696-a420-0564f665260d tempest-VolumeDependencyTests-158100058 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 18:01:40 devstack sudo[90705]: pam_unix(sudo:session): session closed for user root Apr 22 18:01:40 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-467b0a8b-8e24-4660-a248-c521b2bf2a40 tempest-CreateVolumesFromSnapshotTest-540484731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55ffe258-4252-4fe1-a9d0-5200bd52bc4d -F qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-55ffe258-4252-4fe1-a9d0-5200bd52bc4d.6cd77635-8e8b-4129-be92-1fc6b569dc59" returned: 0 in 0.577s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:01:40 devstack cinder-volume[81771]: WARNING cinder.volume.drivers.remotefs [None req-467b0a8b-8e24-4660-a248-c521b2bf2a40 tempest-CreateVolumesFromSnapshotTest-540484731 None] /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-55ffe258-4252-4fe1-a9d0-5200bd52bc4d.6cd77635-8e8b-4129-be92-1fc6b569dc59 is being set with open permissions: ugo+rw Apr 22 18:01:40 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-467b0a8b-8e24-4660-a248-c521b2bf2a40 tempest-CreateVolumesFromSnapshotTest-540484731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-55ffe258-4252-4fe1-a9d0-5200bd52bc4d.6cd77635-8e8b-4129-be92-1fc6b569dc59 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:01:40 devstack sudo[90711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-55ffe258-4252-4fe1-a9d0-5200bd52bc4d.6cd77635-8e8b-4129-be92-1fc6b569dc59 Apr 22 18:01:40 devstack sudo[90711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:01:41 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-597c0388-55bb-48c7-b967-afce57e5d2c8 tempest-CreateVolumesFromImageTest-569648132 None] Acquiring lock "cinder-8807a12f-8b83-464f-aec2-059b520ae1fc-delete_volume" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 18:01:41 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-597c0388-55bb-48c7-b967-afce57e5d2c8 tempest-CreateVolumesFromImageTest-569648132 None] Lock "cinder-8807a12f-8b83-464f-aec2-059b520ae1fc-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 18:01:41 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-597c0388-55bb-48c7-b967-afce57e5d2c8 tempest-CreateVolumesFromImageTest-569648132 None] Acquiring lock "cinder-quobyte-8807a12f-8b83-464f-aec2-059b520ae1fc" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 18:01:41 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-597c0388-55bb-48c7-b967-afce57e5d2c8 tempest-CreateVolumesFromImageTest-569648132 None] Lock "cinder-quobyte-8807a12f-8b83-464f-aec2-059b520ae1fc" acquired by "delete_volume" :: waited 0.017s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 18:01:41 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[f44f8274-0241-4dec-9f18-1f787a299e6f]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 18:01:41 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-597c0388-55bb-48c7-b967-afce57e5d2c8 tempest-CreateVolumesFromImageTest-569648132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-8807a12f-8b83-464f-aec2-059b520ae1fc {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:01:41 devstack sudo[90713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-8807a12f-8b83-464f-aec2-059b520ae1fc Apr 22 18:01:41 devstack sudo[90713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:01:41 devstack sudo[90711]: pam_unix(sudo:session): session closed for user root Apr 22 18:01:41 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-467b0a8b-8e24-4660-a248-c521b2bf2a40 tempest-CreateVolumesFromSnapshotTest-540484731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-55ffe258-4252-4fe1-a9d0-5200bd52bc4d.6cd77635-8e8b-4129-be92-1fc6b569dc59" returned: 0 in 0.459s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:01:41 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-467b0a8b-8e24-4660-a248-c521b2bf2a40 tempest-CreateVolumesFromSnapshotTest-540484731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-55ffe258-4252-4fe1-a9d0-5200bd52bc4d.info {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:01:41 devstack sudo[90716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-55ffe258-4252-4fe1-a9d0-5200bd52bc4d.info Apr 22 18:01:41 devstack sudo[90716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:01:41 devstack sudo[90713]: pam_unix(sudo:session): session closed for user root Apr 22 18:01:41 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-597c0388-55bb-48c7-b967-afce57e5d2c8 tempest-CreateVolumesFromImageTest-569648132 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-8807a12f-8b83-464f-aec2-059b520ae1fc" returned: 0 in 0.551s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:01:41 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-597c0388-55bb-48c7-b967-afce57e5d2c8 tempest-CreateVolumesFromImageTest-569648132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-8807a12f-8b83-464f-aec2-059b520ae1fc {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:01:41 devstack sudo[90721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-8807a12f-8b83-464f-aec2-059b520ae1fc Apr 22 18:01:41 devstack sudo[90721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:01:41 devstack sudo[90716]: pam_unix(sudo:session): session closed for user root Apr 22 18:01:41 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-467b0a8b-8e24-4660-a248-c521b2bf2a40 tempest-CreateVolumesFromSnapshotTest-540484731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-55ffe258-4252-4fe1-a9d0-5200bd52bc4d.info" returned: 0 in 0.479s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:01:41 devstack cinder-volume[81771]: WARNING cinder.volume.drivers.remotefs [None req-467b0a8b-8e24-4660-a248-c521b2bf2a40 tempest-CreateVolumesFromSnapshotTest-540484731 None] /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-55ffe258-4252-4fe1-a9d0-5200bd52bc4d.info is being set with open permissions: ugo+rw Apr 22 18:01:41 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-467b0a8b-8e24-4660-a248-c521b2bf2a40 tempest-CreateVolumesFromSnapshotTest-540484731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-55ffe258-4252-4fe1-a9d0-5200bd52bc4d.info {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:01:41 devstack sudo[90724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-55ffe258-4252-4fe1-a9d0-5200bd52bc4d.info Apr 22 18:01:41 devstack sudo[90724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:01:42 devstack sudo[90721]: pam_unix(sudo:session): session closed for user root Apr 22 18:01:42 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-597c0388-55bb-48c7-b967-afce57e5d2c8 tempest-CreateVolumesFromImageTest-569648132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-8807a12f-8b83-464f-aec2-059b520ae1fc" returned: 0 in 0.465s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:01:42 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-597c0388-55bb-48c7-b967-afce57e5d2c8 tempest-CreateVolumesFromImageTest-569648132 None] Lock "cinder-quobyte-8807a12f-8b83-464f-aec2-059b520ae1fc" released by "delete_volume" :: held 1.080s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 18:01:42 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-597c0388-55bb-48c7-b967-afce57e5d2c8 tempest-CreateVolumesFromImageTest-569648132 None] Created reservations ['aed4ed32-f170-4adb-b8b2-2d8d9886b162', '9cf8e20a-5ff7-46f2-9294-3d5d0d8bde27', '3a82e1ce-0d5c-4992-b7a7-1d76f451be00', '27f6be74-128c-4b2b-be8d-4a84b380c5d3'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 18:01:42 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-597c0388-55bb-48c7-b967-afce57e5d2c8 tempest-CreateVolumesFromImageTest-569648132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 18:01:42 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-597c0388-55bb-48c7-b967-afce57e5d2c8 tempest-CreateVolumesFromImageTest-569648132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 18:01:42 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-597c0388-55bb-48c7-b967-afce57e5d2c8 tempest-CreateVolumesFromImageTest-569648132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 18:01:42 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-597c0388-55bb-48c7-b967-afce57e5d2c8 tempest-CreateVolumesFromImageTest-569648132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 18:01:42 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-597c0388-55bb-48c7-b967-afce57e5d2c8 tempest-CreateVolumesFromImageTest-569648132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 18:01:42 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-597c0388-55bb-48c7-b967-afce57e5d2c8 tempest-CreateVolumesFromImageTest-569648132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:01:42 devstack sudo[90728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 Apr 22 18:01:42 devstack sudo[90728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:01:42 devstack sudo[90724]: pam_unix(sudo:session): session closed for user root Apr 22 18:01:42 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-467b0a8b-8e24-4660-a248-c521b2bf2a40 tempest-CreateVolumesFromSnapshotTest-540484731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-55ffe258-4252-4fe1-a9d0-5200bd52bc4d.info" returned: 0 in 0.485s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:01:42 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-467b0a8b-8e24-4660-a248-c521b2bf2a40 tempest-CreateVolumesFromSnapshotTest-540484731 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.272s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 18:01:42 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-031e1254-37d9-44d2-9250-553afdd7e801 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.050s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 18:01:42 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-031e1254-37d9-44d2-9250-553afdd7e801 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T16:01:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-666291396',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=006fbbb7-2b8a-4508-90ec-16b2a515007c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3ace5ef0e324f26a416db8aa339250a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T16:01:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T16:01:32Z,use_quota=True,user_id='7ca1e0b101e94628a5bab89043e2705b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)}" {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 18:01:42 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-031e1254-37d9-44d2-9250-553afdd7e801 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Creating volume 006fbbb7-2b8a-4508-90ec-16b2a515007c {{(pid=81771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 18:01:42 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-031e1254-37d9-44d2-9250-553afdd7e801 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 18:01:42 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-031e1254-37d9-44d2-9250-553afdd7e801 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 18:01:42 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-031e1254-37d9-44d2-9250-553afdd7e801 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 18:01:42 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-031e1254-37d9-44d2-9250-553afdd7e801 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 18:01:42 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-031e1254-37d9-44d2-9250-553afdd7e801 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 18:01:42 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-031e1254-37d9-44d2-9250-553afdd7e801 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Selected osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 as target Quobyte volume. {{(pid=81771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 18:01:42 devstack cinder-volume[81771]: INFO cinder.volume.drivers.remotefs [None req-031e1254-37d9-44d2-9250-553afdd7e801 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] casted to osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 Apr 22 18:01:42 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-031e1254-37d9-44d2-9250-553afdd7e801 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-006fbbb7-2b8a-4508-90ec-16b2a515007c 1073741824 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:01:42 devstack sudo[90730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-006fbbb7-2b8a-4508-90ec-16b2a515007c 1073741824 Apr 22 18:01:42 devstack sudo[90730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:01:42 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-467b0a8b-8e24-4660-a248-c521b2bf2a40 tempest-CreateVolumesFromSnapshotTest-540484731 None] Create snapshot completed successfully Apr 22 18:01:42 devstack sudo[90728]: pam_unix(sudo:session): session closed for user root Apr 22 18:01:42 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-597c0388-55bb-48c7-b967-afce57e5d2c8 tempest-CreateVolumesFromImageTest-569648132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33" returned: 0 in 0.487s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:01:42 devstack cinder-volume[81771]: DEBUG cinder.manager [None req-597c0388-55bb-48c7-b967-afce57e5d2c8 tempest-CreateVolumesFromImageTest-569648132 None] Notifying Schedulers of capabilities ... {{(pid=81771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 18:01:42 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-597c0388-55bb-48c7-b967-afce57e5d2c8 tempest-CreateVolumesFromImageTest-569648132 None] Deleted volume successfully. Apr 22 18:01:42 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-597c0388-55bb-48c7-b967-afce57e5d2c8 tempest-CreateVolumesFromImageTest-569648132 None] Lock "cinder-8807a12f-8b83-464f-aec2-059b520ae1fc-delete_volume" released by "delete_volume" :: held 1.814s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 18:01:43 devstack sudo[90730]: pam_unix(sudo:session): session closed for user root Apr 22 18:01:43 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-031e1254-37d9-44d2-9250-553afdd7e801 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-006fbbb7-2b8a-4508-90ec-16b2a515007c 1073741824" returned: 0 in 0.683s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:01:43 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-031e1254-37d9-44d2-9250-553afdd7e801 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-006fbbb7-2b8a-4508-90ec-16b2a515007c {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:01:43 devstack sudo[90736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-006fbbb7-2b8a-4508-90ec-16b2a515007c Apr 22 18:01:43 devstack sudo[90736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:01:43 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-a5fc8719-54f2-43ca-ad58-434ef966f7ad tempest-CreateVolumesFromImageTest-569648132 None] Acquiring lock "cinder-b59b7459-24ba-4b27-bb60-e150169a41a8-delete_volume" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 18:01:43 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-a5fc8719-54f2-43ca-ad58-434ef966f7ad tempest-CreateVolumesFromImageTest-569648132 None] Lock "cinder-b59b7459-24ba-4b27-bb60-e150169a41a8-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 18:01:43 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-a5fc8719-54f2-43ca-ad58-434ef966f7ad tempest-CreateVolumesFromImageTest-569648132 None] Acquiring lock "cinder-quobyte-b59b7459-24ba-4b27-bb60-e150169a41a8" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 18:01:43 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-a5fc8719-54f2-43ca-ad58-434ef966f7ad tempest-CreateVolumesFromImageTest-569648132 None] Lock "cinder-quobyte-b59b7459-24ba-4b27-bb60-e150169a41a8" acquired by "delete_volume" :: waited 0.021s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 18:01:43 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[e12ce2a8-d37e-44d3-87c3-2b4612e2aa17]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 18:01:43 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-a5fc8719-54f2-43ca-ad58-434ef966f7ad tempest-CreateVolumesFromImageTest-569648132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b59b7459-24ba-4b27-bb60-e150169a41a8 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:01:43 devstack sudo[90738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b59b7459-24ba-4b27-bb60-e150169a41a8 Apr 22 18:01:43 devstack sudo[90738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:01:43 devstack sudo[90736]: pam_unix(sudo:session): session closed for user root Apr 22 18:01:43 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-031e1254-37d9-44d2-9250-553afdd7e801 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-006fbbb7-2b8a-4508-90ec-16b2a515007c" returned: 0 in 0.504s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:01:43 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-031e1254-37d9-44d2-9250-553afdd7e801 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] <== create_volume: return (1232ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'} {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 18:01:43 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-031e1254-37d9-44d2-9250-553afdd7e801 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.235s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 18:01:43 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-efce5a4a-dec8-4b99-ad9a-8900d1efdae5 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 18:01:43 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-efce5a4a-dec8-4b99-ad9a-8900d1efdae5 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T16:01:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-133949857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f0ae989-4db5-433f-8050-b471b212e992,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3ace5ef0e324f26a416db8aa339250a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T16:01:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T16:01:33Z,use_quota=True,user_id='7ca1e0b101e94628a5bab89043e2705b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)}" {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 18:01:43 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-efce5a4a-dec8-4b99-ad9a-8900d1efdae5 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Creating volume 7f0ae989-4db5-433f-8050-b471b212e992 {{(pid=81771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 18:01:43 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-efce5a4a-dec8-4b99-ad9a-8900d1efdae5 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 18:01:43 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-efce5a4a-dec8-4b99-ad9a-8900d1efdae5 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 18:01:43 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-efce5a4a-dec8-4b99-ad9a-8900d1efdae5 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 18:01:43 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-efce5a4a-dec8-4b99-ad9a-8900d1efdae5 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 18:01:43 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-efce5a4a-dec8-4b99-ad9a-8900d1efdae5 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 18:01:43 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-efce5a4a-dec8-4b99-ad9a-8900d1efdae5 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Selected osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 as target Quobyte volume. {{(pid=81771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 18:01:43 devstack cinder-volume[81771]: INFO cinder.volume.drivers.remotefs [None req-efce5a4a-dec8-4b99-ad9a-8900d1efdae5 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] casted to osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 Apr 22 18:01:43 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-efce5a4a-dec8-4b99-ad9a-8900d1efdae5 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7f0ae989-4db5-433f-8050-b471b212e992 1073741824 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:01:43 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-031e1254-37d9-44d2-9250-553afdd7e801 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af3065d8-8317-4389-a887-cfa6588efa5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-006fbbb7-2b8a-4508-90ec-16b2a515007c', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:01:43 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-031e1254-37d9-44d2-9250-553afdd7e801 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f88e2e3-23af-4b66-8ee7-cc03c86a13df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:01:43 devstack sudo[90743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7f0ae989-4db5-433f-8050-b471b212e992 1073741824 Apr 22 18:01:43 devstack sudo[90743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:01:43 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-031e1254-37d9-44d2-9250-553afdd7e801 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Volume volume-006fbbb7-2b8a-4508-90ec-16b2a515007c (006fbbb7-2b8a-4508-90ec-16b2a515007c): created successfully Apr 22 18:01:43 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-031e1254-37d9-44d2-9250-553afdd7e801 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f88e2e3-23af-4b66-8ee7-cc03c86a13df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:01:43 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-031e1254-37d9-44d2-9250-553afdd7e801 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Flow 'volume_create_manager' (ed53ace2-566d-4552-99d1-9cc24974f774) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 18:01:43 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-031e1254-37d9-44d2-9250-553afdd7e801 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Created volume successfully. Apr 22 18:01:43 devstack cinder-volume[81771]: DEBUG cinder.volume.flows.manager.create_volume [None req-f65f12d8-6f6e-4bba-8dc7-e37deb88d37b tempest-CreateVolumesFromSnapshotTest-540484731 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 18:01:43 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-f65f12d8-6f6e-4bba-8dc7-e37deb88d37b tempest-CreateVolumesFromSnapshotTest-540484731 None] Flow 'volume_create_manager' (312ae070-6c36-459e-b5bc-ef053b625018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 18:01:43 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-f65f12d8-6f6e-4bba-8dc7-e37deb88d37b tempest-CreateVolumesFromSnapshotTest-540484731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df9ff714-d805-459e-a002-9cd0fb467c0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:01:43 devstack sudo[90738]: pam_unix(sudo:session): session closed for user root Apr 22 18:01:44 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-a5fc8719-54f2-43ca-ad58-434ef966f7ad tempest-CreateVolumesFromImageTest-569648132 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b59b7459-24ba-4b27-bb60-e150169a41a8" returned: 0 in 0.640s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:01:44 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-a5fc8719-54f2-43ca-ad58-434ef966f7ad tempest-CreateVolumesFromImageTest-569648132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b59b7459-24ba-4b27-bb60-e150169a41a8 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:01:44 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-f65f12d8-6f6e-4bba-8dc7-e37deb88d37b tempest-CreateVolumesFromSnapshotTest-540484731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df9ff714-d805-459e-a002-9cd0fb467c0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T16:01:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1384314569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea9ae10c-fbda-4c40-8431-f2b3bd91bc49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ad058daf3dd47faa77e8d9cfd2b7b9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T16:01:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T16:01:44Z,use_quota=True,user_id='6cf81a539f0d43779bb0d619864d130a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:01:44 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-f65f12d8-6f6e-4bba-8dc7-e37deb88d37b tempest-CreateVolumesFromSnapshotTest-540484731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e8ce5c2-85ac-4da6-8b29-bef097ef6391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:01:44 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-f65f12d8-6f6e-4bba-8dc7-e37deb88d37b tempest-CreateVolumesFromSnapshotTest-540484731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e8ce5c2-85ac-4da6-8b29-bef097ef6391) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:01:44 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-f65f12d8-6f6e-4bba-8dc7-e37deb88d37b tempest-CreateVolumesFromSnapshotTest-540484731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6eea7ad4-19ef-45a4-b6df-152912395a75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:01:44 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-f65f12d8-6f6e-4bba-8dc7-e37deb88d37b tempest-CreateVolumesFromSnapshotTest-540484731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6eea7ad4-19ef-45a4-b6df-152912395a75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea9ae10c-fbda-4c40-8431-f2b3bd91bc49', 'volume_name': 'volume-ea9ae10c-fbda-4c40-8431-f2b3bd91bc49', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:01:44 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-f65f12d8-6f6e-4bba-8dc7-e37deb88d37b tempest-CreateVolumesFromSnapshotTest-540484731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5d4227b-bce2-40e1-8e01-15f96fd40f92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:01:44 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-f65f12d8-6f6e-4bba-8dc7-e37deb88d37b tempest-CreateVolumesFromSnapshotTest-540484731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5d4227b-bce2-40e1-8e01-15f96fd40f92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:01:44 devstack sudo[90748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b59b7459-24ba-4b27-bb60-e150169a41a8 Apr 22 18:01:44 devstack sudo[90748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:01:44 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-f65f12d8-6f6e-4bba-8dc7-e37deb88d37b tempest-CreateVolumesFromSnapshotTest-540484731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07d1ba88-ce56-47fb-b1bb-8fb594d278bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:01:44 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-f65f12d8-6f6e-4bba-8dc7-e37deb88d37b tempest-CreateVolumesFromSnapshotTest-540484731 None] Volume ea9ae10c-fbda-4c40-8431-f2b3bd91bc49: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea9ae10c-fbda-4c40-8431-f2b3bd91bc49', 'volume_size': 1} Apr 22 18:01:44 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-f65f12d8-6f6e-4bba-8dc7-e37deb88d37b tempest-CreateVolumesFromSnapshotTest-540484731 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 18:01:44 devstack cinder-volume[81771]: DEBUG cinder.volume.flows.manager.create_volume [None req-f69ef7e0-12af-4c51-a718-4a4908e7d0dd tempest-CreateVolumesFromSnapshotTest-540484731 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 18:01:44 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-f69ef7e0-12af-4c51-a718-4a4908e7d0dd tempest-CreateVolumesFromSnapshotTest-540484731 None] Flow 'volume_create_manager' (267b71db-6604-4953-a7b2-947668b32305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 18:01:44 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-f69ef7e0-12af-4c51-a718-4a4908e7d0dd tempest-CreateVolumesFromSnapshotTest-540484731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdb19be0-5227-4ac8-90d2-98ae69c05067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:01:44 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-f69ef7e0-12af-4c51-a718-4a4908e7d0dd tempest-CreateVolumesFromSnapshotTest-540484731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdb19be0-5227-4ac8-90d2-98ae69c05067) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T16:01:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1847807120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e25fcc7-6d9d-4f6c-b3e0-45fe8898750c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ad058daf3dd47faa77e8d9cfd2b7b9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T16:01:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T16:01:44Z,use_quota=True,user_id='6cf81a539f0d43779bb0d619864d130a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:01:44 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-f69ef7e0-12af-4c51-a718-4a4908e7d0dd tempest-CreateVolumesFromSnapshotTest-540484731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee9c93db-613d-46e3-92fc-5d595ddbcd05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:01:44 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-f69ef7e0-12af-4c51-a718-4a4908e7d0dd tempest-CreateVolumesFromSnapshotTest-540484731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee9c93db-613d-46e3-92fc-5d595ddbcd05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:01:44 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-f69ef7e0-12af-4c51-a718-4a4908e7d0dd tempest-CreateVolumesFromSnapshotTest-540484731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df12800f-0aa2-4f37-a161-4ee42b174733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:01:44 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-f69ef7e0-12af-4c51-a718-4a4908e7d0dd tempest-CreateVolumesFromSnapshotTest-540484731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df12800f-0aa2-4f37-a161-4ee42b174733) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e25fcc7-6d9d-4f6c-b3e0-45fe8898750c', 'volume_name': 'volume-1e25fcc7-6d9d-4f6c-b3e0-45fe8898750c', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:01:44 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-f69ef7e0-12af-4c51-a718-4a4908e7d0dd tempest-CreateVolumesFromSnapshotTest-540484731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0541ddf0-f355-463e-9821-30aa2ab3d080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:01:44 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-f69ef7e0-12af-4c51-a718-4a4908e7d0dd tempest-CreateVolumesFromSnapshotTest-540484731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0541ddf0-f355-463e-9821-30aa2ab3d080) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:01:44 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-f69ef7e0-12af-4c51-a718-4a4908e7d0dd tempest-CreateVolumesFromSnapshotTest-540484731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f868fa31-0bc6-4403-b4cf-28ffd69dc11a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:01:44 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-f69ef7e0-12af-4c51-a718-4a4908e7d0dd tempest-CreateVolumesFromSnapshotTest-540484731 None] Volume 1e25fcc7-6d9d-4f6c-b3e0-45fe8898750c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e25fcc7-6d9d-4f6c-b3e0-45fe8898750c', 'volume_size': 1} Apr 22 18:01:44 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-f69ef7e0-12af-4c51-a718-4a4908e7d0dd tempest-CreateVolumesFromSnapshotTest-540484731 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 18:01:44 devstack sudo[90743]: pam_unix(sudo:session): session closed for user root Apr 22 18:01:44 devstack cinder-volume[81771]: DEBUG cinder.volume.flows.manager.create_volume [None req-85f8680d-e727-4b2a-8428-3e65a05e858a tempest-CreateVolumesFromSnapshotTest-540484731 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 18:01:44 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-85f8680d-e727-4b2a-8428-3e65a05e858a tempest-CreateVolumesFromSnapshotTest-540484731 None] Flow 'volume_create_manager' (22cedc59-2198-4a6b-b3d5-a68969f270be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 18:01:44 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-85f8680d-e727-4b2a-8428-3e65a05e858a tempest-CreateVolumesFromSnapshotTest-540484731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1607cef1-c91d-4993-a9b1-0ffb84a3ec86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:01:44 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-efce5a4a-dec8-4b99-ad9a-8900d1efdae5 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7f0ae989-4db5-433f-8050-b471b212e992 1073741824" returned: 0 in 0.904s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:01:44 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-85f8680d-e727-4b2a-8428-3e65a05e858a tempest-CreateVolumesFromSnapshotTest-540484731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1607cef1-c91d-4993-a9b1-0ffb84a3ec86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T16:01:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2006799664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1f6d355-8b4f-4922-bcbc-f9c26a0f5b64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ad058daf3dd47faa77e8d9cfd2b7b9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T16:01:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T16:01:44Z,use_quota=True,user_id='6cf81a539f0d43779bb0d619864d130a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:01:44 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-85f8680d-e727-4b2a-8428-3e65a05e858a tempest-CreateVolumesFromSnapshotTest-540484731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0399210-5197-4959-8a97-8a76a474c1ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:01:44 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-85f8680d-e727-4b2a-8428-3e65a05e858a tempest-CreateVolumesFromSnapshotTest-540484731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0399210-5197-4959-8a97-8a76a474c1ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:01:44 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-85f8680d-e727-4b2a-8428-3e65a05e858a tempest-CreateVolumesFromSnapshotTest-540484731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d879cd63-6546-40e9-9c0d-b8bcb4e4fc9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:01:44 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-85f8680d-e727-4b2a-8428-3e65a05e858a tempest-CreateVolumesFromSnapshotTest-540484731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d879cd63-6546-40e9-9c0d-b8bcb4e4fc9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1f6d355-8b4f-4922-bcbc-f9c26a0f5b64', 'volume_name': 'volume-d1f6d355-8b4f-4922-bcbc-f9c26a0f5b64', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:01:44 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-85f8680d-e727-4b2a-8428-3e65a05e858a tempest-CreateVolumesFromSnapshotTest-540484731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df3ab1c7-cabc-4979-871d-5f141da93486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:01:44 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-85f8680d-e727-4b2a-8428-3e65a05e858a tempest-CreateVolumesFromSnapshotTest-540484731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df3ab1c7-cabc-4979-871d-5f141da93486) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:01:44 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-85f8680d-e727-4b2a-8428-3e65a05e858a tempest-CreateVolumesFromSnapshotTest-540484731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af556fa9-768f-4cf7-b7b0-1a955b8680c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:01:44 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-85f8680d-e727-4b2a-8428-3e65a05e858a tempest-CreateVolumesFromSnapshotTest-540484731 None] Volume d1f6d355-8b4f-4922-bcbc-f9c26a0f5b64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1f6d355-8b4f-4922-bcbc-f9c26a0f5b64', 'volume_size': 1} Apr 22 18:01:44 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-85f8680d-e727-4b2a-8428-3e65a05e858a tempest-CreateVolumesFromSnapshotTest-540484731 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 18:01:44 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-efce5a4a-dec8-4b99-ad9a-8900d1efdae5 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7f0ae989-4db5-433f-8050-b471b212e992 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:01:44 devstack sudo[90754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7f0ae989-4db5-433f-8050-b471b212e992 Apr 22 18:01:44 devstack sudo[90754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:01:44 devstack sudo[90748]: pam_unix(sudo:session): session closed for user root Apr 22 18:01:44 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-a5fc8719-54f2-43ca-ad58-434ef966f7ad tempest-CreateVolumesFromImageTest-569648132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b59b7459-24ba-4b27-bb60-e150169a41a8" returned: 0 in 0.667s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:01:44 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-a5fc8719-54f2-43ca-ad58-434ef966f7ad tempest-CreateVolumesFromImageTest-569648132 None] Lock "cinder-quobyte-b59b7459-24ba-4b27-bb60-e150169a41a8" released by "delete_volume" :: held 1.351s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 18:01:44 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-a5fc8719-54f2-43ca-ad58-434ef966f7ad tempest-CreateVolumesFromImageTest-569648132 None] Created reservations ['fa0d412b-d63a-43f0-be1e-621dbc03b298', 'e4761013-3a27-4269-823b-0536265ea2c7', 'd546d357-a096-424f-bdeb-33054424f164', '83497f58-65e9-4ec0-9865-1e0dcac0e0d9'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 18:01:44 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-a5fc8719-54f2-43ca-ad58-434ef966f7ad tempest-CreateVolumesFromImageTest-569648132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 18:01:44 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-a5fc8719-54f2-43ca-ad58-434ef966f7ad tempest-CreateVolumesFromImageTest-569648132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 18:01:44 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-a5fc8719-54f2-43ca-ad58-434ef966f7ad tempest-CreateVolumesFromImageTest-569648132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 18:01:44 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-a5fc8719-54f2-43ca-ad58-434ef966f7ad tempest-CreateVolumesFromImageTest-569648132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 18:01:44 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-a5fc8719-54f2-43ca-ad58-434ef966f7ad tempest-CreateVolumesFromImageTest-569648132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 18:01:44 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-a5fc8719-54f2-43ca-ad58-434ef966f7ad tempest-CreateVolumesFromImageTest-569648132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:01:44 devstack cinder-volume[81771]: DEBUG cinder.volume.flows.manager.create_volume [None req-6dae16bc-0378-4235-b625-00186b4fb2d5 tempest-CreateVolumesFromSnapshotTest-540484731 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 18:01:44 devstack sudo[90756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 Apr 22 18:01:44 devstack sudo[90756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:01:44 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-6dae16bc-0378-4235-b625-00186b4fb2d5 tempest-CreateVolumesFromSnapshotTest-540484731 None] Flow 'volume_create_manager' (d2d6901f-7a4a-4fd6-b936-c5bd7175e8cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 18:01:44 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-6dae16bc-0378-4235-b625-00186b4fb2d5 tempest-CreateVolumesFromSnapshotTest-540484731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (025ff835-62cb-4ecc-bd06-012bef44c090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:01:44 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-6dae16bc-0378-4235-b625-00186b4fb2d5 tempest-CreateVolumesFromSnapshotTest-540484731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (025ff835-62cb-4ecc-bd06-012bef44c090) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T16:01:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1395117312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0ab3d45-e3ae-4a47-a39e-a50f6ac7e9ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ad058daf3dd47faa77e8d9cfd2b7b9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T16:01:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T16:01:45Z,use_quota=True,user_id='6cf81a539f0d43779bb0d619864d130a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:01:44 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-6dae16bc-0378-4235-b625-00186b4fb2d5 tempest-CreateVolumesFromSnapshotTest-540484731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2537a4ef-482b-4225-828d-6c4434833cf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:01:44 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-6dae16bc-0378-4235-b625-00186b4fb2d5 tempest-CreateVolumesFromSnapshotTest-540484731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2537a4ef-482b-4225-828d-6c4434833cf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:01:44 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-6dae16bc-0378-4235-b625-00186b4fb2d5 tempest-CreateVolumesFromSnapshotTest-540484731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06c795de-99f2-4dd2-9731-c1d3928ef4ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:01:44 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-6dae16bc-0378-4235-b625-00186b4fb2d5 tempest-CreateVolumesFromSnapshotTest-540484731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06c795de-99f2-4dd2-9731-c1d3928ef4ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0ab3d45-e3ae-4a47-a39e-a50f6ac7e9ee', 'volume_name': 'volume-b0ab3d45-e3ae-4a47-a39e-a50f6ac7e9ee', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:01:44 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-6dae16bc-0378-4235-b625-00186b4fb2d5 tempest-CreateVolumesFromSnapshotTest-540484731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7734b0bb-9fee-4f03-a7f3-bb155fc268d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:01:44 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-6dae16bc-0378-4235-b625-00186b4fb2d5 tempest-CreateVolumesFromSnapshotTest-540484731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7734b0bb-9fee-4f03-a7f3-bb155fc268d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:01:44 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-6dae16bc-0378-4235-b625-00186b4fb2d5 tempest-CreateVolumesFromSnapshotTest-540484731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56e6ac99-8695-4ac6-9f9f-85bfb3db0ff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:01:44 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-6dae16bc-0378-4235-b625-00186b4fb2d5 tempest-CreateVolumesFromSnapshotTest-540484731 None] Volume b0ab3d45-e3ae-4a47-a39e-a50f6ac7e9ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0ab3d45-e3ae-4a47-a39e-a50f6ac7e9ee', 'volume_size': 1} Apr 22 18:01:44 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-6dae16bc-0378-4235-b625-00186b4fb2d5 tempest-CreateVolumesFromSnapshotTest-540484731 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 18:01:45 devstack cinder-volume[81771]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a277f8e-99d3-496a-9451-f7b917c82d37 tempest-CreateVolumesFromSnapshotTest-540484731 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 18:01:45 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-7a277f8e-99d3-496a-9451-f7b917c82d37 tempest-CreateVolumesFromSnapshotTest-540484731 None] Flow 'volume_create_manager' (1ed9b341-386e-4778-bf30-20d95d6e835a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 18:01:45 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-7a277f8e-99d3-496a-9451-f7b917c82d37 tempest-CreateVolumesFromSnapshotTest-540484731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a66a9348-5b0b-44fd-b4d0-60d3650b9914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:01:45 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-7a277f8e-99d3-496a-9451-f7b917c82d37 tempest-CreateVolumesFromSnapshotTest-540484731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a66a9348-5b0b-44fd-b4d0-60d3650b9914) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T16:01:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2015773355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c9f6a25-8568-4c1c-abec-4d2054d11971,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ad058daf3dd47faa77e8d9cfd2b7b9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T16:01:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T16:01:45Z,use_quota=True,user_id='6cf81a539f0d43779bb0d619864d130a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:01:45 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-7a277f8e-99d3-496a-9451-f7b917c82d37 tempest-CreateVolumesFromSnapshotTest-540484731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c63f238-b233-4b73-9496-013d9fdbc5a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:01:45 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-7a277f8e-99d3-496a-9451-f7b917c82d37 tempest-CreateVolumesFromSnapshotTest-540484731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c63f238-b233-4b73-9496-013d9fdbc5a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:01:45 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-7a277f8e-99d3-496a-9451-f7b917c82d37 tempest-CreateVolumesFromSnapshotTest-540484731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b17aa11-f78d-4222-933a-d7e714de35e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:01:45 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-7a277f8e-99d3-496a-9451-f7b917c82d37 tempest-CreateVolumesFromSnapshotTest-540484731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b17aa11-f78d-4222-933a-d7e714de35e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c9f6a25-8568-4c1c-abec-4d2054d11971', 'volume_name': 'volume-5c9f6a25-8568-4c1c-abec-4d2054d11971', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:01:45 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-7a277f8e-99d3-496a-9451-f7b917c82d37 tempest-CreateVolumesFromSnapshotTest-540484731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b0e4768-2e25-4275-95ae-33f702fdd985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:01:45 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-7a277f8e-99d3-496a-9451-f7b917c82d37 tempest-CreateVolumesFromSnapshotTest-540484731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b0e4768-2e25-4275-95ae-33f702fdd985) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:01:45 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-7a277f8e-99d3-496a-9451-f7b917c82d37 tempest-CreateVolumesFromSnapshotTest-540484731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65fe9af8-43ba-4666-b738-0e7406848144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:01:45 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-7a277f8e-99d3-496a-9451-f7b917c82d37 tempest-CreateVolumesFromSnapshotTest-540484731 None] Volume 5c9f6a25-8568-4c1c-abec-4d2054d11971: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c9f6a25-8568-4c1c-abec-4d2054d11971', 'volume_size': 1} Apr 22 18:01:45 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-7a277f8e-99d3-496a-9451-f7b917c82d37 tempest-CreateVolumesFromSnapshotTest-540484731 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 18:01:45 devstack sudo[90754]: pam_unix(sudo:session): session closed for user root Apr 22 18:01:45 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-efce5a4a-dec8-4b99-ad9a-8900d1efdae5 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7f0ae989-4db5-433f-8050-b471b212e992" returned: 0 in 0.557s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:01:45 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-efce5a4a-dec8-4b99-ad9a-8900d1efdae5 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] <== create_volume: return (1540ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'} {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 18:01:45 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-efce5a4a-dec8-4b99-ad9a-8900d1efdae5 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.543s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 18:01:45 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-2e498327-668a-424e-838c-13e1b89c6a27 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.274s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 18:01:45 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-2e498327-668a-424e-838c-13e1b89c6a27 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T16:01:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-160235006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92b992fc-e7be-425d-aa6b-9439469b00ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3ace5ef0e324f26a416db8aa339250a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T16:01:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T16:01:33Z,use_quota=True,user_id='7ca1e0b101e94628a5bab89043e2705b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)}" {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 18:01:45 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-2e498327-668a-424e-838c-13e1b89c6a27 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Creating volume 92b992fc-e7be-425d-aa6b-9439469b00ac {{(pid=81771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 18:01:45 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-2e498327-668a-424e-838c-13e1b89c6a27 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 18:01:45 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-2e498327-668a-424e-838c-13e1b89c6a27 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 18:01:45 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-2e498327-668a-424e-838c-13e1b89c6a27 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 18:01:45 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-2e498327-668a-424e-838c-13e1b89c6a27 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 18:01:45 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-2e498327-668a-424e-838c-13e1b89c6a27 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 18:01:45 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-2e498327-668a-424e-838c-13e1b89c6a27 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Selected osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 as target Quobyte volume. {{(pid=81771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 18:01:45 devstack cinder-volume[81771]: INFO cinder.volume.drivers.remotefs [None req-2e498327-668a-424e-838c-13e1b89c6a27 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] casted to osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 Apr 22 18:01:45 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-2e498327-668a-424e-838c-13e1b89c6a27 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-92b992fc-e7be-425d-aa6b-9439469b00ac 1073741824 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:01:45 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-efce5a4a-dec8-4b99-ad9a-8900d1efdae5 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af8a6c3c-996c-44ce-b2b3-824a2cc3d159) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f0ae989-4db5-433f-8050-b471b212e992', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:01:45 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-efce5a4a-dec8-4b99-ad9a-8900d1efdae5 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c80caf6f-a96c-40c3-b231-97dcd1f7db3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:01:45 devstack sudo[90759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-92b992fc-e7be-425d-aa6b-9439469b00ac 1073741824 Apr 22 18:01:45 devstack sudo[90759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:01:45 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-efce5a4a-dec8-4b99-ad9a-8900d1efdae5 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Volume volume-7f0ae989-4db5-433f-8050-b471b212e992 (7f0ae989-4db5-433f-8050-b471b212e992): created successfully Apr 22 18:01:45 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-efce5a4a-dec8-4b99-ad9a-8900d1efdae5 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c80caf6f-a96c-40c3-b231-97dcd1f7db3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:01:45 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-efce5a4a-dec8-4b99-ad9a-8900d1efdae5 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Flow 'volume_create_manager' (ec656864-1c70-4cd9-9fb1-addae2525f9b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 18:01:45 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-efce5a4a-dec8-4b99-ad9a-8900d1efdae5 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Created volume successfully. Apr 22 18:01:45 devstack sudo[90756]: pam_unix(sudo:session): session closed for user root Apr 22 18:01:45 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-a5fc8719-54f2-43ca-ad58-434ef966f7ad tempest-CreateVolumesFromImageTest-569648132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33" returned: 0 in 0.523s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:01:45 devstack cinder-volume[81771]: DEBUG cinder.manager [None req-a5fc8719-54f2-43ca-ad58-434ef966f7ad tempest-CreateVolumesFromImageTest-569648132 None] Notifying Schedulers of capabilities ... {{(pid=81771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 18:01:45 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-a5fc8719-54f2-43ca-ad58-434ef966f7ad tempest-CreateVolumesFromImageTest-569648132 None] Deleted volume successfully. Apr 22 18:01:45 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-a5fc8719-54f2-43ca-ad58-434ef966f7ad tempest-CreateVolumesFromImageTest-569648132 None] Lock "cinder-b59b7459-24ba-4b27-bb60-e150169a41a8-delete_volume" released by "delete_volume" :: held 2.146s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 18:01:45 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-699071de-73a0-4a4c-bec7-ad5a3d739b00 tempest-CreateVolumesFromImageTest-569648132 None] Acquiring lock "cinder-2d35ccc2-3ecd-4dac-845a-d2918866c299-delete_volume" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 18:01:45 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-699071de-73a0-4a4c-bec7-ad5a3d739b00 tempest-CreateVolumesFromImageTest-569648132 None] Lock "cinder-2d35ccc2-3ecd-4dac-845a-d2918866c299-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 18:01:45 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-699071de-73a0-4a4c-bec7-ad5a3d739b00 tempest-CreateVolumesFromImageTest-569648132 None] Acquiring lock "cinder-quobyte-2d35ccc2-3ecd-4dac-845a-d2918866c299" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 18:01:45 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-699071de-73a0-4a4c-bec7-ad5a3d739b00 tempest-CreateVolumesFromImageTest-569648132 None] Lock "cinder-quobyte-2d35ccc2-3ecd-4dac-845a-d2918866c299" acquired by "delete_volume" :: waited 0.017s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 18:01:45 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[bff47712-4742-42b9-9899-3f207fc068d2]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 18:01:45 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-699071de-73a0-4a4c-bec7-ad5a3d739b00 tempest-CreateVolumesFromImageTest-569648132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-2d35ccc2-3ecd-4dac-845a-d2918866c299 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:01:45 devstack sudo[90762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-2d35ccc2-3ecd-4dac-845a-d2918866c299 Apr 22 18:01:45 devstack sudo[90762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:01:45 devstack sudo[90759]: pam_unix(sudo:session): session closed for user root Apr 22 18:01:45 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-2e498327-668a-424e-838c-13e1b89c6a27 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-92b992fc-e7be-425d-aa6b-9439469b00ac 1073741824" returned: 0 in 0.633s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:01:45 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-2e498327-668a-424e-838c-13e1b89c6a27 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-92b992fc-e7be-425d-aa6b-9439469b00ac {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:01:45 devstack sudo[90767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-92b992fc-e7be-425d-aa6b-9439469b00ac Apr 22 18:01:45 devstack sudo[90767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:01:46 devstack sudo[90762]: pam_unix(sudo:session): session closed for user root Apr 22 18:01:46 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-699071de-73a0-4a4c-bec7-ad5a3d739b00 tempest-CreateVolumesFromImageTest-569648132 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-2d35ccc2-3ecd-4dac-845a-d2918866c299" returned: 0 in 0.606s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:01:46 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-699071de-73a0-4a4c-bec7-ad5a3d739b00 tempest-CreateVolumesFromImageTest-569648132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-2d35ccc2-3ecd-4dac-845a-d2918866c299 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:01:46 devstack sudo[90772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-2d35ccc2-3ecd-4dac-845a-d2918866c299 Apr 22 18:01:46 devstack sudo[90772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:01:46 devstack sudo[90767]: pam_unix(sudo:session): session closed for user root Apr 22 18:01:46 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-2e498327-668a-424e-838c-13e1b89c6a27 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-92b992fc-e7be-425d-aa6b-9439469b00ac" returned: 0 in 0.493s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:01:46 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-2e498327-668a-424e-838c-13e1b89c6a27 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] <== create_volume: return (1171ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'} {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 18:01:46 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-2e498327-668a-424e-838c-13e1b89c6a27 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.175s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 18:01:46 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-9c26e9c0-847a-4f7f-84ad-1489b0668851 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.093s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 18:01:46 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-9c26e9c0-847a-4f7f-84ad-1489b0668851 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T16:01:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1967112556',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8019d1d3-1406-4f8d-8c82-6256a9fd32fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3ace5ef0e324f26a416db8aa339250a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T16:01:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T16:01:33Z,use_quota=True,user_id='7ca1e0b101e94628a5bab89043e2705b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)}" {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 18:01:46 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-9c26e9c0-847a-4f7f-84ad-1489b0668851 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Creating volume 8019d1d3-1406-4f8d-8c82-6256a9fd32fd {{(pid=81771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 18:01:46 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-9c26e9c0-847a-4f7f-84ad-1489b0668851 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 18:01:46 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-9c26e9c0-847a-4f7f-84ad-1489b0668851 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 18:01:46 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-9c26e9c0-847a-4f7f-84ad-1489b0668851 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 18:01:46 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-9c26e9c0-847a-4f7f-84ad-1489b0668851 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 18:01:46 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-9c26e9c0-847a-4f7f-84ad-1489b0668851 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 18:01:46 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-9c26e9c0-847a-4f7f-84ad-1489b0668851 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Selected osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 as target Quobyte volume. {{(pid=81771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 18:01:46 devstack cinder-volume[81771]: INFO cinder.volume.drivers.remotefs [None req-9c26e9c0-847a-4f7f-84ad-1489b0668851 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] casted to osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 Apr 22 18:01:46 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-9c26e9c0-847a-4f7f-84ad-1489b0668851 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-8019d1d3-1406-4f8d-8c82-6256a9fd32fd 1073741824 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:01:46 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-2e498327-668a-424e-838c-13e1b89c6a27 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3936be1e-9eb5-434a-8b08-9e2c7858ff34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92b992fc-e7be-425d-aa6b-9439469b00ac', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:01:46 devstack sudo[90775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-8019d1d3-1406-4f8d-8c82-6256a9fd32fd 1073741824 Apr 22 18:01:46 devstack sudo[90775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:01:46 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-2e498327-668a-424e-838c-13e1b89c6a27 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7dd2d1cf-c5e4-403d-a10a-296e6e789748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:01:46 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-2e498327-668a-424e-838c-13e1b89c6a27 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Volume volume-92b992fc-e7be-425d-aa6b-9439469b00ac (92b992fc-e7be-425d-aa6b-9439469b00ac): created successfully Apr 22 18:01:46 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-2e498327-668a-424e-838c-13e1b89c6a27 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7dd2d1cf-c5e4-403d-a10a-296e6e789748) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:01:46 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-2e498327-668a-424e-838c-13e1b89c6a27 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Flow 'volume_create_manager' (fb1b0259-8e1e-4e99-bfee-f79a57c281c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 18:01:46 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-2e498327-668a-424e-838c-13e1b89c6a27 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Created volume successfully. Apr 22 18:01:46 devstack sudo[90772]: pam_unix(sudo:session): session closed for user root Apr 22 18:01:46 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-699071de-73a0-4a4c-bec7-ad5a3d739b00 tempest-CreateVolumesFromImageTest-569648132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-2d35ccc2-3ecd-4dac-845a-d2918866c299" returned: 0 in 0.479s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:01:46 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-699071de-73a0-4a4c-bec7-ad5a3d739b00 tempest-CreateVolumesFromImageTest-569648132 None] Lock "cinder-quobyte-2d35ccc2-3ecd-4dac-845a-d2918866c299" released by "delete_volume" :: held 1.131s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 18:01:46 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-699071de-73a0-4a4c-bec7-ad5a3d739b00 tempest-CreateVolumesFromImageTest-569648132 None] Created reservations ['d5d2cee5-88b6-4a59-9df6-c74de767d3d2', '9ab7a16f-6609-41c8-8363-937d8be8be34', '11d92836-c2f8-4743-82da-526634020bf2', '89a91a21-e50e-42f7-9a33-193c10a44345'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 18:01:46 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-699071de-73a0-4a4c-bec7-ad5a3d739b00 tempest-CreateVolumesFromImageTest-569648132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 18:01:46 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-699071de-73a0-4a4c-bec7-ad5a3d739b00 tempest-CreateVolumesFromImageTest-569648132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 18:01:46 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-699071de-73a0-4a4c-bec7-ad5a3d739b00 tempest-CreateVolumesFromImageTest-569648132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 18:01:46 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-699071de-73a0-4a4c-bec7-ad5a3d739b00 tempest-CreateVolumesFromImageTest-569648132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 18:01:46 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-699071de-73a0-4a4c-bec7-ad5a3d739b00 tempest-CreateVolumesFromImageTest-569648132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 18:01:46 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-699071de-73a0-4a4c-bec7-ad5a3d739b00 tempest-CreateVolumesFromImageTest-569648132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:01:46 devstack sudo[90781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 Apr 22 18:01:46 devstack sudo[90781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:01:47 devstack sudo[90775]: pam_unix(sudo:session): session closed for user root Apr 22 18:01:47 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-9c26e9c0-847a-4f7f-84ad-1489b0668851 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-8019d1d3-1406-4f8d-8c82-6256a9fd32fd 1073741824" returned: 0 in 0.680s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:01:47 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-9c26e9c0-847a-4f7f-84ad-1489b0668851 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-8019d1d3-1406-4f8d-8c82-6256a9fd32fd {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:01:47 devstack sudo[90783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-8019d1d3-1406-4f8d-8c82-6256a9fd32fd Apr 22 18:01:47 devstack sudo[90783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:01:47 devstack sudo[90781]: pam_unix(sudo:session): session closed for user root Apr 22 18:01:47 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-699071de-73a0-4a4c-bec7-ad5a3d739b00 tempest-CreateVolumesFromImageTest-569648132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33" returned: 0 in 0.480s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:01:47 devstack cinder-volume[81771]: DEBUG cinder.manager [None req-699071de-73a0-4a4c-bec7-ad5a3d739b00 tempest-CreateVolumesFromImageTest-569648132 None] Notifying Schedulers of capabilities ... {{(pid=81771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 18:01:47 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-699071de-73a0-4a4c-bec7-ad5a3d739b00 tempest-CreateVolumesFromImageTest-569648132 None] Deleted volume successfully. Apr 22 18:01:47 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-699071de-73a0-4a4c-bec7-ad5a3d739b00 tempest-CreateVolumesFromImageTest-569648132 None] Lock "cinder-2d35ccc2-3ecd-4dac-845a-d2918866c299-delete_volume" released by "delete_volume" :: held 1.814s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 18:01:47 devstack sudo[90783]: pam_unix(sudo:session): session closed for user root Apr 22 18:01:47 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-9c26e9c0-847a-4f7f-84ad-1489b0668851 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-8019d1d3-1406-4f8d-8c82-6256a9fd32fd" returned: 0 in 0.466s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:01:47 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-9c26e9c0-847a-4f7f-84ad-1489b0668851 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] <== create_volume: return (1185ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'} {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 18:01:47 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-9c26e9c0-847a-4f7f-84ad-1489b0668851 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.188s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 18:01:47 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-82fa2a11-ed7f-47ce-b21b-9a4b8cf0b900 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.061s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 18:01:47 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-82fa2a11-ed7f-47ce-b21b-9a4b8cf0b900 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T16:01:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-84808493',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aebeecc6-ff1f-49e5-83e0-70d3f3e23314,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3ace5ef0e324f26a416db8aa339250a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T16:01:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T16:01:33Z,use_quota=True,user_id='7ca1e0b101e94628a5bab89043e2705b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)}" {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 18:01:47 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-82fa2a11-ed7f-47ce-b21b-9a4b8cf0b900 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Creating volume aebeecc6-ff1f-49e5-83e0-70d3f3e23314 {{(pid=81771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 18:01:47 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-82fa2a11-ed7f-47ce-b21b-9a4b8cf0b900 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 18:01:47 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-82fa2a11-ed7f-47ce-b21b-9a4b8cf0b900 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 18:01:47 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-82fa2a11-ed7f-47ce-b21b-9a4b8cf0b900 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 18:01:47 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-82fa2a11-ed7f-47ce-b21b-9a4b8cf0b900 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 18:01:47 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-82fa2a11-ed7f-47ce-b21b-9a4b8cf0b900 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 18:01:47 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-82fa2a11-ed7f-47ce-b21b-9a4b8cf0b900 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Selected osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 as target Quobyte volume. {{(pid=81771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 18:01:47 devstack cinder-volume[81771]: INFO cinder.volume.drivers.remotefs [None req-82fa2a11-ed7f-47ce-b21b-9a4b8cf0b900 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] casted to osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 Apr 22 18:01:47 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-82fa2a11-ed7f-47ce-b21b-9a4b8cf0b900 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-aebeecc6-ff1f-49e5-83e0-70d3f3e23314 1073741824 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:01:47 devstack sudo[90788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-aebeecc6-ff1f-49e5-83e0-70d3f3e23314 1073741824 Apr 22 18:01:47 devstack sudo[90788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:01:47 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-9c26e9c0-847a-4f7f-84ad-1489b0668851 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5c1b4eb-0e04-493b-a098-6860a1a7d808) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8019d1d3-1406-4f8d-8c82-6256a9fd32fd', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:01:47 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-9c26e9c0-847a-4f7f-84ad-1489b0668851 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8228cd30-0437-429d-9e5d-ceebfef6a852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:01:47 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-9c26e9c0-847a-4f7f-84ad-1489b0668851 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Volume volume-8019d1d3-1406-4f8d-8c82-6256a9fd32fd (8019d1d3-1406-4f8d-8c82-6256a9fd32fd): created successfully Apr 22 18:01:47 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-9c26e9c0-847a-4f7f-84ad-1489b0668851 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8228cd30-0437-429d-9e5d-ceebfef6a852) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:01:47 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-9c26e9c0-847a-4f7f-84ad-1489b0668851 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Flow 'volume_create_manager' (5bed5b19-2a8e-472d-86e6-22cd931a0b94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 18:01:47 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-9c26e9c0-847a-4f7f-84ad-1489b0668851 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Created volume successfully. Apr 22 18:01:48 devstack sudo[90788]: pam_unix(sudo:session): session closed for user root Apr 22 18:01:48 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-82fa2a11-ed7f-47ce-b21b-9a4b8cf0b900 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-aebeecc6-ff1f-49e5-83e0-70d3f3e23314 1073741824" returned: 0 in 0.773s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:01:48 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-82fa2a11-ed7f-47ce-b21b-9a4b8cf0b900 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-aebeecc6-ff1f-49e5-83e0-70d3f3e23314 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:01:48 devstack sudo[90794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-aebeecc6-ff1f-49e5-83e0-70d3f3e23314 Apr 22 18:01:48 devstack sudo[90794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:01:48 devstack sudo[90794]: pam_unix(sudo:session): session closed for user root Apr 22 18:01:48 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-82fa2a11-ed7f-47ce-b21b-9a4b8cf0b900 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-aebeecc6-ff1f-49e5-83e0-70d3f3e23314" returned: 0 in 0.586s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:01:48 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-82fa2a11-ed7f-47ce-b21b-9a4b8cf0b900 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] <== create_volume: return (1405ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'} {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 18:01:48 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-82fa2a11-ed7f-47ce-b21b-9a4b8cf0b900 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.407s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 18:01:48 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-b6f2c112-9998-4696-a420-0564f665260d tempest-VolumeDependencyTests-158100058 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 8.247s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 18:01:48 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-b6f2c112-9998-4696-a420-0564f665260d tempest-VolumeDependencyTests-158100058 None] Acquiring lock "cinder-quobyte-720c2c8e-73a4-4b98-8ffb-37cede92e24c-6542b28f-52d6-43da-bee8-a7fa1b970636" by "_create_volume_from_snapshot" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 18:01:49 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-b6f2c112-9998-4696-a420-0564f665260d tempest-VolumeDependencyTests-158100058 None] Lock "cinder-quobyte-720c2c8e-73a4-4b98-8ffb-37cede92e24c-6542b28f-52d6-43da-bee8-a7fa1b970636" acquired by "_create_volume_from_snapshot" :: waited 0.027s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 18:01:49 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-b6f2c112-9998-4696-a420-0564f665260d tempest-VolumeDependencyTests-158100058 None] Creating volume 6542b28f-52d6-43da-bee8-a7fa1b970636 from snapshot 720c2c8e-73a4-4b98-8ffb-37cede92e24c {{(pid=81771) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 22 18:01:49 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-b6f2c112-9998-4696-a420-0564f665260d tempest-VolumeDependencyTests-158100058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 18:01:49 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-b6f2c112-9998-4696-a420-0564f665260d tempest-VolumeDependencyTests-158100058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 18:01:49 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-b6f2c112-9998-4696-a420-0564f665260d tempest-VolumeDependencyTests-158100058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 18:01:49 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-b6f2c112-9998-4696-a420-0564f665260d tempest-VolumeDependencyTests-158100058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 18:01:49 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-b6f2c112-9998-4696-a420-0564f665260d tempest-VolumeDependencyTests-158100058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 18:01:49 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-b6f2c112-9998-4696-a420-0564f665260d tempest-VolumeDependencyTests-158100058 None] Selected osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 as target Quobyte volume. {{(pid=81771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 18:01:49 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-b6f2c112-9998-4696-a420-0564f665260d tempest-VolumeDependencyTests-158100058 None] Acquiring lock "cinder-quobyte-6542b28f-52d6-43da-bee8-a7fa1b970636" by "_copy_volume_from_snapshot" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 18:01:49 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-82fa2a11-ed7f-47ce-b21b-9a4b8cf0b900 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0c4be9c-f426-41a1-9fd3-751363843a88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aebeecc6-ff1f-49e5-83e0-70d3f3e23314', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:01:49 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-82fa2a11-ed7f-47ce-b21b-9a4b8cf0b900 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b62afd1-2952-4b85-a705-74c2798b24d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:01:49 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-82fa2a11-ed7f-47ce-b21b-9a4b8cf0b900 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Volume volume-aebeecc6-ff1f-49e5-83e0-70d3f3e23314 (aebeecc6-ff1f-49e5-83e0-70d3f3e23314): created successfully Apr 22 18:01:49 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-82fa2a11-ed7f-47ce-b21b-9a4b8cf0b900 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b62afd1-2952-4b85-a705-74c2798b24d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:01:49 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-82fa2a11-ed7f-47ce-b21b-9a4b8cf0b900 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Flow 'volume_create_manager' (8548f5a5-f3c3-4caa-a8bb-4269fb8df5f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 18:01:49 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-b6f2c112-9998-4696-a420-0564f665260d tempest-VolumeDependencyTests-158100058 None] Lock "cinder-quobyte-6542b28f-52d6-43da-bee8-a7fa1b970636" acquired by "_copy_volume_from_snapshot" :: waited 0.057s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 18:01:49 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-b6f2c112-9998-4696-a420-0564f665260d tempest-VolumeDependencyTests-158100058 None] snapshot: 720c2c8e-73a4-4b98-8ffb-37cede92e24c, volume: 6542b28f-52d6-43da-bee8-a7fa1b970636, {{(pid=81771) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 22 18:01:49 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-82fa2a11-ed7f-47ce-b21b-9a4b8cf0b900 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Created volume successfully. Apr 22 18:01:49 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-b6f2c112-9998-4696-a420-0564f665260d tempest-VolumeDependencyTests-158100058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 18:01:49 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-b6f2c112-9998-4696-a420-0564f665260d tempest-VolumeDependencyTests-158100058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 18:01:49 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-b6f2c112-9998-4696-a420-0564f665260d tempest-VolumeDependencyTests-158100058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 18:01:49 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-b6f2c112-9998-4696-a420-0564f665260d tempest-VolumeDependencyTests-158100058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 18:01:49 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-b6f2c112-9998-4696-a420-0564f665260d tempest-VolumeDependencyTests-158100058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 18:01:49 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[896d87da-617c-49a2-99d4-3b0d54f64dca]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 18:01:49 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-b6f2c112-9998-4696-a420-0564f665260d tempest-VolumeDependencyTests-158100058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-30ad2fa6-823a-48c4-a1d5-951ad2bc78f5.720c2c8e-73a4-4b98-8ffb-37cede92e24c {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:01:49 devstack sudo[90797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-30ad2fa6-823a-48c4-a1d5-951ad2bc78f5.720c2c8e-73a4-4b98-8ffb-37cede92e24c Apr 22 18:01:49 devstack sudo[90797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:01:49 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-1ed65a4d-3597-4f58-b18f-c9a9e3ea0261 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Acquiring lock "cinder-aebeecc6-ff1f-49e5-83e0-70d3f3e23314-delete_volume" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 18:01:49 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-1ed65a4d-3597-4f58-b18f-c9a9e3ea0261 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Lock "cinder-aebeecc6-ff1f-49e5-83e0-70d3f3e23314-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 18:01:49 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-1ed65a4d-3597-4f58-b18f-c9a9e3ea0261 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Acquiring lock "cinder-quobyte-aebeecc6-ff1f-49e5-83e0-70d3f3e23314" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 18:01:49 devstack sudo[90797]: pam_unix(sudo:session): session closed for user root Apr 22 18:01:49 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-1ed65a4d-3597-4f58-b18f-c9a9e3ea0261 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Lock "cinder-quobyte-aebeecc6-ff1f-49e5-83e0-70d3f3e23314" acquired by "delete_volume" :: waited 0.024s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 18:01:49 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-b6f2c112-9998-4696-a420-0564f665260d tempest-VolumeDependencyTests-158100058 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-30ad2fa6-823a-48c4-a1d5-951ad2bc78f5.720c2c8e-73a4-4b98-8ffb-37cede92e24c" returned: 0 in 0.719s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:01:49 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-b6f2c112-9998-4696-a420-0564f665260d tempest-VolumeDependencyTests-158100058 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-30ad2fa6-823a-48c4-a1d5-951ad2bc78f5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81771) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 22 18:01:49 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-b6f2c112-9998-4696-a420-0564f665260d tempest-VolumeDependencyTests-158100058 None] will copy from snapshot at /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-30ad2fa6-823a-48c4-a1d5-951ad2bc78f5 {{(pid=81771) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 22 18:01:49 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-b6f2c112-9998-4696-a420-0564f665260d tempest-VolumeDependencyTests-158100058 None] Creating direct copy from snapshot {{(pid=81771) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 22 18:01:49 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cf8c163-d8a0-42a2-9822-6391e68e08c6]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 18:01:49 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-1ed65a4d-3597-4f58-b18f-c9a9e3ea0261 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-aebeecc6-ff1f-49e5-83e0-70d3f3e23314 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:01:49 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd32aebe-d5cf-49c1-bfc0-985099aaa2ea]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 18:01:49 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-b6f2c112-9998-4696-a420-0564f665260d tempest-VolumeDependencyTests-158100058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-30ad2fa6-823a-48c4-a1d5-951ad2bc78f5 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:01:49 devstack sudo[90803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-aebeecc6-ff1f-49e5-83e0-70d3f3e23314 Apr 22 18:01:49 devstack sudo[90803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:01:50 devstack sudo[90804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-30ad2fa6-823a-48c4-a1d5-951ad2bc78f5 Apr 22 18:01:50 devstack sudo[90804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:01:50 devstack sudo[90804]: pam_unix(sudo:session): session closed for user root Apr 22 18:01:50 devstack sudo[90803]: pam_unix(sudo:session): session closed for user root Apr 22 18:01:50 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-b6f2c112-9998-4696-a420-0564f665260d tempest-VolumeDependencyTests-158100058 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-30ad2fa6-823a-48c4-a1d5-951ad2bc78f5" returned: 0 in 0.685s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:01:50 devstack cinder-volume[81771]: DEBUG cinder.utils [None req-b6f2c112-9998-4696-a420-0564f665260d tempest-VolumeDependencyTests-158100058 None] Path /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-6542b28f-52d6-43da-bee8-a7fa1b970636 not found in is_blk_device check {{(pid=81771) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 22 18:01:50 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-b6f2c112-9998-4696-a420-0564f665260d tempest-VolumeDependencyTests-158100058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-30ad2fa6-823a-48c4-a1d5-951ad2bc78f5 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-6542b28f-52d6-43da-bee8-a7fa1b970636 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:01:50 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-1ed65a4d-3597-4f58-b18f-c9a9e3ea0261 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-aebeecc6-ff1f-49e5-83e0-70d3f3e23314" returned: 0 in 0.713s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:01:50 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-1ed65a4d-3597-4f58-b18f-c9a9e3ea0261 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-aebeecc6-ff1f-49e5-83e0-70d3f3e23314 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:01:50 devstack sudo[90813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-30ad2fa6-823a-48c4-a1d5-951ad2bc78f5 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-6542b28f-52d6-43da-bee8-a7fa1b970636 Apr 22 18:01:50 devstack sudo[90813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:01:50 devstack sudo[90814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-aebeecc6-ff1f-49e5-83e0-70d3f3e23314 Apr 22 18:01:50 devstack sudo[90814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:01:51 devstack sudo[90814]: pam_unix(sudo:session): session closed for user root Apr 22 18:01:51 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-1ed65a4d-3597-4f58-b18f-c9a9e3ea0261 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-aebeecc6-ff1f-49e5-83e0-70d3f3e23314" returned: 0 in 0.602s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:01:51 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-1ed65a4d-3597-4f58-b18f-c9a9e3ea0261 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Lock "cinder-quobyte-aebeecc6-ff1f-49e5-83e0-70d3f3e23314" released by "delete_volume" :: held 1.374s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 18:01:51 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-1ed65a4d-3597-4f58-b18f-c9a9e3ea0261 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Created reservations ['419b48f7-e0a4-4b40-98bd-61ab9dd19bf0', 'c7823d59-87f5-4ddc-8927-5643a34d3fef', '8d845ac9-aabf-470e-bb86-2781cf4c8150', '77387abb-5f41-4a7d-886f-1716a6a174c0'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 18:01:51 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-1ed65a4d-3597-4f58-b18f-c9a9e3ea0261 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 18:01:51 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-1ed65a4d-3597-4f58-b18f-c9a9e3ea0261 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 18:01:51 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-1ed65a4d-3597-4f58-b18f-c9a9e3ea0261 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 18:01:51 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-1ed65a4d-3597-4f58-b18f-c9a9e3ea0261 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 18:01:51 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-1ed65a4d-3597-4f58-b18f-c9a9e3ea0261 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 18:01:51 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-1ed65a4d-3597-4f58-b18f-c9a9e3ea0261 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:01:51 devstack sudo[90826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 Apr 22 18:01:51 devstack sudo[90826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:01:52 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-e9d05ba2-d84f-4995-aac2-1836b7efc0e0 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Acquiring lock "cinder-8019d1d3-1406-4f8d-8c82-6256a9fd32fd-delete_volume" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 18:01:52 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-e9d05ba2-d84f-4995-aac2-1836b7efc0e0 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Lock "cinder-8019d1d3-1406-4f8d-8c82-6256a9fd32fd-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 18:01:52 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-e9d05ba2-d84f-4995-aac2-1836b7efc0e0 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Acquiring lock "cinder-quobyte-8019d1d3-1406-4f8d-8c82-6256a9fd32fd" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 18:01:52 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-e9d05ba2-d84f-4995-aac2-1836b7efc0e0 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Lock "cinder-quobyte-8019d1d3-1406-4f8d-8c82-6256a9fd32fd" acquired by "delete_volume" :: waited 0.031s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 18:01:52 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[60307c32-af12-459b-9ff4-004163267006]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 18:01:52 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-e9d05ba2-d84f-4995-aac2-1836b7efc0e0 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-8019d1d3-1406-4f8d-8c82-6256a9fd32fd {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:01:52 devstack sudo[90830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-8019d1d3-1406-4f8d-8c82-6256a9fd32fd Apr 22 18:01:52 devstack sudo[90830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:01:52 devstack sudo[90826]: pam_unix(sudo:session): session closed for user root Apr 22 18:01:52 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-1ed65a4d-3597-4f58-b18f-c9a9e3ea0261 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33" returned: 0 in 1.447s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:01:52 devstack cinder-volume[81771]: DEBUG cinder.manager [None req-1ed65a4d-3597-4f58-b18f-c9a9e3ea0261 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Notifying Schedulers of capabilities ... {{(pid=81771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 18:01:52 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-1ed65a4d-3597-4f58-b18f-c9a9e3ea0261 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Deleted volume successfully. Apr 22 18:01:52 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-1ed65a4d-3597-4f58-b18f-c9a9e3ea0261 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Lock "cinder-aebeecc6-ff1f-49e5-83e0-70d3f3e23314-delete_volume" released by "delete_volume" :: held 3.147s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 18:01:53 devstack sudo[90830]: pam_unix(sudo:session): session closed for user root Apr 22 18:01:53 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-e9d05ba2-d84f-4995-aac2-1836b7efc0e0 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-8019d1d3-1406-4f8d-8c82-6256a9fd32fd" returned: 0 in 1.478s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:01:53 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-e9d05ba2-d84f-4995-aac2-1836b7efc0e0 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-8019d1d3-1406-4f8d-8c82-6256a9fd32fd {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:01:53 devstack sudo[90836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-8019d1d3-1406-4f8d-8c82-6256a9fd32fd Apr 22 18:01:53 devstack sudo[90836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:01:55 devstack sudo[90836]: pam_unix(sudo:session): session closed for user root Apr 22 18:01:55 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-e9d05ba2-d84f-4995-aac2-1836b7efc0e0 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-8019d1d3-1406-4f8d-8c82-6256a9fd32fd" returned: 0 in 1.450s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:01:55 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-e9d05ba2-d84f-4995-aac2-1836b7efc0e0 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Lock "cinder-quobyte-8019d1d3-1406-4f8d-8c82-6256a9fd32fd" released by "delete_volume" :: held 3.046s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 18:01:55 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-e9d05ba2-d84f-4995-aac2-1836b7efc0e0 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Created reservations ['10c735cc-cccc-4c9c-b2df-c11e813cef0b', '395f0c7f-ce81-4151-98a5-7c29fda86e8e', 'ca71cbf0-8091-4231-8118-1b94220e865c', 'd00dc0af-1098-4788-834b-2ea4e7248d8f'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 18:01:55 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-e9d05ba2-d84f-4995-aac2-1836b7efc0e0 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 18:01:55 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-e9d05ba2-d84f-4995-aac2-1836b7efc0e0 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 18:01:55 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-e9d05ba2-d84f-4995-aac2-1836b7efc0e0 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 18:01:55 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-e9d05ba2-d84f-4995-aac2-1836b7efc0e0 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 18:01:55 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-e9d05ba2-d84f-4995-aac2-1836b7efc0e0 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 18:01:55 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-e9d05ba2-d84f-4995-aac2-1836b7efc0e0 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:01:55 devstack sudo[90839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 Apr 22 18:01:55 devstack sudo[90839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:01:55 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-a1d07271-910d-481e-918a-8d42f25c0e25 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Acquiring lock "cinder-92b992fc-e7be-425d-aa6b-9439469b00ac-delete_volume" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 18:01:56 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-a1d07271-910d-481e-918a-8d42f25c0e25 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Lock "cinder-92b992fc-e7be-425d-aa6b-9439469b00ac-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 18:01:56 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-a1d07271-910d-481e-918a-8d42f25c0e25 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Acquiring lock "cinder-quobyte-92b992fc-e7be-425d-aa6b-9439469b00ac" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 18:01:56 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-a1d07271-910d-481e-918a-8d42f25c0e25 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Lock "cinder-quobyte-92b992fc-e7be-425d-aa6b-9439469b00ac" acquired by "delete_volume" :: waited 0.025s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 18:01:56 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2408c3f-5a18-4f17-aec5-d825305c1945]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 18:01:56 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-a1d07271-910d-481e-918a-8d42f25c0e25 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-92b992fc-e7be-425d-aa6b-9439469b00ac {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:01:56 devstack sudo[90841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-92b992fc-e7be-425d-aa6b-9439469b00ac Apr 22 18:01:56 devstack sudo[90841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:01:57 devstack sudo[90813]: pam_unix(sudo:session): session closed for user root Apr 22 18:01:57 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-b6f2c112-9998-4696-a420-0564f665260d tempest-VolumeDependencyTests-158100058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-30ad2fa6-823a-48c4-a1d5-951ad2bc78f5 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-6542b28f-52d6-43da-bee8-a7fa1b970636" returned: 0 in 6.411s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:01:57 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfebf78e-2c83-4acf-95c3-efa78f6614d7]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 18:01:57 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-b6f2c112-9998-4696-a420-0564f665260d tempest-VolumeDependencyTests-158100058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-30ad2fa6-823a-48c4-a1d5-951ad2bc78f5 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:01:57 devstack sudo[90839]: pam_unix(sudo:session): session closed for user root Apr 22 18:01:57 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-e9d05ba2-d84f-4995-aac2-1836b7efc0e0 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33" returned: 0 in 1.381s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:01:57 devstack cinder-volume[81771]: DEBUG cinder.manager [None req-e9d05ba2-d84f-4995-aac2-1836b7efc0e0 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Notifying Schedulers of capabilities ... {{(pid=81771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 18:01:57 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-e9d05ba2-d84f-4995-aac2-1836b7efc0e0 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Deleted volume successfully. Apr 22 18:01:57 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-e9d05ba2-d84f-4995-aac2-1836b7efc0e0 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Lock "cinder-8019d1d3-1406-4f8d-8c82-6256a9fd32fd-delete_volume" released by "delete_volume" :: held 4.947s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 18:01:57 devstack sudo[90844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-30ad2fa6-823a-48c4-a1d5-951ad2bc78f5 Apr 22 18:01:57 devstack sudo[90844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:01:57 devstack sudo[90841]: pam_unix(sudo:session): session closed for user root Apr 22 18:01:57 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-a1d07271-910d-481e-918a-8d42f25c0e25 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-92b992fc-e7be-425d-aa6b-9439469b00ac" returned: 0 in 1.072s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:01:57 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-a1d07271-910d-481e-918a-8d42f25c0e25 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-92b992fc-e7be-425d-aa6b-9439469b00ac {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:01:57 devstack sudo[90850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-92b992fc-e7be-425d-aa6b-9439469b00ac Apr 22 18:01:57 devstack sudo[90850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:01:57 devstack sudo[90844]: pam_unix(sudo:session): session closed for user root Apr 22 18:01:57 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-b6f2c112-9998-4696-a420-0564f665260d tempest-VolumeDependencyTests-158100058 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-30ad2fa6-823a-48c4-a1d5-951ad2bc78f5" returned: 0 in 0.812s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:01:57 devstack cinder-volume[81771]: DEBUG cinder.image.image_utils [None req-b6f2c112-9998-4696-a420-0564f665260d tempest-VolumeDependencyTests-158100058 None] Image conversion details: src /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-30ad2fa6-823a-48c4-a1d5-951ad2bc78f5, size 1024.00 MB, duration 6.41 sec, destination /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-6542b28f-52d6-43da-bee8-a7fa1b970636 {{(pid=81771) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 22 18:01:57 devstack cinder-volume[81771]: INFO cinder.image.image_utils [None req-b6f2c112-9998-4696-a420-0564f665260d tempest-VolumeDependencyTests-158100058 None] Converted 1024.00 MB image at 159.69 MB/s Apr 22 18:01:57 devstack cinder-volume[81771]: WARNING cinder.volume.drivers.remotefs [None req-b6f2c112-9998-4696-a420-0564f665260d tempest-VolumeDependencyTests-158100058 None] /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-6542b28f-52d6-43da-bee8-a7fa1b970636 is being set with open permissions: ugo+rw Apr 22 18:01:57 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-b6f2c112-9998-4696-a420-0564f665260d tempest-VolumeDependencyTests-158100058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-6542b28f-52d6-43da-bee8-a7fa1b970636 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:01:57 devstack sudo[90856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-6542b28f-52d6-43da-bee8-a7fa1b970636 Apr 22 18:01:57 devstack sudo[90856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:01:57 devstack sudo[90850]: pam_unix(sudo:session): session closed for user root Apr 22 18:01:57 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-a1d07271-910d-481e-918a-8d42f25c0e25 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-92b992fc-e7be-425d-aa6b-9439469b00ac" returned: 0 in 0.610s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:01:57 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-a1d07271-910d-481e-918a-8d42f25c0e25 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Lock "cinder-quobyte-92b992fc-e7be-425d-aa6b-9439469b00ac" released by "delete_volume" :: held 1.774s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 18:01:58 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-a1d07271-910d-481e-918a-8d42f25c0e25 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Created reservations ['4cfa2224-327f-4d58-9ff5-8e8ad46eb52b', 'e24b6e70-d2e8-4f53-b10c-30c2501450ec', '3b748032-f4e9-4e19-85d8-0697168f0f80', '83ac1c6f-d7a0-44f1-b151-226fef294792'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 18:01:58 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-a1d07271-910d-481e-918a-8d42f25c0e25 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 18:01:58 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-a1d07271-910d-481e-918a-8d42f25c0e25 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 18:01:58 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-a1d07271-910d-481e-918a-8d42f25c0e25 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 18:01:58 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-a1d07271-910d-481e-918a-8d42f25c0e25 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 18:01:58 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-a1d07271-910d-481e-918a-8d42f25c0e25 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 18:01:58 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-a1d07271-910d-481e-918a-8d42f25c0e25 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:01:58 devstack sudo[90858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 Apr 22 18:01:58 devstack sudo[90858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:01:58 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-2c4ea0a8-00fe-40fd-8271-eea7fe85792a tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Acquiring lock "cinder-7f0ae989-4db5-433f-8050-b471b212e992-delete_volume" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 18:01:58 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-2c4ea0a8-00fe-40fd-8271-eea7fe85792a tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Lock "cinder-7f0ae989-4db5-433f-8050-b471b212e992-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 18:01:58 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-2c4ea0a8-00fe-40fd-8271-eea7fe85792a tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Acquiring lock "cinder-quobyte-7f0ae989-4db5-433f-8050-b471b212e992" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 18:01:58 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-2c4ea0a8-00fe-40fd-8271-eea7fe85792a tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Lock "cinder-quobyte-7f0ae989-4db5-433f-8050-b471b212e992" acquired by "delete_volume" :: waited 0.022s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 18:01:58 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[27535f0e-ea50-4e57-b1f5-6b08b092c8fc]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 18:01:58 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-2c4ea0a8-00fe-40fd-8271-eea7fe85792a tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7f0ae989-4db5-433f-8050-b471b212e992 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:01:58 devstack sudo[90856]: pam_unix(sudo:session): session closed for user root Apr 22 18:01:58 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-b6f2c112-9998-4696-a420-0564f665260d tempest-VolumeDependencyTests-158100058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-6542b28f-52d6-43da-bee8-a7fa1b970636" returned: 0 in 0.686s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:01:58 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-b6f2c112-9998-4696-a420-0564f665260d tempest-VolumeDependencyTests-158100058 None] Lock "cinder-quobyte-6542b28f-52d6-43da-bee8-a7fa1b970636" released by "_copy_volume_from_snapshot" :: held 9.449s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 18:01:58 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-b6f2c112-9998-4696-a420-0564f665260d tempest-VolumeDependencyTests-158100058 None] Lock "cinder-quobyte-720c2c8e-73a4-4b98-8ffb-37cede92e24c-6542b28f-52d6-43da-bee8-a7fa1b970636" released by "_create_volume_from_snapshot" :: held 9.523s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 18:01:58 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-b6f2c112-9998-4696-a420-0564f665260d tempest-VolumeDependencyTests-158100058 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.554s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 18:01:58 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-f65f12d8-6f6e-4bba-8dc7-e37deb88d37b tempest-CreateVolumesFromSnapshotTest-540484731 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.483s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 18:01:58 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-f65f12d8-6f6e-4bba-8dc7-e37deb88d37b tempest-CreateVolumesFromSnapshotTest-540484731 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T16:01:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1384314569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea9ae10c-fbda-4c40-8431-f2b3bd91bc49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ad058daf3dd47faa77e8d9cfd2b7b9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T16:01:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T16:01:44Z,use_quota=True,user_id='6cf81a539f0d43779bb0d619864d130a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)}" {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 18:01:58 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-f65f12d8-6f6e-4bba-8dc7-e37deb88d37b tempest-CreateVolumesFromSnapshotTest-540484731 None] Creating volume ea9ae10c-fbda-4c40-8431-f2b3bd91bc49 {{(pid=81771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 18:01:58 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-f65f12d8-6f6e-4bba-8dc7-e37deb88d37b tempest-CreateVolumesFromSnapshotTest-540484731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 18:01:58 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-f65f12d8-6f6e-4bba-8dc7-e37deb88d37b tempest-CreateVolumesFromSnapshotTest-540484731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 18:01:58 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-f65f12d8-6f6e-4bba-8dc7-e37deb88d37b tempest-CreateVolumesFromSnapshotTest-540484731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 18:01:58 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-f65f12d8-6f6e-4bba-8dc7-e37deb88d37b tempest-CreateVolumesFromSnapshotTest-540484731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 18:01:58 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-f65f12d8-6f6e-4bba-8dc7-e37deb88d37b tempest-CreateVolumesFromSnapshotTest-540484731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 18:01:58 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-f65f12d8-6f6e-4bba-8dc7-e37deb88d37b tempest-CreateVolumesFromSnapshotTest-540484731 None] Selected osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 as target Quobyte volume. {{(pid=81771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 18:01:58 devstack cinder-volume[81771]: INFO cinder.volume.drivers.remotefs [None req-f65f12d8-6f6e-4bba-8dc7-e37deb88d37b tempest-CreateVolumesFromSnapshotTest-540484731 None] casted to osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 Apr 22 18:01:58 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-f65f12d8-6f6e-4bba-8dc7-e37deb88d37b tempest-CreateVolumesFromSnapshotTest-540484731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-ea9ae10c-fbda-4c40-8431-f2b3bd91bc49 1073741824 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:01:58 devstack sudo[90862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-ea9ae10c-fbda-4c40-8431-f2b3bd91bc49 1073741824 Apr 22 18:01:58 devstack sudo[90862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:01:58 devstack sudo[90861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7f0ae989-4db5-433f-8050-b471b212e992 Apr 22 18:01:58 devstack sudo[90861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:01:58 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-b6f2c112-9998-4696-a420-0564f665260d tempest-VolumeDependencyTests-158100058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5a71cc5-e4ca-4dcf-bed5-81827f9729b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6542b28f-52d6-43da-bee8-a7fa1b970636', 'volume_size': 1, 'snapshot_id': '720c2c8e-73a4-4b98-8ffb-37cede92e24c'}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:01:58 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-b6f2c112-9998-4696-a420-0564f665260d tempest-VolumeDependencyTests-158100058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac64f05e-3f4c-4935-8fd3-f94938d1c545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:01:58 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-b6f2c112-9998-4696-a420-0564f665260d tempest-VolumeDependencyTests-158100058 None] Volume volume-6542b28f-52d6-43da-bee8-a7fa1b970636 (6542b28f-52d6-43da-bee8-a7fa1b970636): created successfully Apr 22 18:01:58 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-b6f2c112-9998-4696-a420-0564f665260d tempest-VolumeDependencyTests-158100058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac64f05e-3f4c-4935-8fd3-f94938d1c545) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:01:58 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-b6f2c112-9998-4696-a420-0564f665260d tempest-VolumeDependencyTests-158100058 None] Flow 'volume_create_manager' (eeae1b20-7c77-495f-b990-1684b8f9db8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 18:01:58 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-b6f2c112-9998-4696-a420-0564f665260d tempest-VolumeDependencyTests-158100058 None] Created volume successfully. Apr 22 18:01:58 devstack sudo[90858]: pam_unix(sudo:session): session closed for user root Apr 22 18:01:58 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-a1d07271-910d-481e-918a-8d42f25c0e25 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33" returned: 0 in 0.645s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:01:58 devstack cinder-volume[81771]: DEBUG cinder.manager [None req-a1d07271-910d-481e-918a-8d42f25c0e25 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Notifying Schedulers of capabilities ... {{(pid=81771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 18:01:58 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-a1d07271-910d-481e-918a-8d42f25c0e25 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Deleted volume successfully. Apr 22 18:01:58 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-a1d07271-910d-481e-918a-8d42f25c0e25 tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Lock "cinder-92b992fc-e7be-425d-aa6b-9439469b00ac-delete_volume" released by "delete_volume" :: held 2.744s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 18:01:59 devstack sudo[90861]: pam_unix(sudo:session): session closed for user root Apr 22 18:01:59 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-2c4ea0a8-00fe-40fd-8271-eea7fe85792a tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7f0ae989-4db5-433f-8050-b471b212e992" returned: 0 in 0.778s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:01:59 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-2c4ea0a8-00fe-40fd-8271-eea7fe85792a tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7f0ae989-4db5-433f-8050-b471b212e992 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:01:59 devstack sudo[90905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7f0ae989-4db5-433f-8050-b471b212e992 Apr 22 18:01:59 devstack sudo[90905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:01:59 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-1225d22f-c062-40e8-8e6f-89ddd16c9aaf tempest-VolumeDependencyTests-158100058 None] Acquiring lock "cinder-720c2c8e-73a4-4b98-8ffb-37cede92e24c-delete_snapshot" by "delete_snapshot" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 18:01:59 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-1225d22f-c062-40e8-8e6f-89ddd16c9aaf tempest-VolumeDependencyTests-158100058 None] Lock "cinder-720c2c8e-73a4-4b98-8ffb-37cede92e24c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.061s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 18:01:59 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-1225d22f-c062-40e8-8e6f-89ddd16c9aaf tempest-VolumeDependencyTests-158100058 None] Acquiring lock "cinder-quobyte-30ad2fa6-823a-48c4-a1d5-951ad2bc78f5" by "delete_snapshot" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 18:01:59 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-1225d22f-c062-40e8-8e6f-89ddd16c9aaf tempest-VolumeDependencyTests-158100058 None] Lock "cinder-quobyte-30ad2fa6-823a-48c4-a1d5-951ad2bc78f5" acquired by "delete_snapshot" :: waited 0.018s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 18:01:59 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-1225d22f-c062-40e8-8e6f-89ddd16c9aaf tempest-VolumeDependencyTests-158100058 None] Acquiring lock "cinder-quobyte-720c2c8e-73a4-4b98-8ffb-37cede92e24c" by "_delete_snapshot" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 18:01:59 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-1225d22f-c062-40e8-8e6f-89ddd16c9aaf tempest-VolumeDependencyTests-158100058 None] Lock "cinder-quobyte-720c2c8e-73a4-4b98-8ffb-37cede92e24c" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 18:01:59 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-1225d22f-c062-40e8-8e6f-89ddd16c9aaf tempest-VolumeDependencyTests-158100058 None] Deleting offline snapshot 720c2c8e-73a4-4b98-8ffb-37cede92e24c of volume 30ad2fa6-823a-48c4-a1d5-951ad2bc78f5 {{(pid=81771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 22 18:01:59 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-1225d22f-c062-40e8-8e6f-89ddd16c9aaf tempest-VolumeDependencyTests-158100058 None] snapshot_file for this snap is: volume-30ad2fa6-823a-48c4-a1d5-951ad2bc78f5.720c2c8e-73a4-4b98-8ffb-37cede92e24c {{(pid=81771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 22 18:01:59 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[d19d23a9-ecc6-470b-a9b1-1963f5cd5c8f]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 18:01:59 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-1225d22f-c062-40e8-8e6f-89ddd16c9aaf tempest-VolumeDependencyTests-158100058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-30ad2fa6-823a-48c4-a1d5-951ad2bc78f5.720c2c8e-73a4-4b98-8ffb-37cede92e24c {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:01:59 devstack sudo[90862]: pam_unix(sudo:session): session closed for user root Apr 22 18:01:59 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-f65f12d8-6f6e-4bba-8dc7-e37deb88d37b tempest-CreateVolumesFromSnapshotTest-540484731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-ea9ae10c-fbda-4c40-8431-f2b3bd91bc49 1073741824" returned: 0 in 1.045s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:01:59 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-f65f12d8-6f6e-4bba-8dc7-e37deb88d37b tempest-CreateVolumesFromSnapshotTest-540484731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-ea9ae10c-fbda-4c40-8431-f2b3bd91bc49 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:01:59 devstack sudo[90909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-30ad2fa6-823a-48c4-a1d5-951ad2bc78f5.720c2c8e-73a4-4b98-8ffb-37cede92e24c Apr 22 18:01:59 devstack sudo[90909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:01:59 devstack sudo[90910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-ea9ae10c-fbda-4c40-8431-f2b3bd91bc49 Apr 22 18:01:59 devstack sudo[90910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:01:59 devstack sudo[90905]: pam_unix(sudo:session): session closed for user root Apr 22 18:01:59 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-2c4ea0a8-00fe-40fd-8271-eea7fe85792a tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-7f0ae989-4db5-433f-8050-b471b212e992" returned: 0 in 0.639s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:01:59 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-2c4ea0a8-00fe-40fd-8271-eea7fe85792a tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Lock "cinder-quobyte-7f0ae989-4db5-433f-8050-b471b212e992" released by "delete_volume" :: held 1.474s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 18:01:59 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-2c4ea0a8-00fe-40fd-8271-eea7fe85792a tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Created reservations ['aad330d2-6a90-4eed-aed1-655594ecc706', 'dbef8b60-fd32-4e26-9eb1-b58c5acecf4f', '9e0ca8f1-2147-4894-b16f-470110a43637', 'e17eff10-c8b3-47f9-9976-ee71d4a5b7d0'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 18:02:00 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-2c4ea0a8-00fe-40fd-8271-eea7fe85792a tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 18:02:00 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-2c4ea0a8-00fe-40fd-8271-eea7fe85792a tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 18:02:00 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-2c4ea0a8-00fe-40fd-8271-eea7fe85792a tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 18:02:00 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-2c4ea0a8-00fe-40fd-8271-eea7fe85792a tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 18:02:00 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-2c4ea0a8-00fe-40fd-8271-eea7fe85792a tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 18:02:00 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-2c4ea0a8-00fe-40fd-8271-eea7fe85792a tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:02:00 devstack sudo[90914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 Apr 22 18:02:00 devstack sudo[90914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:02:00 devstack sudo[90910]: pam_unix(sudo:session): session closed for user root Apr 22 18:02:00 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-f65f12d8-6f6e-4bba-8dc7-e37deb88d37b tempest-CreateVolumesFromSnapshotTest-540484731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-ea9ae10c-fbda-4c40-8431-f2b3bd91bc49" returned: 0 in 0.593s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:02:00 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-f65f12d8-6f6e-4bba-8dc7-e37deb88d37b tempest-CreateVolumesFromSnapshotTest-540484731 None] <== create_volume: return (1688ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'} {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 18:02:00 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-f65f12d8-6f6e-4bba-8dc7-e37deb88d37b tempest-CreateVolumesFromSnapshotTest-540484731 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.693s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 18:02:00 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-f69ef7e0-12af-4c51-a718-4a4908e7d0dd tempest-CreateVolumesFromSnapshotTest-540484731 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.898s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 18:02:00 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-f69ef7e0-12af-4c51-a718-4a4908e7d0dd tempest-CreateVolumesFromSnapshotTest-540484731 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T16:01:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1847807120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e25fcc7-6d9d-4f6c-b3e0-45fe8898750c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ad058daf3dd47faa77e8d9cfd2b7b9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T16:01:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T16:01:44Z,use_quota=True,user_id='6cf81a539f0d43779bb0d619864d130a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)}" {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 18:02:00 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-f69ef7e0-12af-4c51-a718-4a4908e7d0dd tempest-CreateVolumesFromSnapshotTest-540484731 None] Creating volume 1e25fcc7-6d9d-4f6c-b3e0-45fe8898750c {{(pid=81771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 18:02:00 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-f69ef7e0-12af-4c51-a718-4a4908e7d0dd tempest-CreateVolumesFromSnapshotTest-540484731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 18:02:00 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-f69ef7e0-12af-4c51-a718-4a4908e7d0dd tempest-CreateVolumesFromSnapshotTest-540484731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 18:02:00 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-f69ef7e0-12af-4c51-a718-4a4908e7d0dd tempest-CreateVolumesFromSnapshotTest-540484731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 18:02:00 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-f69ef7e0-12af-4c51-a718-4a4908e7d0dd tempest-CreateVolumesFromSnapshotTest-540484731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 18:02:00 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-f69ef7e0-12af-4c51-a718-4a4908e7d0dd tempest-CreateVolumesFromSnapshotTest-540484731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 18:02:00 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-f69ef7e0-12af-4c51-a718-4a4908e7d0dd tempest-CreateVolumesFromSnapshotTest-540484731 None] Selected osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 as target Quobyte volume. {{(pid=81771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 18:02:00 devstack cinder-volume[81771]: INFO cinder.volume.drivers.remotefs [None req-f69ef7e0-12af-4c51-a718-4a4908e7d0dd tempest-CreateVolumesFromSnapshotTest-540484731 None] casted to osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 Apr 22 18:02:00 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-f69ef7e0-12af-4c51-a718-4a4908e7d0dd tempest-CreateVolumesFromSnapshotTest-540484731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-1e25fcc7-6d9d-4f6c-b3e0-45fe8898750c 1073741824 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:02:00 devstack sudo[90920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-1e25fcc7-6d9d-4f6c-b3e0-45fe8898750c 1073741824 Apr 22 18:02:00 devstack sudo[90920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:02:00 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-f65f12d8-6f6e-4bba-8dc7-e37deb88d37b tempest-CreateVolumesFromSnapshotTest-540484731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07d1ba88-ce56-47fb-b1bb-8fb594d278bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea9ae10c-fbda-4c40-8431-f2b3bd91bc49', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:02:00 devstack sudo[90909]: pam_unix(sudo:session): session closed for user root Apr 22 18:02:00 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-f65f12d8-6f6e-4bba-8dc7-e37deb88d37b tempest-CreateVolumesFromSnapshotTest-540484731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11bb634a-c3a7-4676-955b-c33e9d91e1c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:02:00 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-1225d22f-c062-40e8-8e6f-89ddd16c9aaf tempest-VolumeDependencyTests-158100058 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-30ad2fa6-823a-48c4-a1d5-951ad2bc78f5.720c2c8e-73a4-4b98-8ffb-37cede92e24c" returned: 0 in 0.761s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:02:00 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-1225d22f-c062-40e8-8e6f-89ddd16c9aaf tempest-VolumeDependencyTests-158100058 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-30ad2fa6-823a-48c4-a1d5-951ad2bc78f5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81771) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 22 18:02:00 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bfa625e-cbd8-4321-b65b-57856c031f9b]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 18:02:00 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-1225d22f-c062-40e8-8e6f-89ddd16c9aaf tempest-VolumeDependencyTests-158100058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-30ad2fa6-823a-48c4-a1d5-951ad2bc78f5 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:02:00 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-f65f12d8-6f6e-4bba-8dc7-e37deb88d37b tempest-CreateVolumesFromSnapshotTest-540484731 None] Volume volume-ea9ae10c-fbda-4c40-8431-f2b3bd91bc49 (ea9ae10c-fbda-4c40-8431-f2b3bd91bc49): created successfully Apr 22 18:02:00 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-f65f12d8-6f6e-4bba-8dc7-e37deb88d37b tempest-CreateVolumesFromSnapshotTest-540484731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11bb634a-c3a7-4676-955b-c33e9d91e1c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:02:00 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-f65f12d8-6f6e-4bba-8dc7-e37deb88d37b tempest-CreateVolumesFromSnapshotTest-540484731 None] Flow 'volume_create_manager' (312ae070-6c36-459e-b5bc-ef053b625018) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 18:02:00 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-f65f12d8-6f6e-4bba-8dc7-e37deb88d37b tempest-CreateVolumesFromSnapshotTest-540484731 None] Created volume successfully. Apr 22 18:02:00 devstack sudo[90922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-30ad2fa6-823a-48c4-a1d5-951ad2bc78f5 Apr 22 18:02:00 devstack sudo[90922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:02:00 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-8ad63122-f995-4cb2-a953-e05e3fbcf88d tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Acquiring lock "cinder-006fbbb7-2b8a-4508-90ec-16b2a515007c-delete_volume" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 18:02:00 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-8ad63122-f995-4cb2-a953-e05e3fbcf88d tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Lock "cinder-006fbbb7-2b8a-4508-90ec-16b2a515007c-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 18:02:00 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-8ad63122-f995-4cb2-a953-e05e3fbcf88d tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Acquiring lock "cinder-quobyte-006fbbb7-2b8a-4508-90ec-16b2a515007c" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 18:02:00 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-8ad63122-f995-4cb2-a953-e05e3fbcf88d tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Lock "cinder-quobyte-006fbbb7-2b8a-4508-90ec-16b2a515007c" acquired by "delete_volume" :: waited 0.045s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 18:02:00 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[edfa88c0-b978-4562-86eb-0d3c873522ce]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 18:02:00 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-8ad63122-f995-4cb2-a953-e05e3fbcf88d tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-006fbbb7-2b8a-4508-90ec-16b2a515007c {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:02:01 devstack sudo[90914]: pam_unix(sudo:session): session closed for user root Apr 22 18:02:01 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-2c4ea0a8-00fe-40fd-8271-eea7fe85792a tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33" returned: 0 in 0.984s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:02:01 devstack cinder-volume[81771]: DEBUG cinder.manager [None req-2c4ea0a8-00fe-40fd-8271-eea7fe85792a tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Notifying Schedulers of capabilities ... {{(pid=81771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 18:02:01 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-2c4ea0a8-00fe-40fd-8271-eea7fe85792a tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Deleted volume successfully. Apr 22 18:02:01 devstack sudo[90928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-006fbbb7-2b8a-4508-90ec-16b2a515007c Apr 22 18:02:01 devstack sudo[90928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:02:01 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-2c4ea0a8-00fe-40fd-8271-eea7fe85792a tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Lock "cinder-7f0ae989-4db5-433f-8050-b471b212e992-delete_volume" released by "delete_volume" :: held 2.755s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 18:02:01 devstack sudo[90920]: pam_unix(sudo:session): session closed for user root Apr 22 18:02:01 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-f69ef7e0-12af-4c51-a718-4a4908e7d0dd tempest-CreateVolumesFromSnapshotTest-540484731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-1e25fcc7-6d9d-4f6c-b3e0-45fe8898750c 1073741824" returned: 0 in 0.916s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:02:01 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-f69ef7e0-12af-4c51-a718-4a4908e7d0dd tempest-CreateVolumesFromSnapshotTest-540484731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-1e25fcc7-6d9d-4f6c-b3e0-45fe8898750c {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:02:01 devstack sudo[90933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-1e25fcc7-6d9d-4f6c-b3e0-45fe8898750c Apr 22 18:02:01 devstack sudo[90933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:02:01 devstack sudo[90922]: pam_unix(sudo:session): session closed for user root Apr 22 18:02:01 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-1225d22f-c062-40e8-8e6f-89ddd16c9aaf tempest-VolumeDependencyTests-158100058 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-30ad2fa6-823a-48c4-a1d5-951ad2bc78f5" returned: 0 in 0.961s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:02:01 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-1225d22f-c062-40e8-8e6f-89ddd16c9aaf tempest-VolumeDependencyTests-158100058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-30ad2fa6-823a-48c4-a1d5-951ad2bc78f5.720c2c8e-73a4-4b98-8ffb-37cede92e24c {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:02:01 devstack sudo[90935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-30ad2fa6-823a-48c4-a1d5-951ad2bc78f5.720c2c8e-73a4-4b98-8ffb-37cede92e24c Apr 22 18:02:01 devstack sudo[90935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:02:01 devstack sudo[90928]: pam_unix(sudo:session): session closed for user root Apr 22 18:02:01 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-8ad63122-f995-4cb2-a953-e05e3fbcf88d tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-006fbbb7-2b8a-4508-90ec-16b2a515007c" returned: 0 in 0.726s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:02:01 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-8ad63122-f995-4cb2-a953-e05e3fbcf88d tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-006fbbb7-2b8a-4508-90ec-16b2a515007c {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:02:01 devstack sudo[90940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-006fbbb7-2b8a-4508-90ec-16b2a515007c Apr 22 18:02:01 devstack sudo[90940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:02:01 devstack sudo[90933]: pam_unix(sudo:session): session closed for user root Apr 22 18:02:01 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-f69ef7e0-12af-4c51-a718-4a4908e7d0dd tempest-CreateVolumesFromSnapshotTest-540484731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-1e25fcc7-6d9d-4f6c-b3e0-45fe8898750c" returned: 0 in 0.665s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:02:01 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-f69ef7e0-12af-4c51-a718-4a4908e7d0dd tempest-CreateVolumesFromSnapshotTest-540484731 None] <== create_volume: return (1637ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'} {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 18:02:01 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-f69ef7e0-12af-4c51-a718-4a4908e7d0dd tempest-CreateVolumesFromSnapshotTest-540484731 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.648s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 18:02:01 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-85f8680d-e727-4b2a-8428-3e65a05e858a tempest-CreateVolumesFromSnapshotTest-540484731 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 17.290s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 18:02:01 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-85f8680d-e727-4b2a-8428-3e65a05e858a tempest-CreateVolumesFromSnapshotTest-540484731 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T16:01:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2006799664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1f6d355-8b4f-4922-bcbc-f9c26a0f5b64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ad058daf3dd47faa77e8d9cfd2b7b9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T16:01:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T16:01:44Z,use_quota=True,user_id='6cf81a539f0d43779bb0d619864d130a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)}" {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 18:02:01 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-85f8680d-e727-4b2a-8428-3e65a05e858a tempest-CreateVolumesFromSnapshotTest-540484731 None] Creating volume d1f6d355-8b4f-4922-bcbc-f9c26a0f5b64 {{(pid=81771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 18:02:01 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-85f8680d-e727-4b2a-8428-3e65a05e858a tempest-CreateVolumesFromSnapshotTest-540484731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 18:02:01 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-85f8680d-e727-4b2a-8428-3e65a05e858a tempest-CreateVolumesFromSnapshotTest-540484731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 18:02:01 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-85f8680d-e727-4b2a-8428-3e65a05e858a tempest-CreateVolumesFromSnapshotTest-540484731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 18:02:01 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-85f8680d-e727-4b2a-8428-3e65a05e858a tempest-CreateVolumesFromSnapshotTest-540484731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 18:02:01 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-85f8680d-e727-4b2a-8428-3e65a05e858a tempest-CreateVolumesFromSnapshotTest-540484731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 18:02:01 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-85f8680d-e727-4b2a-8428-3e65a05e858a tempest-CreateVolumesFromSnapshotTest-540484731 None] Selected osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 as target Quobyte volume. {{(pid=81771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 18:02:01 devstack cinder-volume[81771]: INFO cinder.volume.drivers.remotefs [None req-85f8680d-e727-4b2a-8428-3e65a05e858a tempest-CreateVolumesFromSnapshotTest-540484731 None] casted to osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 Apr 22 18:02:01 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-85f8680d-e727-4b2a-8428-3e65a05e858a tempest-CreateVolumesFromSnapshotTest-540484731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-d1f6d355-8b4f-4922-bcbc-f9c26a0f5b64 1073741824 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:02:01 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-f69ef7e0-12af-4c51-a718-4a4908e7d0dd tempest-CreateVolumesFromSnapshotTest-540484731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f868fa31-0bc6-4403-b4cf-28ffd69dc11a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e25fcc7-6d9d-4f6c-b3e0-45fe8898750c', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:02:01 devstack sudo[90946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-d1f6d355-8b4f-4922-bcbc-f9c26a0f5b64 1073741824 Apr 22 18:02:02 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-f69ef7e0-12af-4c51-a718-4a4908e7d0dd tempest-CreateVolumesFromSnapshotTest-540484731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ddb4929-834b-4c0a-9f62-2194613671aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:02:02 devstack sudo[90946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:02:02 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-f69ef7e0-12af-4c51-a718-4a4908e7d0dd tempest-CreateVolumesFromSnapshotTest-540484731 None] Volume volume-1e25fcc7-6d9d-4f6c-b3e0-45fe8898750c (1e25fcc7-6d9d-4f6c-b3e0-45fe8898750c): created successfully Apr 22 18:02:02 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-f69ef7e0-12af-4c51-a718-4a4908e7d0dd tempest-CreateVolumesFromSnapshotTest-540484731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ddb4929-834b-4c0a-9f62-2194613671aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:02:02 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-f69ef7e0-12af-4c51-a718-4a4908e7d0dd tempest-CreateVolumesFromSnapshotTest-540484731 None] Flow 'volume_create_manager' (267b71db-6604-4953-a7b2-947668b32305) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 18:02:02 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-f69ef7e0-12af-4c51-a718-4a4908e7d0dd tempest-CreateVolumesFromSnapshotTest-540484731 None] Created volume successfully. Apr 22 18:02:02 devstack sudo[90935]: pam_unix(sudo:session): session closed for user root Apr 22 18:02:02 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-1225d22f-c062-40e8-8e6f-89ddd16c9aaf tempest-VolumeDependencyTests-158100058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-30ad2fa6-823a-48c4-a1d5-951ad2bc78f5.720c2c8e-73a4-4b98-8ffb-37cede92e24c" returned: 0 in 0.802s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:02:02 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-1225d22f-c062-40e8-8e6f-89ddd16c9aaf tempest-VolumeDependencyTests-158100058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-30ad2fa6-823a-48c4-a1d5-951ad2bc78f5.720c2c8e-73a4-4b98-8ffb-37cede92e24c {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:02:02 devstack sudo[90949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-30ad2fa6-823a-48c4-a1d5-951ad2bc78f5.720c2c8e-73a4-4b98-8ffb-37cede92e24c Apr 22 18:02:02 devstack sudo[90949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:02:02 devstack sudo[90940]: pam_unix(sudo:session): session closed for user root Apr 22 18:02:02 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-8ad63122-f995-4cb2-a953-e05e3fbcf88d tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-006fbbb7-2b8a-4508-90ec-16b2a515007c" returned: 0 in 0.596s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:02:02 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-8ad63122-f995-4cb2-a953-e05e3fbcf88d tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Lock "cinder-quobyte-006fbbb7-2b8a-4508-90ec-16b2a515007c" released by "delete_volume" :: held 1.383s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 18:02:02 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-8ad63122-f995-4cb2-a953-e05e3fbcf88d tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Created reservations ['22bf2bfd-3b94-49ec-94f3-e3c05de6f64f', '1c381b3b-eb3f-4a87-bb5b-4c001e933e05', '5034f748-3a5c-4a17-99d4-fba7eba0854d', 'ad5d3830-1dc4-44c7-a520-66086772efdd'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 18:02:02 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-8ad63122-f995-4cb2-a953-e05e3fbcf88d tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 18:02:02 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-8ad63122-f995-4cb2-a953-e05e3fbcf88d tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 18:02:02 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-8ad63122-f995-4cb2-a953-e05e3fbcf88d tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 18:02:02 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-8ad63122-f995-4cb2-a953-e05e3fbcf88d tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 18:02:02 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-8ad63122-f995-4cb2-a953-e05e3fbcf88d tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 18:02:02 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-8ad63122-f995-4cb2-a953-e05e3fbcf88d tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:02:02 devstack sudo[90951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 Apr 22 18:02:02 devstack sudo[90951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:02:02 devstack sudo[90949]: pam_unix(sudo:session): session closed for user root Apr 22 18:02:02 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-1225d22f-c062-40e8-8e6f-89ddd16c9aaf tempest-VolumeDependencyTests-158100058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-30ad2fa6-823a-48c4-a1d5-951ad2bc78f5.720c2c8e-73a4-4b98-8ffb-37cede92e24c" returned: 0 in 0.582s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:02:02 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-1225d22f-c062-40e8-8e6f-89ddd16c9aaf tempest-VolumeDependencyTests-158100058 None] Lock "cinder-quobyte-720c2c8e-73a4-4b98-8ffb-37cede92e24c" released by "_delete_snapshot" :: held 3.232s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 18:02:02 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-1225d22f-c062-40e8-8e6f-89ddd16c9aaf tempest-VolumeDependencyTests-158100058 None] Lock "cinder-quobyte-30ad2fa6-823a-48c4-a1d5-951ad2bc78f5" released by "delete_snapshot" :: held 3.278s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 18:02:02 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-1225d22f-c062-40e8-8e6f-89ddd16c9aaf tempest-VolumeDependencyTests-158100058 None] Created reservations ['d2e48bd5-777c-47d0-9313-d711253c0b92', '064b10eb-566d-4620-823a-90427531db72', '2743b84d-ffa0-4506-b8c2-fa594bcc33fe', '5bed2c22-9546-469d-a481-a791c347fdec'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 18:02:02 devstack sudo[90946]: pam_unix(sudo:session): session closed for user root Apr 22 18:02:02 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-85f8680d-e727-4b2a-8428-3e65a05e858a tempest-CreateVolumesFromSnapshotTest-540484731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-d1f6d355-8b4f-4922-bcbc-f9c26a0f5b64 1073741824" returned: 0 in 0.922s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:02:02 devstack sudo[90951]: pam_unix(sudo:session): session closed for user root Apr 22 18:02:02 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-8ad63122-f995-4cb2-a953-e05e3fbcf88d tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33" returned: 0 in 0.580s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:02:02 devstack cinder-volume[81771]: DEBUG cinder.manager [None req-8ad63122-f995-4cb2-a953-e05e3fbcf88d tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Notifying Schedulers of capabilities ... {{(pid=81771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 18:02:02 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-1225d22f-c062-40e8-8e6f-89ddd16c9aaf tempest-VolumeDependencyTests-158100058 None] Delete snapshot completed successfully. Apr 22 18:02:02 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-85f8680d-e727-4b2a-8428-3e65a05e858a tempest-CreateVolumesFromSnapshotTest-540484731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-d1f6d355-8b4f-4922-bcbc-f9c26a0f5b64 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:02:02 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-8ad63122-f995-4cb2-a953-e05e3fbcf88d tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Deleted volume successfully. Apr 22 18:02:02 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-1225d22f-c062-40e8-8e6f-89ddd16c9aaf tempest-VolumeDependencyTests-158100058 None] Lock "cinder-720c2c8e-73a4-4b98-8ffb-37cede92e24c-delete_snapshot" released by "delete_snapshot" :: held 3.513s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 18:02:02 devstack sudo[90958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-d1f6d355-8b4f-4922-bcbc-f9c26a0f5b64 Apr 22 18:02:03 devstack sudo[90958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:02:03 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-8ad63122-f995-4cb2-a953-e05e3fbcf88d tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Lock "cinder-006fbbb7-2b8a-4508-90ec-16b2a515007c-delete_volume" released by "delete_volume" :: held 2.265s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 18:02:03 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-f396e23c-f570-4a9b-a3a1-9e94b53ca65e tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Acquiring lock "cinder-65691bb2-4668-4f12-8e78-134a22b2fc7b-delete_volume" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 18:02:03 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-f396e23c-f570-4a9b-a3a1-9e94b53ca65e tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Lock "cinder-65691bb2-4668-4f12-8e78-134a22b2fc7b-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 18:02:03 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-f396e23c-f570-4a9b-a3a1-9e94b53ca65e tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Acquiring lock "cinder-quobyte-65691bb2-4668-4f12-8e78-134a22b2fc7b" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 18:02:03 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-f396e23c-f570-4a9b-a3a1-9e94b53ca65e tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Lock "cinder-quobyte-65691bb2-4668-4f12-8e78-134a22b2fc7b" acquired by "delete_volume" :: waited 0.015s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 18:02:03 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[64de627a-bb4b-4f4a-9ac8-0a0d622554c8]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 18:02:03 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-f396e23c-f570-4a9b-a3a1-9e94b53ca65e tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-65691bb2-4668-4f12-8e78-134a22b2fc7b {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:02:03 devstack sudo[90960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-65691bb2-4668-4f12-8e78-134a22b2fc7b Apr 22 18:02:03 devstack sudo[90960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:02:03 devstack sudo[90958]: pam_unix(sudo:session): session closed for user root Apr 22 18:02:03 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-85f8680d-e727-4b2a-8428-3e65a05e858a tempest-CreateVolumesFromSnapshotTest-540484731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-d1f6d355-8b4f-4922-bcbc-f9c26a0f5b64" returned: 0 in 0.584s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:02:03 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-85f8680d-e727-4b2a-8428-3e65a05e858a tempest-CreateVolumesFromSnapshotTest-540484731 None] <== create_volume: return (1609ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'} {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 18:02:03 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-85f8680d-e727-4b2a-8428-3e65a05e858a tempest-CreateVolumesFromSnapshotTest-540484731 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.615s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 18:02:03 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-6dae16bc-0378-4235-b625-00186b4fb2d5 tempest-CreateVolumesFromSnapshotTest-540484731 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 18.557s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 18:02:03 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-6dae16bc-0378-4235-b625-00186b4fb2d5 tempest-CreateVolumesFromSnapshotTest-540484731 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T16:01:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1395117312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0ab3d45-e3ae-4a47-a39e-a50f6ac7e9ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ad058daf3dd47faa77e8d9cfd2b7b9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T16:01:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T16:01:45Z,use_quota=True,user_id='6cf81a539f0d43779bb0d619864d130a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)}" {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 18:02:03 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-6dae16bc-0378-4235-b625-00186b4fb2d5 tempest-CreateVolumesFromSnapshotTest-540484731 None] Creating volume b0ab3d45-e3ae-4a47-a39e-a50f6ac7e9ee {{(pid=81771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 18:02:03 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-6dae16bc-0378-4235-b625-00186b4fb2d5 tempest-CreateVolumesFromSnapshotTest-540484731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 18:02:03 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-6dae16bc-0378-4235-b625-00186b4fb2d5 tempest-CreateVolumesFromSnapshotTest-540484731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 18:02:03 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-6dae16bc-0378-4235-b625-00186b4fb2d5 tempest-CreateVolumesFromSnapshotTest-540484731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 18:02:03 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-6dae16bc-0378-4235-b625-00186b4fb2d5 tempest-CreateVolumesFromSnapshotTest-540484731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 18:02:03 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-6dae16bc-0378-4235-b625-00186b4fb2d5 tempest-CreateVolumesFromSnapshotTest-540484731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 18:02:03 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-6dae16bc-0378-4235-b625-00186b4fb2d5 tempest-CreateVolumesFromSnapshotTest-540484731 None] Selected osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 as target Quobyte volume. {{(pid=81771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 18:02:03 devstack cinder-volume[81771]: INFO cinder.volume.drivers.remotefs [None req-6dae16bc-0378-4235-b625-00186b4fb2d5 tempest-CreateVolumesFromSnapshotTest-540484731 None] casted to osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 Apr 22 18:02:03 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-6dae16bc-0378-4235-b625-00186b4fb2d5 tempest-CreateVolumesFromSnapshotTest-540484731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b0ab3d45-e3ae-4a47-a39e-a50f6ac7e9ee 1073741824 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:02:03 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-85f8680d-e727-4b2a-8428-3e65a05e858a tempest-CreateVolumesFromSnapshotTest-540484731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af556fa9-768f-4cf7-b7b0-1a955b8680c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1f6d355-8b4f-4922-bcbc-f9c26a0f5b64', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:02:03 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-85f8680d-e727-4b2a-8428-3e65a05e858a tempest-CreateVolumesFromSnapshotTest-540484731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92e29448-114f-493b-bcd7-c666b8c00a76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:02:03 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-85f8680d-e727-4b2a-8428-3e65a05e858a tempest-CreateVolumesFromSnapshotTest-540484731 None] Volume volume-d1f6d355-8b4f-4922-bcbc-f9c26a0f5b64 (d1f6d355-8b4f-4922-bcbc-f9c26a0f5b64): created successfully Apr 22 18:02:03 devstack sudo[90963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b0ab3d45-e3ae-4a47-a39e-a50f6ac7e9ee 1073741824 Apr 22 18:02:03 devstack sudo[90963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:02:03 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-85f8680d-e727-4b2a-8428-3e65a05e858a tempest-CreateVolumesFromSnapshotTest-540484731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92e29448-114f-493b-bcd7-c666b8c00a76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:02:03 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-85f8680d-e727-4b2a-8428-3e65a05e858a tempest-CreateVolumesFromSnapshotTest-540484731 None] Flow 'volume_create_manager' (22cedc59-2198-4a6b-b3d5-a68969f270be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 18:02:03 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-85f8680d-e727-4b2a-8428-3e65a05e858a tempest-CreateVolumesFromSnapshotTest-540484731 None] Created volume successfully. Apr 22 18:02:03 devstack sudo[90960]: pam_unix(sudo:session): session closed for user root Apr 22 18:02:03 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-f396e23c-f570-4a9b-a3a1-9e94b53ca65e tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-65691bb2-4668-4f12-8e78-134a22b2fc7b" returned: 0 in 0.620s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:02:03 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-f396e23c-f570-4a9b-a3a1-9e94b53ca65e tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-65691bb2-4668-4f12-8e78-134a22b2fc7b {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:02:03 devstack sudo[90968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-65691bb2-4668-4f12-8e78-134a22b2fc7b Apr 22 18:02:03 devstack sudo[90968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:02:03 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-525293d2-9af6-4ec1-b704-d7d38c1dc0a4 tempest-VolumeDependencyTests-158100058 None] Acquiring lock "cinder-30ad2fa6-823a-48c4-a1d5-951ad2bc78f5-delete_volume" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 18:02:03 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-525293d2-9af6-4ec1-b704-d7d38c1dc0a4 tempest-VolumeDependencyTests-158100058 None] Lock "cinder-30ad2fa6-823a-48c4-a1d5-951ad2bc78f5-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 18:02:03 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-525293d2-9af6-4ec1-b704-d7d38c1dc0a4 tempest-VolumeDependencyTests-158100058 None] Acquiring lock "cinder-quobyte-30ad2fa6-823a-48c4-a1d5-951ad2bc78f5" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 18:02:04 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-525293d2-9af6-4ec1-b704-d7d38c1dc0a4 tempest-VolumeDependencyTests-158100058 None] Lock "cinder-quobyte-30ad2fa6-823a-48c4-a1d5-951ad2bc78f5" acquired by "delete_volume" :: waited 0.093s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 18:02:04 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c0c067a-22e4-4109-890a-ab34c8c2fa31]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 18:02:04 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-525293d2-9af6-4ec1-b704-d7d38c1dc0a4 tempest-VolumeDependencyTests-158100058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-30ad2fa6-823a-48c4-a1d5-951ad2bc78f5 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:02:04 devstack sudo[90972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-30ad2fa6-823a-48c4-a1d5-951ad2bc78f5 Apr 22 18:02:04 devstack sudo[90972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:02:04 devstack sudo[90963]: pam_unix(sudo:session): session closed for user root Apr 22 18:02:04 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-6dae16bc-0378-4235-b625-00186b4fb2d5 tempest-CreateVolumesFromSnapshotTest-540484731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b0ab3d45-e3ae-4a47-a39e-a50f6ac7e9ee 1073741824" returned: 0 in 0.861s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:02:04 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-6dae16bc-0378-4235-b625-00186b4fb2d5 tempest-CreateVolumesFromSnapshotTest-540484731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b0ab3d45-e3ae-4a47-a39e-a50f6ac7e9ee {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:02:04 devstack sudo[90976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b0ab3d45-e3ae-4a47-a39e-a50f6ac7e9ee Apr 22 18:02:04 devstack sudo[90976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:02:04 devstack sudo[90968]: pam_unix(sudo:session): session closed for user root Apr 22 18:02:04 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-f396e23c-f570-4a9b-a3a1-9e94b53ca65e tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-65691bb2-4668-4f12-8e78-134a22b2fc7b" returned: 0 in 0.763s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:02:04 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-f396e23c-f570-4a9b-a3a1-9e94b53ca65e tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Lock "cinder-quobyte-65691bb2-4668-4f12-8e78-134a22b2fc7b" released by "delete_volume" :: held 1.432s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 18:02:04 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-f396e23c-f570-4a9b-a3a1-9e94b53ca65e tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Created reservations ['404e6c85-0318-42b9-8531-319ba1704484', 'c7afb883-f208-4b8d-8386-4bca84de7908', '6942708c-c828-4289-a1fd-4da5be3852b1', 'dfef0253-bd6e-428e-9f43-6a62fae1c569'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 18:02:04 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-f396e23c-f570-4a9b-a3a1-9e94b53ca65e tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 18:02:04 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-f396e23c-f570-4a9b-a3a1-9e94b53ca65e tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 18:02:04 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-f396e23c-f570-4a9b-a3a1-9e94b53ca65e tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 18:02:04 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-f396e23c-f570-4a9b-a3a1-9e94b53ca65e tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 18:02:04 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-f396e23c-f570-4a9b-a3a1-9e94b53ca65e tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 18:02:04 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-f396e23c-f570-4a9b-a3a1-9e94b53ca65e tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:02:04 devstack sudo[90981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 Apr 22 18:02:04 devstack sudo[90981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:02:04 devstack sudo[90972]: pam_unix(sudo:session): session closed for user root Apr 22 18:02:04 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-525293d2-9af6-4ec1-b704-d7d38c1dc0a4 tempest-VolumeDependencyTests-158100058 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-30ad2fa6-823a-48c4-a1d5-951ad2bc78f5" returned: 0 in 0.710s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:02:04 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-525293d2-9af6-4ec1-b704-d7d38c1dc0a4 tempest-VolumeDependencyTests-158100058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-30ad2fa6-823a-48c4-a1d5-951ad2bc78f5 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:02:04 devstack sudo[90983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-30ad2fa6-823a-48c4-a1d5-951ad2bc78f5 Apr 22 18:02:04 devstack sudo[90983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:02:05 devstack sudo[90976]: pam_unix(sudo:session): session closed for user root Apr 22 18:02:05 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-6dae16bc-0378-4235-b625-00186b4fb2d5 tempest-CreateVolumesFromSnapshotTest-540484731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b0ab3d45-e3ae-4a47-a39e-a50f6ac7e9ee" returned: 0 in 0.673s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:02:05 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-6dae16bc-0378-4235-b625-00186b4fb2d5 tempest-CreateVolumesFromSnapshotTest-540484731 None] <== create_volume: return (1580ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'} {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 18:02:05 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-6dae16bc-0378-4235-b625-00186b4fb2d5 tempest-CreateVolumesFromSnapshotTest-540484731 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.585s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 18:02:05 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-7a277f8e-99d3-496a-9451-f7b917c82d37 tempest-CreateVolumesFromSnapshotTest-540484731 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 19.940s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 18:02:05 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-7a277f8e-99d3-496a-9451-f7b917c82d37 tempest-CreateVolumesFromSnapshotTest-540484731 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T16:01:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2015773355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c9f6a25-8568-4c1c-abec-4d2054d11971,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ad058daf3dd47faa77e8d9cfd2b7b9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T16:01:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T16:01:45Z,use_quota=True,user_id='6cf81a539f0d43779bb0d619864d130a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)}" {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 18:02:05 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-7a277f8e-99d3-496a-9451-f7b917c82d37 tempest-CreateVolumesFromSnapshotTest-540484731 None] Creating volume 5c9f6a25-8568-4c1c-abec-4d2054d11971 {{(pid=81771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 18:02:05 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-7a277f8e-99d3-496a-9451-f7b917c82d37 tempest-CreateVolumesFromSnapshotTest-540484731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 18:02:05 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-7a277f8e-99d3-496a-9451-f7b917c82d37 tempest-CreateVolumesFromSnapshotTest-540484731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 18:02:05 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-7a277f8e-99d3-496a-9451-f7b917c82d37 tempest-CreateVolumesFromSnapshotTest-540484731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 18:02:05 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-7a277f8e-99d3-496a-9451-f7b917c82d37 tempest-CreateVolumesFromSnapshotTest-540484731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 18:02:05 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-7a277f8e-99d3-496a-9451-f7b917c82d37 tempest-CreateVolumesFromSnapshotTest-540484731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 18:02:05 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-7a277f8e-99d3-496a-9451-f7b917c82d37 tempest-CreateVolumesFromSnapshotTest-540484731 None] Selected osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 as target Quobyte volume. {{(pid=81771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 18:02:05 devstack cinder-volume[81771]: INFO cinder.volume.drivers.remotefs [None req-7a277f8e-99d3-496a-9451-f7b917c82d37 tempest-CreateVolumesFromSnapshotTest-540484731 None] casted to osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 Apr 22 18:02:05 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-7a277f8e-99d3-496a-9451-f7b917c82d37 tempest-CreateVolumesFromSnapshotTest-540484731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-5c9f6a25-8568-4c1c-abec-4d2054d11971 1073741824 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:02:05 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-6dae16bc-0378-4235-b625-00186b4fb2d5 tempest-CreateVolumesFromSnapshotTest-540484731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56e6ac99-8695-4ac6-9f9f-85bfb3db0ff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0ab3d45-e3ae-4a47-a39e-a50f6ac7e9ee', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:02:05 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-6dae16bc-0378-4235-b625-00186b4fb2d5 tempest-CreateVolumesFromSnapshotTest-540484731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (350dba11-bb35-43c1-8365-292afe2d0c95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:02:05 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-6dae16bc-0378-4235-b625-00186b4fb2d5 tempest-CreateVolumesFromSnapshotTest-540484731 None] Volume volume-b0ab3d45-e3ae-4a47-a39e-a50f6ac7e9ee (b0ab3d45-e3ae-4a47-a39e-a50f6ac7e9ee): created successfully Apr 22 18:02:05 devstack sudo[90986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-5c9f6a25-8568-4c1c-abec-4d2054d11971 1073741824 Apr 22 18:02:05 devstack sudo[90986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:02:05 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-6dae16bc-0378-4235-b625-00186b4fb2d5 tempest-CreateVolumesFromSnapshotTest-540484731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (350dba11-bb35-43c1-8365-292afe2d0c95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:02:05 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-6dae16bc-0378-4235-b625-00186b4fb2d5 tempest-CreateVolumesFromSnapshotTest-540484731 None] Flow 'volume_create_manager' (d2d6901f-7a4a-4fd6-b936-c5bd7175e8cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 18:02:05 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-6dae16bc-0378-4235-b625-00186b4fb2d5 tempest-CreateVolumesFromSnapshotTest-540484731 None] Created volume successfully. Apr 22 18:02:05 devstack sudo[90981]: pam_unix(sudo:session): session closed for user root Apr 22 18:02:05 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-f396e23c-f570-4a9b-a3a1-9e94b53ca65e tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33" returned: 0 in 0.690s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:02:05 devstack cinder-volume[81771]: DEBUG cinder.manager [None req-f396e23c-f570-4a9b-a3a1-9e94b53ca65e tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Notifying Schedulers of capabilities ... {{(pid=81771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 18:02:05 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-f396e23c-f570-4a9b-a3a1-9e94b53ca65e tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Deleted volume successfully. Apr 22 18:02:05 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-f396e23c-f570-4a9b-a3a1-9e94b53ca65e tempest-CreateVolumesFromSourceVolumeTest-1436531336 None] Lock "cinder-65691bb2-4668-4f12-8e78-134a22b2fc7b-delete_volume" released by "delete_volume" :: held 2.365s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 18:02:05 devstack sudo[90983]: pam_unix(sudo:session): session closed for user root Apr 22 18:02:05 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-525293d2-9af6-4ec1-b704-d7d38c1dc0a4 tempest-VolumeDependencyTests-158100058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-30ad2fa6-823a-48c4-a1d5-951ad2bc78f5" returned: 0 in 0.723s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:02:05 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-525293d2-9af6-4ec1-b704-d7d38c1dc0a4 tempest-VolumeDependencyTests-158100058 None] Lock "cinder-quobyte-30ad2fa6-823a-48c4-a1d5-951ad2bc78f5" released by "delete_volume" :: held 1.528s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 18:02:05 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-525293d2-9af6-4ec1-b704-d7d38c1dc0a4 tempest-VolumeDependencyTests-158100058 None] Created reservations ['9ef4aabd-7174-4c2d-a63e-f464d8d4fbd1', 'f03a9d77-732f-494b-a79c-c7ebdc935b89', '877183fe-8c91-41ac-be9f-7b756a00a1c5', 'b6272b54-be5e-4d7b-980e-8f6c7b1b808d'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 18:02:05 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-525293d2-9af6-4ec1-b704-d7d38c1dc0a4 tempest-VolumeDependencyTests-158100058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 18:02:05 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-525293d2-9af6-4ec1-b704-d7d38c1dc0a4 tempest-VolumeDependencyTests-158100058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 18:02:05 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-525293d2-9af6-4ec1-b704-d7d38c1dc0a4 tempest-VolumeDependencyTests-158100058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 18:02:05 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-525293d2-9af6-4ec1-b704-d7d38c1dc0a4 tempest-VolumeDependencyTests-158100058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 18:02:05 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-525293d2-9af6-4ec1-b704-d7d38c1dc0a4 tempest-VolumeDependencyTests-158100058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 18:02:05 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-525293d2-9af6-4ec1-b704-d7d38c1dc0a4 tempest-VolumeDependencyTests-158100058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:02:05 devstack sudo[90990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 Apr 22 18:02:05 devstack sudo[90990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:02:06 devstack sudo[90986]: pam_unix(sudo:session): session closed for user root Apr 22 18:02:06 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-7a277f8e-99d3-496a-9451-f7b917c82d37 tempest-CreateVolumesFromSnapshotTest-540484731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-5c9f6a25-8568-4c1c-abec-4d2054d11971 1073741824" returned: 0 in 0.923s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:02:06 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-7a277f8e-99d3-496a-9451-f7b917c82d37 tempest-CreateVolumesFromSnapshotTest-540484731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-5c9f6a25-8568-4c1c-abec-4d2054d11971 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:02:06 devstack sudo[90995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-5c9f6a25-8568-4c1c-abec-4d2054d11971 Apr 22 18:02:06 devstack sudo[90995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:02:06 devstack sudo[90990]: pam_unix(sudo:session): session closed for user root Apr 22 18:02:06 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-525293d2-9af6-4ec1-b704-d7d38c1dc0a4 tempest-VolumeDependencyTests-158100058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33" returned: 0 in 0.758s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:02:06 devstack cinder-volume[81771]: DEBUG cinder.manager [None req-525293d2-9af6-4ec1-b704-d7d38c1dc0a4 tempest-VolumeDependencyTests-158100058 None] Notifying Schedulers of capabilities ... {{(pid=81771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 18:02:06 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-525293d2-9af6-4ec1-b704-d7d38c1dc0a4 tempest-VolumeDependencyTests-158100058 None] Deleted volume successfully. Apr 22 18:02:06 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-525293d2-9af6-4ec1-b704-d7d38c1dc0a4 tempest-VolumeDependencyTests-158100058 None] Lock "cinder-30ad2fa6-823a-48c4-a1d5-951ad2bc78f5-delete_volume" released by "delete_volume" :: held 2.621s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 18:02:06 devstack cinder-volume[81771]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c119ca4-10c5-4d68-80eb-a22b8aba2a59 tempest-VolumeDependencyTests-158100058 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 18:02:06 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-9c119ca4-10c5-4d68-80eb-a22b8aba2a59 tempest-VolumeDependencyTests-158100058 None] Flow 'volume_create_manager' (d1d44712-efd0-44c9-ae8f-0336ee87b290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 18:02:06 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-9c119ca4-10c5-4d68-80eb-a22b8aba2a59 tempest-VolumeDependencyTests-158100058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf86f3f3-c33b-4e1f-93d3-6d5c5f34852f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:02:06 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-9c119ca4-10c5-4d68-80eb-a22b8aba2a59 tempest-VolumeDependencyTests-158100058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf86f3f3-c33b-4e1f-93d3-6d5c5f34852f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T16:02:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-466483816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6cf00cd-388a-49f5-9288-d5cc8adc54ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='536299bc187146e6aafa6018c45d2513',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T16:02:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T16:02:07Z,use_quota=True,user_id='4f97ef6588be415596a71e15e94c99cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:02:06 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-9c119ca4-10c5-4d68-80eb-a22b8aba2a59 tempest-VolumeDependencyTests-158100058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16fc08f2-0f0f-424f-8d23-2d004c19a0ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:02:06 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-9c119ca4-10c5-4d68-80eb-a22b8aba2a59 tempest-VolumeDependencyTests-158100058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16fc08f2-0f0f-424f-8d23-2d004c19a0ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:02:06 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-9c119ca4-10c5-4d68-80eb-a22b8aba2a59 tempest-VolumeDependencyTests-158100058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42bec4b5-faf3-456d-8fd2-a1976096950e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:02:06 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-9c119ca4-10c5-4d68-80eb-a22b8aba2a59 tempest-VolumeDependencyTests-158100058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42bec4b5-faf3-456d-8fd2-a1976096950e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6cf00cd-388a-49f5-9288-d5cc8adc54ec', 'volume_name': 'volume-f6cf00cd-388a-49f5-9288-d5cc8adc54ec', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:02:06 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-9c119ca4-10c5-4d68-80eb-a22b8aba2a59 tempest-VolumeDependencyTests-158100058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16e85659-6bf9-4d6a-bb45-809f80a468a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:02:06 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-9c119ca4-10c5-4d68-80eb-a22b8aba2a59 tempest-VolumeDependencyTests-158100058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16e85659-6bf9-4d6a-bb45-809f80a468a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:02:06 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-9c119ca4-10c5-4d68-80eb-a22b8aba2a59 tempest-VolumeDependencyTests-158100058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (379e03ee-a14f-4c23-a00a-1a2e510acc50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:02:06 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-9c119ca4-10c5-4d68-80eb-a22b8aba2a59 tempest-VolumeDependencyTests-158100058 None] Volume f6cf00cd-388a-49f5-9288-d5cc8adc54ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6cf00cd-388a-49f5-9288-d5cc8adc54ec', 'volume_size': 1} Apr 22 18:02:06 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-9c119ca4-10c5-4d68-80eb-a22b8aba2a59 tempest-VolumeDependencyTests-158100058 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 18:02:06 devstack sudo[90995]: pam_unix(sudo:session): session closed for user root Apr 22 18:02:06 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-7a277f8e-99d3-496a-9451-f7b917c82d37 tempest-CreateVolumesFromSnapshotTest-540484731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-5c9f6a25-8568-4c1c-abec-4d2054d11971" returned: 0 in 0.728s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:02:06 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-7a277f8e-99d3-496a-9451-f7b917c82d37 tempest-CreateVolumesFromSnapshotTest-540484731 None] <== create_volume: return (1703ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'} {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 18:02:06 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-7a277f8e-99d3-496a-9451-f7b917c82d37 tempest-CreateVolumesFromSnapshotTest-540484731 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.707s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 18:02:06 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-9c119ca4-10c5-4d68-80eb-a22b8aba2a59 tempest-VolumeDependencyTests-158100058 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.011s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 18:02:06 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-9c119ca4-10c5-4d68-80eb-a22b8aba2a59 tempest-VolumeDependencyTests-158100058 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T16:02:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-466483816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6cf00cd-388a-49f5-9288-d5cc8adc54ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='536299bc187146e6aafa6018c45d2513',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T16:02:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T16:02:07Z,use_quota=True,user_id='4f97ef6588be415596a71e15e94c99cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)}" {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 18:02:06 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-9c119ca4-10c5-4d68-80eb-a22b8aba2a59 tempest-VolumeDependencyTests-158100058 None] Creating volume f6cf00cd-388a-49f5-9288-d5cc8adc54ec {{(pid=81771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 18:02:06 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-9c119ca4-10c5-4d68-80eb-a22b8aba2a59 tempest-VolumeDependencyTests-158100058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 18:02:06 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-9c119ca4-10c5-4d68-80eb-a22b8aba2a59 tempest-VolumeDependencyTests-158100058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 18:02:06 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-9c119ca4-10c5-4d68-80eb-a22b8aba2a59 tempest-VolumeDependencyTests-158100058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 18:02:06 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-9c119ca4-10c5-4d68-80eb-a22b8aba2a59 tempest-VolumeDependencyTests-158100058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 18:02:06 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-9c119ca4-10c5-4d68-80eb-a22b8aba2a59 tempest-VolumeDependencyTests-158100058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 18:02:06 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-9c119ca4-10c5-4d68-80eb-a22b8aba2a59 tempest-VolumeDependencyTests-158100058 None] Selected osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 as target Quobyte volume. {{(pid=81771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 18:02:06 devstack cinder-volume[81771]: INFO cinder.volume.drivers.remotefs [None req-9c119ca4-10c5-4d68-80eb-a22b8aba2a59 tempest-VolumeDependencyTests-158100058 None] casted to osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 Apr 22 18:02:06 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-9c119ca4-10c5-4d68-80eb-a22b8aba2a59 tempest-VolumeDependencyTests-158100058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-f6cf00cd-388a-49f5-9288-d5cc8adc54ec 1073741824 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:02:06 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-7a277f8e-99d3-496a-9451-f7b917c82d37 tempest-CreateVolumesFromSnapshotTest-540484731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65fe9af8-43ba-4666-b738-0e7406848144) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c9f6a25-8568-4c1c-abec-4d2054d11971', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:02:06 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-7a277f8e-99d3-496a-9451-f7b917c82d37 tempest-CreateVolumesFromSnapshotTest-540484731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68234510-bee4-4c1d-94f0-260d0cced37a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:02:06 devstack sudo[91000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-f6cf00cd-388a-49f5-9288-d5cc8adc54ec 1073741824 Apr 22 18:02:06 devstack sudo[91000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:02:06 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-7a277f8e-99d3-496a-9451-f7b917c82d37 tempest-CreateVolumesFromSnapshotTest-540484731 None] Volume volume-5c9f6a25-8568-4c1c-abec-4d2054d11971 (5c9f6a25-8568-4c1c-abec-4d2054d11971): created successfully Apr 22 18:02:06 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-7a277f8e-99d3-496a-9451-f7b917c82d37 tempest-CreateVolumesFromSnapshotTest-540484731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68234510-bee4-4c1d-94f0-260d0cced37a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:02:06 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-7a277f8e-99d3-496a-9451-f7b917c82d37 tempest-CreateVolumesFromSnapshotTest-540484731 None] Flow 'volume_create_manager' (1ed9b341-386e-4778-bf30-20d95d6e835a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 18:02:06 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-7a277f8e-99d3-496a-9451-f7b917c82d37 tempest-CreateVolumesFromSnapshotTest-540484731 None] Created volume successfully. Apr 22 18:02:07 devstack sudo[91000]: pam_unix(sudo:session): session closed for user root Apr 22 18:02:07 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-9c119ca4-10c5-4d68-80eb-a22b8aba2a59 tempest-VolumeDependencyTests-158100058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-f6cf00cd-388a-49f5-9288-d5cc8adc54ec 1073741824" returned: 0 in 0.821s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:02:07 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-fbb566a6-2e1c-4d1e-bdea-c1632253618a tempest-CreateVolumesFromSnapshotTest-540484731 None] Acquiring lock "cinder-5c9f6a25-8568-4c1c-abec-4d2054d11971-delete_volume" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 18:02:07 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-fbb566a6-2e1c-4d1e-bdea-c1632253618a tempest-CreateVolumesFromSnapshotTest-540484731 None] Lock "cinder-5c9f6a25-8568-4c1c-abec-4d2054d11971-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 18:02:07 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-9c119ca4-10c5-4d68-80eb-a22b8aba2a59 tempest-VolumeDependencyTests-158100058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-f6cf00cd-388a-49f5-9288-d5cc8adc54ec {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:02:07 devstack sudo[91006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-f6cf00cd-388a-49f5-9288-d5cc8adc54ec Apr 22 18:02:07 devstack sudo[91006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:02:07 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-fbb566a6-2e1c-4d1e-bdea-c1632253618a tempest-CreateVolumesFromSnapshotTest-540484731 None] Acquiring lock "cinder-quobyte-5c9f6a25-8568-4c1c-abec-4d2054d11971" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 18:02:07 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-fbb566a6-2e1c-4d1e-bdea-c1632253618a tempest-CreateVolumesFromSnapshotTest-540484731 None] Lock "cinder-quobyte-5c9f6a25-8568-4c1c-abec-4d2054d11971" acquired by "delete_volume" :: waited 0.021s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 18:02:07 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5f89bcb-821f-4a6d-bb90-9cfd7e63b36c]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 18:02:07 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-fbb566a6-2e1c-4d1e-bdea-c1632253618a tempest-CreateVolumesFromSnapshotTest-540484731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-5c9f6a25-8568-4c1c-abec-4d2054d11971 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:02:07 devstack sudo[91008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-5c9f6a25-8568-4c1c-abec-4d2054d11971 Apr 22 18:02:07 devstack sudo[91008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:02:08 devstack sudo[91006]: pam_unix(sudo:session): session closed for user root Apr 22 18:02:08 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-9c119ca4-10c5-4d68-80eb-a22b8aba2a59 tempest-VolumeDependencyTests-158100058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-f6cf00cd-388a-49f5-9288-d5cc8adc54ec" returned: 0 in 0.639s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:02:08 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-9c119ca4-10c5-4d68-80eb-a22b8aba2a59 tempest-VolumeDependencyTests-158100058 None] <== create_volume: return (1583ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'} {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 18:02:08 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-9c119ca4-10c5-4d68-80eb-a22b8aba2a59 tempest-VolumeDependencyTests-158100058 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.586s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 18:02:08 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-9c119ca4-10c5-4d68-80eb-a22b8aba2a59 tempest-VolumeDependencyTests-158100058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (379e03ee-a14f-4c23-a00a-1a2e510acc50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6cf00cd-388a-49f5-9288-d5cc8adc54ec', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:02:08 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-9c119ca4-10c5-4d68-80eb-a22b8aba2a59 tempest-VolumeDependencyTests-158100058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b72e6a5c-016a-428d-bb71-816b8db88364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:02:08 devstack sudo[91008]: pam_unix(sudo:session): session closed for user root Apr 22 18:02:08 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-fbb566a6-2e1c-4d1e-bdea-c1632253618a tempest-CreateVolumesFromSnapshotTest-540484731 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-5c9f6a25-8568-4c1c-abec-4d2054d11971" returned: 0 in 0.589s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:02:08 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-fbb566a6-2e1c-4d1e-bdea-c1632253618a tempest-CreateVolumesFromSnapshotTest-540484731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-5c9f6a25-8568-4c1c-abec-4d2054d11971 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:02:08 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-9c119ca4-10c5-4d68-80eb-a22b8aba2a59 tempest-VolumeDependencyTests-158100058 None] Volume volume-f6cf00cd-388a-49f5-9288-d5cc8adc54ec (f6cf00cd-388a-49f5-9288-d5cc8adc54ec): created successfully Apr 22 18:02:08 devstack sudo[91014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-5c9f6a25-8568-4c1c-abec-4d2054d11971 Apr 22 18:02:08 devstack sudo[91014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:02:08 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-9c119ca4-10c5-4d68-80eb-a22b8aba2a59 tempest-VolumeDependencyTests-158100058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b72e6a5c-016a-428d-bb71-816b8db88364) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:02:08 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-9c119ca4-10c5-4d68-80eb-a22b8aba2a59 tempest-VolumeDependencyTests-158100058 None] Flow 'volume_create_manager' (d1d44712-efd0-44c9-ae8f-0336ee87b290) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 18:02:08 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-9c119ca4-10c5-4d68-80eb-a22b8aba2a59 tempest-VolumeDependencyTests-158100058 None] Created volume successfully. Apr 22 18:02:08 devstack cinder-volume[81771]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b6be3db-f8c6-49ce-bcf2-95865c67004d tempest-CinderUnicodeTest-850776731 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 18:02:08 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-7b6be3db-f8c6-49ce-bcf2-95865c67004d tempest-CinderUnicodeTest-850776731 None] Flow 'volume_create_manager' (51a634b8-62f1-4e33-82be-cb54ca96c1cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 18:02:08 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-7b6be3db-f8c6-49ce-bcf2-95865c67004d tempest-CinderUnicodeTest-850776731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f45d6d4-7f3b-44fb-981b-967bb369cad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:02:08 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-7b6be3db-f8c6-49ce-bcf2-95865c67004d tempest-CinderUnicodeTest-850776731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f45d6d4-7f3b-44fb-981b-967bb369cad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T16:02:08Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3c80a94-66b5-4e24-8d3d-d6822299c6f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9a5be7b15154149bbe2c5834561f81e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T16:02:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T16:02:09Z,use_quota=True,user_id='e70be7585b534362abf047d85f39ccd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:02:08 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-7b6be3db-f8c6-49ce-bcf2-95865c67004d tempest-CinderUnicodeTest-850776731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0f83698-6c7e-4aab-a690-507a020c4ead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:02:08 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-7b6be3db-f8c6-49ce-bcf2-95865c67004d tempest-CinderUnicodeTest-850776731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0f83698-6c7e-4aab-a690-507a020c4ead) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:02:08 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-7b6be3db-f8c6-49ce-bcf2-95865c67004d tempest-CinderUnicodeTest-850776731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a622708d-aac9-4f08-8a82-282aa4158d4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:02:08 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-7b6be3db-f8c6-49ce-bcf2-95865c67004d tempest-CinderUnicodeTest-850776731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a622708d-aac9-4f08-8a82-282aa4158d4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3c80a94-66b5-4e24-8d3d-d6822299c6f5', 'volume_name': 'volume-e3c80a94-66b5-4e24-8d3d-d6822299c6f5', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:02:08 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-7b6be3db-f8c6-49ce-bcf2-95865c67004d tempest-CinderUnicodeTest-850776731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13a34af0-930b-435f-bb6b-b022f8af51dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:02:08 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-7b6be3db-f8c6-49ce-bcf2-95865c67004d tempest-CinderUnicodeTest-850776731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13a34af0-930b-435f-bb6b-b022f8af51dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:02:08 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-7b6be3db-f8c6-49ce-bcf2-95865c67004d tempest-CinderUnicodeTest-850776731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c1f438e-f3d4-4eaa-bacd-a0a9a768c92b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:02:08 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-7b6be3db-f8c6-49ce-bcf2-95865c67004d tempest-CinderUnicodeTest-850776731 None] Volume e3c80a94-66b5-4e24-8d3d-d6822299c6f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3c80a94-66b5-4e24-8d3d-d6822299c6f5', 'volume_size': 1} Apr 22 18:02:08 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-7b6be3db-f8c6-49ce-bcf2-95865c67004d tempest-CinderUnicodeTest-850776731 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 18:02:08 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-7b6be3db-f8c6-49ce-bcf2-95865c67004d tempest-CinderUnicodeTest-850776731 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 18:02:08 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-7b6be3db-f8c6-49ce-bcf2-95865c67004d tempest-CinderUnicodeTest-850776731 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T16:02:08Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3c80a94-66b5-4e24-8d3d-d6822299c6f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9a5be7b15154149bbe2c5834561f81e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T16:02:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T16:02:09Z,use_quota=True,user_id='e70be7585b534362abf047d85f39ccd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)}" {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 18:02:08 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-7b6be3db-f8c6-49ce-bcf2-95865c67004d tempest-CinderUnicodeTest-850776731 None] Creating volume e3c80a94-66b5-4e24-8d3d-d6822299c6f5 {{(pid=81771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 18:02:08 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-7b6be3db-f8c6-49ce-bcf2-95865c67004d tempest-CinderUnicodeTest-850776731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 18:02:08 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-7b6be3db-f8c6-49ce-bcf2-95865c67004d tempest-CinderUnicodeTest-850776731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 18:02:08 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-7b6be3db-f8c6-49ce-bcf2-95865c67004d tempest-CinderUnicodeTest-850776731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 18:02:08 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-7b6be3db-f8c6-49ce-bcf2-95865c67004d tempest-CinderUnicodeTest-850776731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 18:02:08 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-7b6be3db-f8c6-49ce-bcf2-95865c67004d tempest-CinderUnicodeTest-850776731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 18:02:08 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-7b6be3db-f8c6-49ce-bcf2-95865c67004d tempest-CinderUnicodeTest-850776731 None] Selected osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 as target Quobyte volume. {{(pid=81771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 18:02:08 devstack cinder-volume[81771]: INFO cinder.volume.drivers.remotefs [None req-7b6be3db-f8c6-49ce-bcf2-95865c67004d tempest-CinderUnicodeTest-850776731 None] casted to osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 Apr 22 18:02:08 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-7b6be3db-f8c6-49ce-bcf2-95865c67004d tempest-CinderUnicodeTest-850776731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e3c80a94-66b5-4e24-8d3d-d6822299c6f5 1073741824 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:02:08 devstack sudo[91016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e3c80a94-66b5-4e24-8d3d-d6822299c6f5 1073741824 Apr 22 18:02:08 devstack sudo[91016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:02:08 devstack sudo[91014]: pam_unix(sudo:session): session closed for user root Apr 22 18:02:08 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-fbb566a6-2e1c-4d1e-bdea-c1632253618a tempest-CreateVolumesFromSnapshotTest-540484731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-5c9f6a25-8568-4c1c-abec-4d2054d11971" returned: 0 in 0.534s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:02:09 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-fbb566a6-2e1c-4d1e-bdea-c1632253618a tempest-CreateVolumesFromSnapshotTest-540484731 None] Lock "cinder-quobyte-5c9f6a25-8568-4c1c-abec-4d2054d11971" released by "delete_volume" :: held 1.170s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 18:02:09 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-fbb566a6-2e1c-4d1e-bdea-c1632253618a tempest-CreateVolumesFromSnapshotTest-540484731 None] Created reservations ['4d94ebb5-1228-47ed-ba1d-46518213c0b6', '2841d559-9abb-4a3b-9f47-db7c6f8107b9', '5007384c-75ce-4c32-ac76-e8e8bf3f1bf4', '76798255-65bd-4045-bf3f-fd1f2590be32'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 18:02:09 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-fbb566a6-2e1c-4d1e-bdea-c1632253618a tempest-CreateVolumesFromSnapshotTest-540484731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 18:02:09 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-fbb566a6-2e1c-4d1e-bdea-c1632253618a tempest-CreateVolumesFromSnapshotTest-540484731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 18:02:09 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-fbb566a6-2e1c-4d1e-bdea-c1632253618a tempest-CreateVolumesFromSnapshotTest-540484731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 18:02:09 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-fbb566a6-2e1c-4d1e-bdea-c1632253618a tempest-CreateVolumesFromSnapshotTest-540484731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 18:02:09 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-fbb566a6-2e1c-4d1e-bdea-c1632253618a tempest-CreateVolumesFromSnapshotTest-540484731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 18:02:09 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-fbb566a6-2e1c-4d1e-bdea-c1632253618a tempest-CreateVolumesFromSnapshotTest-540484731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:02:09 devstack sudo[91019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 Apr 22 18:02:09 devstack sudo[91019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:02:09 devstack cinder-volume[81771]: DEBUG cinder.volume.flows.manager.create_volume [None req-21d55fd3-2773-4ecf-839f-b27d36fc254e tempest-VolumeDependencyTests-158100058 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 18:02:09 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-21d55fd3-2773-4ecf-839f-b27d36fc254e tempest-VolumeDependencyTests-158100058 None] Flow 'volume_create_manager' (8ae6bdca-7e39-4582-8765-810af652a6fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 18:02:09 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-21d55fd3-2773-4ecf-839f-b27d36fc254e tempest-VolumeDependencyTests-158100058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eda0f36f-1e8e-4fe9-bbd1-0d765840aa78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:02:09 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-21d55fd3-2773-4ecf-839f-b27d36fc254e tempest-VolumeDependencyTests-158100058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eda0f36f-1e8e-4fe9-bbd1-0d765840aa78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T16:02:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1532080748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cb247d9-2766-4800-bc49-8d671ed7f1e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='536299bc187146e6aafa6018c45d2513',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T16:02:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=f6cf00cd-388a-49f5-9288-d5cc8adc54ec,status='creating',terminated_at=None,updated_at=2026-04-22T16:02:09Z,use_quota=True,user_id='4f97ef6588be415596a71e15e94c99cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:02:09 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-21d55fd3-2773-4ecf-839f-b27d36fc254e tempest-VolumeDependencyTests-158100058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c307f214-da06-4d72-a2cf-e44ed521bdbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:02:09 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-21d55fd3-2773-4ecf-839f-b27d36fc254e tempest-VolumeDependencyTests-158100058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c307f214-da06-4d72-a2cf-e44ed521bdbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:02:09 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-21d55fd3-2773-4ecf-839f-b27d36fc254e tempest-VolumeDependencyTests-158100058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ab1ea29-e8ed-4954-b1b9-f56c0d472d9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:02:09 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-21d55fd3-2773-4ecf-839f-b27d36fc254e tempest-VolumeDependencyTests-158100058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ab1ea29-e8ed-4954-b1b9-f56c0d472d9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '9cb247d9-2766-4800-bc49-8d671ed7f1e2', 'volume_name': 'volume-9cb247d9-2766-4800-bc49-8d671ed7f1e2', 'volume_size': 1, 'source_volid': 'f6cf00cd-388a-49f5-9288-d5cc8adc54ec', 'source_volstatus': 'available'}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:02:09 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-21d55fd3-2773-4ecf-839f-b27d36fc254e tempest-VolumeDependencyTests-158100058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93254939-34cc-4322-9dcb-161cb395346b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:02:09 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-21d55fd3-2773-4ecf-839f-b27d36fc254e tempest-VolumeDependencyTests-158100058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93254939-34cc-4322-9dcb-161cb395346b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:02:09 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-21d55fd3-2773-4ecf-839f-b27d36fc254e tempest-VolumeDependencyTests-158100058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f38a8a9-6446-49d5-9770-c6d5f4f76834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:02:09 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-21d55fd3-2773-4ecf-839f-b27d36fc254e tempest-VolumeDependencyTests-158100058 None] Volume 9cb247d9-2766-4800-bc49-8d671ed7f1e2: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-9cb247d9-2766-4800-bc49-8d671ed7f1e2', 'volume_size': 1, 'source_volid': 'f6cf00cd-388a-49f5-9288-d5cc8adc54ec', 'source_volstatus': 'available'} Apr 22 18:02:09 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-21d55fd3-2773-4ecf-839f-b27d36fc254e tempest-VolumeDependencyTests-158100058 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 18:02:09 devstack sudo[91016]: pam_unix(sudo:session): session closed for user root Apr 22 18:02:09 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-7b6be3db-f8c6-49ce-bcf2-95865c67004d tempest-CinderUnicodeTest-850776731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e3c80a94-66b5-4e24-8d3d-d6822299c6f5 1073741824" returned: 0 in 0.924s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:02:09 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-7b6be3db-f8c6-49ce-bcf2-95865c67004d tempest-CinderUnicodeTest-850776731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e3c80a94-66b5-4e24-8d3d-d6822299c6f5 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:02:09 devstack sudo[91024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e3c80a94-66b5-4e24-8d3d-d6822299c6f5 Apr 22 18:02:09 devstack sudo[91024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:02:09 devstack sudo[91019]: pam_unix(sudo:session): session closed for user root Apr 22 18:02:09 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-fbb566a6-2e1c-4d1e-bdea-c1632253618a tempest-CreateVolumesFromSnapshotTest-540484731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33" returned: 0 in 0.653s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:02:09 devstack cinder-volume[81771]: DEBUG cinder.manager [None req-fbb566a6-2e1c-4d1e-bdea-c1632253618a tempest-CreateVolumesFromSnapshotTest-540484731 None] Notifying Schedulers of capabilities ... {{(pid=81771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 18:02:09 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-fbb566a6-2e1c-4d1e-bdea-c1632253618a tempest-CreateVolumesFromSnapshotTest-540484731 None] Deleted volume successfully. Apr 22 18:02:09 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-fbb566a6-2e1c-4d1e-bdea-c1632253618a tempest-CreateVolumesFromSnapshotTest-540484731 None] Lock "cinder-5c9f6a25-8568-4c1c-abec-4d2054d11971-delete_volume" released by "delete_volume" :: held 2.073s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 18:02:10 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-15bd618d-a86e-414a-8465-0e1b0e52941b tempest-CreateVolumesFromSnapshotTest-540484731 None] Acquiring lock "cinder-b0ab3d45-e3ae-4a47-a39e-a50f6ac7e9ee-delete_volume" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 18:02:10 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-15bd618d-a86e-414a-8465-0e1b0e52941b tempest-CreateVolumesFromSnapshotTest-540484731 None] Lock "cinder-b0ab3d45-e3ae-4a47-a39e-a50f6ac7e9ee-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 18:02:10 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-15bd618d-a86e-414a-8465-0e1b0e52941b tempest-CreateVolumesFromSnapshotTest-540484731 None] Acquiring lock "cinder-quobyte-b0ab3d45-e3ae-4a47-a39e-a50f6ac7e9ee" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 18:02:10 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-15bd618d-a86e-414a-8465-0e1b0e52941b tempest-CreateVolumesFromSnapshotTest-540484731 None] Lock "cinder-quobyte-b0ab3d45-e3ae-4a47-a39e-a50f6ac7e9ee" acquired by "delete_volume" :: waited 0.016s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 18:02:10 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a011ad5-7999-401b-bef9-fcf1e7f1878e]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 18:02:10 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-15bd618d-a86e-414a-8465-0e1b0e52941b tempest-CreateVolumesFromSnapshotTest-540484731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b0ab3d45-e3ae-4a47-a39e-a50f6ac7e9ee {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:02:10 devstack sudo[91024]: pam_unix(sudo:session): session closed for user root Apr 22 18:02:10 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-7b6be3db-f8c6-49ce-bcf2-95865c67004d tempest-CinderUnicodeTest-850776731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e3c80a94-66b5-4e24-8d3d-d6822299c6f5" returned: 0 in 0.579s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:02:10 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-7b6be3db-f8c6-49ce-bcf2-95865c67004d tempest-CinderUnicodeTest-850776731 None] <== create_volume: return (1541ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'} {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 18:02:10 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-7b6be3db-f8c6-49ce-bcf2-95865c67004d tempest-CinderUnicodeTest-850776731 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.544s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 18:02:10 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-21d55fd3-2773-4ecf-839f-b27d36fc254e tempest-VolumeDependencyTests-158100058 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.642s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 18:02:10 devstack cinder-volume[81771]: INFO cinder.volume.drivers.remotefs [None req-21d55fd3-2773-4ecf-839f-b27d36fc254e tempest-VolumeDependencyTests-158100058 None] Cloning volume f6cf00cd-388a-49f5-9288-d5cc8adc54ec to volume 9cb247d9-2766-4800-bc49-8d671ed7f1e2 Apr 22 18:02:10 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-7b6be3db-f8c6-49ce-bcf2-95865c67004d tempest-CinderUnicodeTest-850776731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c1f438e-f3d4-4eaa-bacd-a0a9a768c92b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3c80a94-66b5-4e24-8d3d-d6822299c6f5', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:02:10 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-7b6be3db-f8c6-49ce-bcf2-95865c67004d tempest-CinderUnicodeTest-850776731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (642c743b-d32b-4148-b1b5-6bcf45752a2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:02:10 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-7b6be3db-f8c6-49ce-bcf2-95865c67004d tempest-CinderUnicodeTest-850776731 None] Volume volume-e3c80a94-66b5-4e24-8d3d-d6822299c6f5 (e3c80a94-66b5-4e24-8d3d-d6822299c6f5): created successfully Apr 22 18:02:10 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-7b6be3db-f8c6-49ce-bcf2-95865c67004d tempest-CinderUnicodeTest-850776731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (642c743b-d32b-4148-b1b5-6bcf45752a2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:02:10 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-7b6be3db-f8c6-49ce-bcf2-95865c67004d tempest-CinderUnicodeTest-850776731 None] Flow 'volume_create_manager' (51a634b8-62f1-4e33-82be-cb54ca96c1cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 18:02:10 devstack sudo[91028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b0ab3d45-e3ae-4a47-a39e-a50f6ac7e9ee Apr 22 18:02:10 devstack sudo[91028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:02:10 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-7b6be3db-f8c6-49ce-bcf2-95865c67004d tempest-CinderUnicodeTest-850776731 None] Created volume successfully. Apr 22 18:02:10 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-21d55fd3-2773-4ecf-839f-b27d36fc254e tempest-VolumeDependencyTests-158100058 None] Creating offline snapshot 6504cfde-d184-4484-8345-bb9276951fcd of volume f6cf00cd-388a-49f5-9288-d5cc8adc54ec {{(pid=81771) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 22 18:02:10 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[5418aab5-bf3d-4305-b56d-8f5978fe1672]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 18:02:10 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-21d55fd3-2773-4ecf-839f-b27d36fc254e tempest-VolumeDependencyTests-158100058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-f6cf00cd-388a-49f5-9288-d5cc8adc54ec {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:02:10 devstack sudo[91030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-f6cf00cd-388a-49f5-9288-d5cc8adc54ec Apr 22 18:02:10 devstack sudo[91030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:02:10 devstack sudo[91028]: pam_unix(sudo:session): session closed for user root Apr 22 18:02:10 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-15bd618d-a86e-414a-8465-0e1b0e52941b tempest-CreateVolumesFromSnapshotTest-540484731 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b0ab3d45-e3ae-4a47-a39e-a50f6ac7e9ee" returned: 0 in 0.720s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:02:10 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-15bd618d-a86e-414a-8465-0e1b0e52941b tempest-CreateVolumesFromSnapshotTest-540484731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b0ab3d45-e3ae-4a47-a39e-a50f6ac7e9ee {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:02:10 devstack sudo[91038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b0ab3d45-e3ae-4a47-a39e-a50f6ac7e9ee Apr 22 18:02:10 devstack sudo[91038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:02:11 devstack sudo[91030]: pam_unix(sudo:session): session closed for user root Apr 22 18:02:11 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-21d55fd3-2773-4ecf-839f-b27d36fc254e tempest-VolumeDependencyTests-158100058 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-f6cf00cd-388a-49f5-9288-d5cc8adc54ec" returned: 0 in 0.719s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:02:11 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-21d55fd3-2773-4ecf-839f-b27d36fc254e tempest-VolumeDependencyTests-158100058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-f6cf00cd-388a-49f5-9288-d5cc8adc54ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-f6cf00cd-388a-49f5-9288-d5cc8adc54ec.6504cfde-d184-4484-8345-bb9276951fcd 1G {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:02:11 devstack sudo[91040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-f6cf00cd-388a-49f5-9288-d5cc8adc54ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-f6cf00cd-388a-49f5-9288-d5cc8adc54ec.6504cfde-d184-4484-8345-bb9276951fcd 1G Apr 22 18:02:11 devstack sudo[91040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:02:11 devstack cinder-volume[81771]: DEBUG cinder.volume.flows.manager.create_volume [None req-152c5f68-a1dc-4fb0-927e-9b39104130eb tempest-CinderUnicodeTest-850776731 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 18:02:11 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-152c5f68-a1dc-4fb0-927e-9b39104130eb tempest-CinderUnicodeTest-850776731 None] Flow 'volume_create_manager' (4e03b3af-0c78-4024-8b0b-cdb57577dad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 18:02:11 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-152c5f68-a1dc-4fb0-927e-9b39104130eb tempest-CinderUnicodeTest-850776731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7aa90019-5457-4e2e-a297-f785fc6347e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:02:11 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-152c5f68-a1dc-4fb0-927e-9b39104130eb tempest-CinderUnicodeTest-850776731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7aa90019-5457-4e2e-a297-f785fc6347e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T16:02:11Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-945737527',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35e23836-c086-47d9-b97d-12a01b96047f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9a5be7b15154149bbe2c5834561f81e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T16:02:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T16:02:11Z,use_quota=True,user_id='e70be7585b534362abf047d85f39ccd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:02:11 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-152c5f68-a1dc-4fb0-927e-9b39104130eb tempest-CinderUnicodeTest-850776731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f836c78-7fcc-4f8d-a0ee-4b86c2f67992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:02:11 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-152c5f68-a1dc-4fb0-927e-9b39104130eb tempest-CinderUnicodeTest-850776731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f836c78-7fcc-4f8d-a0ee-4b86c2f67992) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:02:11 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-152c5f68-a1dc-4fb0-927e-9b39104130eb tempest-CinderUnicodeTest-850776731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad90b7ad-eef6-4069-9842-3eb748c0040a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:02:11 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-152c5f68-a1dc-4fb0-927e-9b39104130eb tempest-CinderUnicodeTest-850776731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad90b7ad-eef6-4069-9842-3eb748c0040a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35e23836-c086-47d9-b97d-12a01b96047f', 'volume_name': 'volume-35e23836-c086-47d9-b97d-12a01b96047f', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:02:11 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-152c5f68-a1dc-4fb0-927e-9b39104130eb tempest-CinderUnicodeTest-850776731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2012f9f-1f33-48d0-b22c-902e87e2051d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:02:11 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-152c5f68-a1dc-4fb0-927e-9b39104130eb tempest-CinderUnicodeTest-850776731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2012f9f-1f33-48d0-b22c-902e87e2051d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:02:11 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-152c5f68-a1dc-4fb0-927e-9b39104130eb tempest-CinderUnicodeTest-850776731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39187b7f-c5b1-42d0-b52b-b68abc156011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:02:11 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-152c5f68-a1dc-4fb0-927e-9b39104130eb tempest-CinderUnicodeTest-850776731 None] Volume 35e23836-c086-47d9-b97d-12a01b96047f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35e23836-c086-47d9-b97d-12a01b96047f', 'volume_size': 1} Apr 22 18:02:11 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-152c5f68-a1dc-4fb0-927e-9b39104130eb tempest-CinderUnicodeTest-850776731 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 18:02:11 devstack sudo[91038]: pam_unix(sudo:session): session closed for user root Apr 22 18:02:11 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-15bd618d-a86e-414a-8465-0e1b0e52941b tempest-CreateVolumesFromSnapshotTest-540484731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-b0ab3d45-e3ae-4a47-a39e-a50f6ac7e9ee" returned: 0 in 0.666s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:02:11 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-15bd618d-a86e-414a-8465-0e1b0e52941b tempest-CreateVolumesFromSnapshotTest-540484731 None] Lock "cinder-quobyte-b0ab3d45-e3ae-4a47-a39e-a50f6ac7e9ee" released by "delete_volume" :: held 1.445s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 18:02:11 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-15bd618d-a86e-414a-8465-0e1b0e52941b tempest-CreateVolumesFromSnapshotTest-540484731 None] Created reservations ['9aa2dce5-432d-4feb-a4df-ec817d670450', '2af1b593-af03-49e4-a655-fe8493cdc987', '1f52aa13-566f-494d-ac28-8fe0cffd025b', '3456f265-acb9-4448-b9e7-25134aa7a5dc'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 18:02:11 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-15bd618d-a86e-414a-8465-0e1b0e52941b tempest-CreateVolumesFromSnapshotTest-540484731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 18:02:11 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-15bd618d-a86e-414a-8465-0e1b0e52941b tempest-CreateVolumesFromSnapshotTest-540484731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 18:02:11 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-15bd618d-a86e-414a-8465-0e1b0e52941b tempest-CreateVolumesFromSnapshotTest-540484731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 18:02:11 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-15bd618d-a86e-414a-8465-0e1b0e52941b tempest-CreateVolumesFromSnapshotTest-540484731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 18:02:11 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-15bd618d-a86e-414a-8465-0e1b0e52941b tempest-CreateVolumesFromSnapshotTest-540484731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 18:02:11 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-15bd618d-a86e-414a-8465-0e1b0e52941b tempest-CreateVolumesFromSnapshotTest-540484731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:02:11 devstack sudo[91040]: pam_unix(sudo:session): session closed for user root Apr 22 18:02:11 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-21d55fd3-2773-4ecf-839f-b27d36fc254e tempest-VolumeDependencyTests-158100058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-f6cf00cd-388a-49f5-9288-d5cc8adc54ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-f6cf00cd-388a-49f5-9288-d5cc8adc54ec.6504cfde-d184-4484-8345-bb9276951fcd 1G" returned: 0 in 0.752s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:02:11 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-21d55fd3-2773-4ecf-839f-b27d36fc254e tempest-VolumeDependencyTests-158100058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6cf00cd-388a-49f5-9288-d5cc8adc54ec -F qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-f6cf00cd-388a-49f5-9288-d5cc8adc54ec.6504cfde-d184-4484-8345-bb9276951fcd {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:02:11 devstack sudo[91046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 Apr 22 18:02:11 devstack sudo[91046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:02:11 devstack sudo[91047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6cf00cd-388a-49f5-9288-d5cc8adc54ec -F qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-f6cf00cd-388a-49f5-9288-d5cc8adc54ec.6504cfde-d184-4484-8345-bb9276951fcd Apr 22 18:02:11 devstack sudo[91047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:02:12 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-45aa58c7-8933-43a1-8de1-98a7c8ed8a66 tempest-CreateVolumesFromSnapshotTest-540484731 None] Acquiring lock "cinder-d1f6d355-8b4f-4922-bcbc-f9c26a0f5b64-delete_volume" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 18:02:12 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-45aa58c7-8933-43a1-8de1-98a7c8ed8a66 tempest-CreateVolumesFromSnapshotTest-540484731 None] Lock "cinder-d1f6d355-8b4f-4922-bcbc-f9c26a0f5b64-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 18:02:12 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-45aa58c7-8933-43a1-8de1-98a7c8ed8a66 tempest-CreateVolumesFromSnapshotTest-540484731 None] Acquiring lock "cinder-quobyte-d1f6d355-8b4f-4922-bcbc-f9c26a0f5b64" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 18:02:12 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-45aa58c7-8933-43a1-8de1-98a7c8ed8a66 tempest-CreateVolumesFromSnapshotTest-540484731 None] Lock "cinder-quobyte-d1f6d355-8b4f-4922-bcbc-f9c26a0f5b64" acquired by "delete_volume" :: waited 0.014s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 18:02:12 devstack sudo[91046]: pam_unix(sudo:session): session closed for user root Apr 22 18:02:12 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-15bd618d-a86e-414a-8465-0e1b0e52941b tempest-CreateVolumesFromSnapshotTest-540484731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33" returned: 0 in 0.667s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:02:12 devstack cinder-volume[81771]: DEBUG cinder.manager [None req-15bd618d-a86e-414a-8465-0e1b0e52941b tempest-CreateVolumesFromSnapshotTest-540484731 None] Notifying Schedulers of capabilities ... {{(pid=81771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 18:02:12 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-15bd618d-a86e-414a-8465-0e1b0e52941b tempest-CreateVolumesFromSnapshotTest-540484731 None] Deleted volume successfully. Apr 22 18:02:12 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[c865f344-72a7-4938-9234-d92dbb3e872d]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 18:02:12 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-45aa58c7-8933-43a1-8de1-98a7c8ed8a66 tempest-CreateVolumesFromSnapshotTest-540484731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-d1f6d355-8b4f-4922-bcbc-f9c26a0f5b64 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:02:12 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-15bd618d-a86e-414a-8465-0e1b0e52941b tempest-CreateVolumesFromSnapshotTest-540484731 None] Lock "cinder-b0ab3d45-e3ae-4a47-a39e-a50f6ac7e9ee-delete_volume" released by "delete_volume" :: held 2.430s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 18:02:12 devstack sudo[91047]: pam_unix(sudo:session): session closed for user root Apr 22 18:02:12 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-21d55fd3-2773-4ecf-839f-b27d36fc254e tempest-VolumeDependencyTests-158100058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6cf00cd-388a-49f5-9288-d5cc8adc54ec -F qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-f6cf00cd-388a-49f5-9288-d5cc8adc54ec.6504cfde-d184-4484-8345-bb9276951fcd" returned: 0 in 0.708s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:02:12 devstack cinder-volume[81771]: WARNING cinder.volume.drivers.remotefs [None req-21d55fd3-2773-4ecf-839f-b27d36fc254e tempest-VolumeDependencyTests-158100058 None] /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-f6cf00cd-388a-49f5-9288-d5cc8adc54ec.6504cfde-d184-4484-8345-bb9276951fcd is being set with open permissions: ugo+rw Apr 22 18:02:12 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-21d55fd3-2773-4ecf-839f-b27d36fc254e tempest-VolumeDependencyTests-158100058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-f6cf00cd-388a-49f5-9288-d5cc8adc54ec.6504cfde-d184-4484-8345-bb9276951fcd {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:02:12 devstack sudo[91055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-f6cf00cd-388a-49f5-9288-d5cc8adc54ec.6504cfde-d184-4484-8345-bb9276951fcd Apr 22 18:02:12 devstack sudo[91055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:02:12 devstack sudo[91054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-d1f6d355-8b4f-4922-bcbc-f9c26a0f5b64 Apr 22 18:02:12 devstack sudo[91054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:02:13 devstack sudo[91054]: pam_unix(sudo:session): session closed for user root Apr 22 18:02:13 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-45aa58c7-8933-43a1-8de1-98a7c8ed8a66 tempest-CreateVolumesFromSnapshotTest-540484731 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-d1f6d355-8b4f-4922-bcbc-f9c26a0f5b64" returned: 0 in 0.638s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:02:13 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-45aa58c7-8933-43a1-8de1-98a7c8ed8a66 tempest-CreateVolumesFromSnapshotTest-540484731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-d1f6d355-8b4f-4922-bcbc-f9c26a0f5b64 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:02:13 devstack sudo[91055]: pam_unix(sudo:session): session closed for user root Apr 22 18:02:13 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-21d55fd3-2773-4ecf-839f-b27d36fc254e tempest-VolumeDependencyTests-158100058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-f6cf00cd-388a-49f5-9288-d5cc8adc54ec.6504cfde-d184-4484-8345-bb9276951fcd" returned: 0 in 0.613s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:02:13 devstack sudo[91062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-d1f6d355-8b4f-4922-bcbc-f9c26a0f5b64 Apr 22 18:02:13 devstack sudo[91062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:02:13 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-21d55fd3-2773-4ecf-839f-b27d36fc254e tempest-VolumeDependencyTests-158100058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-f6cf00cd-388a-49f5-9288-d5cc8adc54ec.info {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:02:13 devstack sudo[91064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-f6cf00cd-388a-49f5-9288-d5cc8adc54ec.info Apr 22 18:02:13 devstack sudo[91064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:02:13 devstack sudo[91062]: pam_unix(sudo:session): session closed for user root Apr 22 18:02:13 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-45aa58c7-8933-43a1-8de1-98a7c8ed8a66 tempest-CreateVolumesFromSnapshotTest-540484731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-d1f6d355-8b4f-4922-bcbc-f9c26a0f5b64" returned: 0 in 0.664s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:02:13 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-45aa58c7-8933-43a1-8de1-98a7c8ed8a66 tempest-CreateVolumesFromSnapshotTest-540484731 None] Lock "cinder-quobyte-d1f6d355-8b4f-4922-bcbc-f9c26a0f5b64" released by "delete_volume" :: held 1.361s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 18:02:13 devstack sudo[91064]: pam_unix(sudo:session): session closed for user root Apr 22 18:02:13 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-21d55fd3-2773-4ecf-839f-b27d36fc254e tempest-VolumeDependencyTests-158100058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-f6cf00cd-388a-49f5-9288-d5cc8adc54ec.info" returned: 0 in 0.659s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:02:13 devstack cinder-volume[81771]: WARNING cinder.volume.drivers.remotefs [None req-21d55fd3-2773-4ecf-839f-b27d36fc254e tempest-VolumeDependencyTests-158100058 None] /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-f6cf00cd-388a-49f5-9288-d5cc8adc54ec.info is being set with open permissions: ugo+rw Apr 22 18:02:13 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-21d55fd3-2773-4ecf-839f-b27d36fc254e tempest-VolumeDependencyTests-158100058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-f6cf00cd-388a-49f5-9288-d5cc8adc54ec.info {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:02:13 devstack sudo[91068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-f6cf00cd-388a-49f5-9288-d5cc8adc54ec.info Apr 22 18:02:13 devstack sudo[91068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:02:13 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-45aa58c7-8933-43a1-8de1-98a7c8ed8a66 tempest-CreateVolumesFromSnapshotTest-540484731 None] Created reservations ['35651f75-d814-4fa9-8eaf-465705284c14', '4a0d5846-0038-405a-9172-cd6bbc6bf159', '5fee4106-7739-4b51-8120-774e771f759b', 'ffa1021d-8c11-45a0-a558-09b8b9fe48c0'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 18:02:13 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-45aa58c7-8933-43a1-8de1-98a7c8ed8a66 tempest-CreateVolumesFromSnapshotTest-540484731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 18:02:13 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-45aa58c7-8933-43a1-8de1-98a7c8ed8a66 tempest-CreateVolumesFromSnapshotTest-540484731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 18:02:13 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-45aa58c7-8933-43a1-8de1-98a7c8ed8a66 tempest-CreateVolumesFromSnapshotTest-540484731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 18:02:13 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-45aa58c7-8933-43a1-8de1-98a7c8ed8a66 tempest-CreateVolumesFromSnapshotTest-540484731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 18:02:13 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-45aa58c7-8933-43a1-8de1-98a7c8ed8a66 tempest-CreateVolumesFromSnapshotTest-540484731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 18:02:13 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-45aa58c7-8933-43a1-8de1-98a7c8ed8a66 tempest-CreateVolumesFromSnapshotTest-540484731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:02:13 devstack sudo[91070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 Apr 22 18:02:13 devstack sudo[91070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:02:14 devstack sudo[91068]: pam_unix(sudo:session): session closed for user root Apr 22 18:02:14 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-21d55fd3-2773-4ecf-839f-b27d36fc254e tempest-VolumeDependencyTests-158100058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-f6cf00cd-388a-49f5-9288-d5cc8adc54ec.info" returned: 0 in 0.609s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:02:14 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-21d55fd3-2773-4ecf-839f-b27d36fc254e tempest-VolumeDependencyTests-158100058 None] Acquiring lock "cinder-quobyte-9cb247d9-2766-4800-bc49-8d671ed7f1e2" by "_copy_volume_from_snapshot" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 18:02:14 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-21d55fd3-2773-4ecf-839f-b27d36fc254e tempest-VolumeDependencyTests-158100058 None] Lock "cinder-quobyte-9cb247d9-2766-4800-bc49-8d671ed7f1e2" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 18:02:14 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-21d55fd3-2773-4ecf-839f-b27d36fc254e tempest-VolumeDependencyTests-158100058 None] snapshot: 6504cfde-d184-4484-8345-bb9276951fcd, volume: 9cb247d9-2766-4800-bc49-8d671ed7f1e2, {{(pid=81771) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 22 18:02:14 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-21d55fd3-2773-4ecf-839f-b27d36fc254e tempest-VolumeDependencyTests-158100058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 18:02:14 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-21d55fd3-2773-4ecf-839f-b27d36fc254e tempest-VolumeDependencyTests-158100058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 18:02:14 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-21d55fd3-2773-4ecf-839f-b27d36fc254e tempest-VolumeDependencyTests-158100058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 18:02:14 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-21d55fd3-2773-4ecf-839f-b27d36fc254e tempest-VolumeDependencyTests-158100058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 18:02:14 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-21d55fd3-2773-4ecf-839f-b27d36fc254e tempest-VolumeDependencyTests-158100058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 18:02:14 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec2ea1dd-3e17-4b5d-bdbf-1da093ba54b2]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 18:02:14 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-21d55fd3-2773-4ecf-839f-b27d36fc254e tempest-VolumeDependencyTests-158100058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-f6cf00cd-388a-49f5-9288-d5cc8adc54ec.6504cfde-d184-4484-8345-bb9276951fcd {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:02:14 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-533ae7b9-ed7a-4f07-b73e-9efc4d8982f1 tempest-CreateVolumesFromSnapshotTest-540484731 None] Acquiring lock "cinder-1e25fcc7-6d9d-4f6c-b3e0-45fe8898750c-delete_volume" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 18:02:14 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-533ae7b9-ed7a-4f07-b73e-9efc4d8982f1 tempest-CreateVolumesFromSnapshotTest-540484731 None] Lock "cinder-1e25fcc7-6d9d-4f6c-b3e0-45fe8898750c-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 18:02:14 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-533ae7b9-ed7a-4f07-b73e-9efc4d8982f1 tempest-CreateVolumesFromSnapshotTest-540484731 None] Acquiring lock "cinder-quobyte-1e25fcc7-6d9d-4f6c-b3e0-45fe8898750c" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 18:02:14 devstack sudo[91070]: pam_unix(sudo:session): session closed for user root Apr 22 18:02:14 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-45aa58c7-8933-43a1-8de1-98a7c8ed8a66 tempest-CreateVolumesFromSnapshotTest-540484731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33" returned: 0 in 0.736s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:02:14 devstack cinder-volume[81771]: DEBUG cinder.manager [None req-45aa58c7-8933-43a1-8de1-98a7c8ed8a66 tempest-CreateVolumesFromSnapshotTest-540484731 None] Notifying Schedulers of capabilities ... {{(pid=81771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 18:02:14 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-533ae7b9-ed7a-4f07-b73e-9efc4d8982f1 tempest-CreateVolumesFromSnapshotTest-540484731 None] Lock "cinder-quobyte-1e25fcc7-6d9d-4f6c-b3e0-45fe8898750c" acquired by "delete_volume" :: waited 0.025s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 18:02:14 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-45aa58c7-8933-43a1-8de1-98a7c8ed8a66 tempest-CreateVolumesFromSnapshotTest-540484731 None] Deleted volume successfully. Apr 22 18:02:14 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[58b534e8-4e73-49c2-874d-49f492fbbebf]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 18:02:14 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-533ae7b9-ed7a-4f07-b73e-9efc4d8982f1 tempest-CreateVolumesFromSnapshotTest-540484731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-1e25fcc7-6d9d-4f6c-b3e0-45fe8898750c {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:02:14 devstack sudo[91074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-f6cf00cd-388a-49f5-9288-d5cc8adc54ec.6504cfde-d184-4484-8345-bb9276951fcd Apr 22 18:02:14 devstack sudo[91074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:02:14 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-45aa58c7-8933-43a1-8de1-98a7c8ed8a66 tempest-CreateVolumesFromSnapshotTest-540484731 None] Lock "cinder-d1f6d355-8b4f-4922-bcbc-f9c26a0f5b64-delete_volume" released by "delete_volume" :: held 2.442s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 18:02:14 devstack sudo[91076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-1e25fcc7-6d9d-4f6c-b3e0-45fe8898750c Apr 22 18:02:14 devstack sudo[91076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:02:15 devstack sudo[91074]: pam_unix(sudo:session): session closed for user root Apr 22 18:02:15 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-21d55fd3-2773-4ecf-839f-b27d36fc254e tempest-VolumeDependencyTests-158100058 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-f6cf00cd-388a-49f5-9288-d5cc8adc54ec.6504cfde-d184-4484-8345-bb9276951fcd" returned: 0 in 0.743s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:02:15 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-21d55fd3-2773-4ecf-839f-b27d36fc254e tempest-VolumeDependencyTests-158100058 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f6cf00cd-388a-49f5-9288-d5cc8adc54ec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81771) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 22 18:02:15 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-21d55fd3-2773-4ecf-839f-b27d36fc254e tempest-VolumeDependencyTests-158100058 None] will copy from snapshot at /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-f6cf00cd-388a-49f5-9288-d5cc8adc54ec {{(pid=81771) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 22 18:02:15 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-21d55fd3-2773-4ecf-839f-b27d36fc254e tempest-VolumeDependencyTests-158100058 None] Creating direct copy from snapshot {{(pid=81771) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 22 18:02:15 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f2f4eab-7ea6-44ee-a277-f4c9c610e956]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 18:02:15 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-21d55fd3-2773-4ecf-839f-b27d36fc254e tempest-VolumeDependencyTests-158100058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-f6cf00cd-388a-49f5-9288-d5cc8adc54ec {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:02:15 devstack sudo[91084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-f6cf00cd-388a-49f5-9288-d5cc8adc54ec Apr 22 18:02:15 devstack sudo[91084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:02:15 devstack sudo[91076]: pam_unix(sudo:session): session closed for user root Apr 22 18:02:15 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-533ae7b9-ed7a-4f07-b73e-9efc4d8982f1 tempest-CreateVolumesFromSnapshotTest-540484731 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-1e25fcc7-6d9d-4f6c-b3e0-45fe8898750c" returned: 0 in 0.718s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:02:15 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-533ae7b9-ed7a-4f07-b73e-9efc4d8982f1 tempest-CreateVolumesFromSnapshotTest-540484731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-1e25fcc7-6d9d-4f6c-b3e0-45fe8898750c {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:02:15 devstack sudo[91086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-1e25fcc7-6d9d-4f6c-b3e0-45fe8898750c Apr 22 18:02:15 devstack sudo[91086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:02:16 devstack sudo[91084]: pam_unix(sudo:session): session closed for user root Apr 22 18:02:16 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-21d55fd3-2773-4ecf-839f-b27d36fc254e tempest-VolumeDependencyTests-158100058 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-f6cf00cd-388a-49f5-9288-d5cc8adc54ec" returned: 0 in 0.788s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:02:16 devstack cinder-volume[81771]: DEBUG cinder.utils [None req-21d55fd3-2773-4ecf-839f-b27d36fc254e tempest-VolumeDependencyTests-158100058 None] Path /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-9cb247d9-2766-4800-bc49-8d671ed7f1e2 not found in is_blk_device check {{(pid=81771) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 22 18:02:16 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-21d55fd3-2773-4ecf-839f-b27d36fc254e tempest-VolumeDependencyTests-158100058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-f6cf00cd-388a-49f5-9288-d5cc8adc54ec /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-9cb247d9-2766-4800-bc49-8d671ed7f1e2 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:02:16 devstack sudo[91092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-f6cf00cd-388a-49f5-9288-d5cc8adc54ec /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-9cb247d9-2766-4800-bc49-8d671ed7f1e2 Apr 22 18:02:16 devstack sudo[91092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:02:16 devstack sudo[91086]: pam_unix(sudo:session): session closed for user root Apr 22 18:02:16 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-533ae7b9-ed7a-4f07-b73e-9efc4d8982f1 tempest-CreateVolumesFromSnapshotTest-540484731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-1e25fcc7-6d9d-4f6c-b3e0-45fe8898750c" returned: 0 in 0.651s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:02:16 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-533ae7b9-ed7a-4f07-b73e-9efc4d8982f1 tempest-CreateVolumesFromSnapshotTest-540484731 None] Lock "cinder-quobyte-1e25fcc7-6d9d-4f6c-b3e0-45fe8898750c" released by "delete_volume" :: held 1.425s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 18:02:16 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-533ae7b9-ed7a-4f07-b73e-9efc4d8982f1 tempest-CreateVolumesFromSnapshotTest-540484731 None] Created reservations ['e0f94a70-299f-4ec4-a359-f5e97252a117', 'ff1c4108-1a63-4bd7-b2c0-f12728a4a793', 'e2783814-bdac-4495-b11f-7e4c5260aa7b', '44698f28-23a2-4b86-8c5e-960f422a7e22'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 18:02:16 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-533ae7b9-ed7a-4f07-b73e-9efc4d8982f1 tempest-CreateVolumesFromSnapshotTest-540484731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 18:02:16 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-533ae7b9-ed7a-4f07-b73e-9efc4d8982f1 tempest-CreateVolumesFromSnapshotTest-540484731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 18:02:16 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-533ae7b9-ed7a-4f07-b73e-9efc4d8982f1 tempest-CreateVolumesFromSnapshotTest-540484731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 18:02:16 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-533ae7b9-ed7a-4f07-b73e-9efc4d8982f1 tempest-CreateVolumesFromSnapshotTest-540484731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 18:02:16 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-533ae7b9-ed7a-4f07-b73e-9efc4d8982f1 tempest-CreateVolumesFromSnapshotTest-540484731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 18:02:16 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-533ae7b9-ed7a-4f07-b73e-9efc4d8982f1 tempest-CreateVolumesFromSnapshotTest-540484731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:02:16 devstack sudo[91094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 Apr 22 18:02:16 devstack sudo[91094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:02:16 devstack cinder-volume[81771]: DEBUG cinder.volume.flows.manager.create_volume [None req-1aba7c43-dc83-492b-aac5-0432de4ae1ad tempest-SnapshotDependencyTests-2017080561 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 18:02:16 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-1aba7c43-dc83-492b-aac5-0432de4ae1ad tempest-SnapshotDependencyTests-2017080561 None] Flow 'volume_create_manager' (ff5a1250-60d0-4996-8b6f-b443183e794d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 18:02:16 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-1aba7c43-dc83-492b-aac5-0432de4ae1ad tempest-SnapshotDependencyTests-2017080561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfe333e1-a2cd-48f9-a81f-09a191ab65dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:02:16 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-1aba7c43-dc83-492b-aac5-0432de4ae1ad tempest-SnapshotDependencyTests-2017080561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfe333e1-a2cd-48f9-a81f-09a191ab65dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T16:02:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-235014327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fe7fe60-bc42-42cd-b858-171062f7bbb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb32e1211ee14ffc9e01cab5dfd616cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T16:02:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T16:02:17Z,use_quota=True,user_id='5a388900c1034871a5374c024b9639bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:02:16 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-1aba7c43-dc83-492b-aac5-0432de4ae1ad tempest-SnapshotDependencyTests-2017080561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8edc82d1-6d6e-4826-a615-135c1ba665a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:02:16 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-1aba7c43-dc83-492b-aac5-0432de4ae1ad tempest-SnapshotDependencyTests-2017080561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8edc82d1-6d6e-4826-a615-135c1ba665a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:02:16 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-1aba7c43-dc83-492b-aac5-0432de4ae1ad tempest-SnapshotDependencyTests-2017080561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79e8317e-237f-47e2-819b-edb78ba2efa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:02:16 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-1aba7c43-dc83-492b-aac5-0432de4ae1ad tempest-SnapshotDependencyTests-2017080561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79e8317e-237f-47e2-819b-edb78ba2efa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1fe7fe60-bc42-42cd-b858-171062f7bbb7', 'volume_name': 'volume-1fe7fe60-bc42-42cd-b858-171062f7bbb7', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:02:16 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-1aba7c43-dc83-492b-aac5-0432de4ae1ad tempest-SnapshotDependencyTests-2017080561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15cbed75-17b2-47ac-bc47-84d5d2552ded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:02:16 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-1aba7c43-dc83-492b-aac5-0432de4ae1ad tempest-SnapshotDependencyTests-2017080561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15cbed75-17b2-47ac-bc47-84d5d2552ded) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:02:16 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-1aba7c43-dc83-492b-aac5-0432de4ae1ad tempest-SnapshotDependencyTests-2017080561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24328d2f-18a2-440e-984c-d7080ec0abd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:02:16 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-1aba7c43-dc83-492b-aac5-0432de4ae1ad tempest-SnapshotDependencyTests-2017080561 None] Volume 1fe7fe60-bc42-42cd-b858-171062f7bbb7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1fe7fe60-bc42-42cd-b858-171062f7bbb7', 'volume_size': 1} Apr 22 18:02:16 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-1aba7c43-dc83-492b-aac5-0432de4ae1ad tempest-SnapshotDependencyTests-2017080561 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 18:02:17 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-e2ca64bd-0195-495d-9d40-166625337565 tempest-CreateVolumesFromSnapshotTest-540484731 None] Acquiring lock "cinder-ea9ae10c-fbda-4c40-8431-f2b3bd91bc49-delete_volume" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 18:02:17 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-e2ca64bd-0195-495d-9d40-166625337565 tempest-CreateVolumesFromSnapshotTest-540484731 None] Lock "cinder-ea9ae10c-fbda-4c40-8431-f2b3bd91bc49-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 18:02:17 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-e2ca64bd-0195-495d-9d40-166625337565 tempest-CreateVolumesFromSnapshotTest-540484731 None] Acquiring lock "cinder-quobyte-ea9ae10c-fbda-4c40-8431-f2b3bd91bc49" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 18:02:17 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-e2ca64bd-0195-495d-9d40-166625337565 tempest-CreateVolumesFromSnapshotTest-540484731 None] Lock "cinder-quobyte-ea9ae10c-fbda-4c40-8431-f2b3bd91bc49" acquired by "delete_volume" :: waited 0.048s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 18:02:17 devstack sudo[91094]: pam_unix(sudo:session): session closed for user root Apr 22 18:02:17 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-533ae7b9-ed7a-4f07-b73e-9efc4d8982f1 tempest-CreateVolumesFromSnapshotTest-540484731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33" returned: 0 in 1.065s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:02:17 devstack cinder-volume[81771]: DEBUG cinder.manager [None req-533ae7b9-ed7a-4f07-b73e-9efc4d8982f1 tempest-CreateVolumesFromSnapshotTest-540484731 None] Notifying Schedulers of capabilities ... {{(pid=81771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 18:02:17 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-533ae7b9-ed7a-4f07-b73e-9efc4d8982f1 tempest-CreateVolumesFromSnapshotTest-540484731 None] Deleted volume successfully. Apr 22 18:02:17 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[21b9e915-b8a6-42c0-92e3-718d053afc49]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 18:02:17 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-e2ca64bd-0195-495d-9d40-166625337565 tempest-CreateVolumesFromSnapshotTest-540484731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-ea9ae10c-fbda-4c40-8431-f2b3bd91bc49 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:02:17 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-533ae7b9-ed7a-4f07-b73e-9efc4d8982f1 tempest-CreateVolumesFromSnapshotTest-540484731 None] Lock "cinder-1e25fcc7-6d9d-4f6c-b3e0-45fe8898750c-delete_volume" released by "delete_volume" :: held 2.916s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 18:02:17 devstack sudo[91108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-ea9ae10c-fbda-4c40-8431-f2b3bd91bc49 Apr 22 18:02:17 devstack sudo[91108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:02:18 devstack sudo[91108]: pam_unix(sudo:session): session closed for user root Apr 22 18:02:18 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-e2ca64bd-0195-495d-9d40-166625337565 tempest-CreateVolumesFromSnapshotTest-540484731 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-ea9ae10c-fbda-4c40-8431-f2b3bd91bc49" returned: 0 in 1.554s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:02:18 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-e2ca64bd-0195-495d-9d40-166625337565 tempest-CreateVolumesFromSnapshotTest-540484731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-ea9ae10c-fbda-4c40-8431-f2b3bd91bc49 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:02:19 devstack sudo[91113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-ea9ae10c-fbda-4c40-8431-f2b3bd91bc49 Apr 22 18:02:19 devstack sudo[91113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:02:19 devstack sudo[91113]: pam_unix(sudo:session): session closed for user root Apr 22 18:02:19 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-e2ca64bd-0195-495d-9d40-166625337565 tempest-CreateVolumesFromSnapshotTest-540484731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-ea9ae10c-fbda-4c40-8431-f2b3bd91bc49" returned: 0 in 0.772s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:02:19 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-e2ca64bd-0195-495d-9d40-166625337565 tempest-CreateVolumesFromSnapshotTest-540484731 None] Lock "cinder-quobyte-ea9ae10c-fbda-4c40-8431-f2b3bd91bc49" released by "delete_volume" :: held 2.427s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 18:02:19 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-e2ca64bd-0195-495d-9d40-166625337565 tempest-CreateVolumesFromSnapshotTest-540484731 None] Created reservations ['3a2704f9-c66e-40b8-b628-941917556ccf', '447f6b67-34be-4b6d-a02b-d8541193fde3', '05fd89f6-0040-47d0-93e0-d8b9638fea6d', '4e3f84fc-22e0-4177-b12c-dae6199508dc'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 18:02:20 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-e2ca64bd-0195-495d-9d40-166625337565 tempest-CreateVolumesFromSnapshotTest-540484731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 18:02:20 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-e2ca64bd-0195-495d-9d40-166625337565 tempest-CreateVolumesFromSnapshotTest-540484731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 18:02:20 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-e2ca64bd-0195-495d-9d40-166625337565 tempest-CreateVolumesFromSnapshotTest-540484731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 18:02:20 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-e2ca64bd-0195-495d-9d40-166625337565 tempest-CreateVolumesFromSnapshotTest-540484731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 18:02:20 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-e2ca64bd-0195-495d-9d40-166625337565 tempest-CreateVolumesFromSnapshotTest-540484731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 18:02:20 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-e2ca64bd-0195-495d-9d40-166625337565 tempest-CreateVolumesFromSnapshotTest-540484731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:02:20 devstack sudo[91116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 Apr 22 18:02:20 devstack sudo[91116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:02:20 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-42011288-7216-4819-8d60-be8ee4af327f tempest-CreateVolumesFromSnapshotTest-540484731 None] Acquiring lock "cinder-6cd77635-8e8b-4129-be92-1fc6b569dc59-delete_snapshot" by "delete_snapshot" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 18:02:20 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-42011288-7216-4819-8d60-be8ee4af327f tempest-CreateVolumesFromSnapshotTest-540484731 None] Lock "cinder-6cd77635-8e8b-4129-be92-1fc6b569dc59-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 18:02:20 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-42011288-7216-4819-8d60-be8ee4af327f tempest-CreateVolumesFromSnapshotTest-540484731 None] Acquiring lock "cinder-quobyte-55ffe258-4252-4fe1-a9d0-5200bd52bc4d" by "delete_snapshot" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 18:02:20 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-42011288-7216-4819-8d60-be8ee4af327f tempest-CreateVolumesFromSnapshotTest-540484731 None] Lock "cinder-quobyte-55ffe258-4252-4fe1-a9d0-5200bd52bc4d" acquired by "delete_snapshot" :: waited 0.024s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 18:02:20 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-42011288-7216-4819-8d60-be8ee4af327f tempest-CreateVolumesFromSnapshotTest-540484731 None] Acquiring lock "cinder-quobyte-6cd77635-8e8b-4129-be92-1fc6b569dc59" by "_delete_snapshot" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 18:02:20 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-42011288-7216-4819-8d60-be8ee4af327f tempest-CreateVolumesFromSnapshotTest-540484731 None] Lock "cinder-quobyte-6cd77635-8e8b-4129-be92-1fc6b569dc59" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 18:02:20 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-42011288-7216-4819-8d60-be8ee4af327f tempest-CreateVolumesFromSnapshotTest-540484731 None] Deleting offline snapshot 6cd77635-8e8b-4129-be92-1fc6b569dc59 of volume 55ffe258-4252-4fe1-a9d0-5200bd52bc4d {{(pid=81771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 22 18:02:20 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-42011288-7216-4819-8d60-be8ee4af327f tempest-CreateVolumesFromSnapshotTest-540484731 None] snapshot_file for this snap is: volume-55ffe258-4252-4fe1-a9d0-5200bd52bc4d.6cd77635-8e8b-4129-be92-1fc6b569dc59 {{(pid=81771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 22 18:02:20 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f1fd2b8-682d-40bc-adb6-57ab51d8c95c]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 18:02:20 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-42011288-7216-4819-8d60-be8ee4af327f tempest-CreateVolumesFromSnapshotTest-540484731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-55ffe258-4252-4fe1-a9d0-5200bd52bc4d.6cd77635-8e8b-4129-be92-1fc6b569dc59 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:02:21 devstack sudo[91120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-55ffe258-4252-4fe1-a9d0-5200bd52bc4d.6cd77635-8e8b-4129-be92-1fc6b569dc59 Apr 22 18:02:21 devstack sudo[91120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:02:21 devstack sudo[91116]: pam_unix(sudo:session): session closed for user root Apr 22 18:02:21 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-e2ca64bd-0195-495d-9d40-166625337565 tempest-CreateVolumesFromSnapshotTest-540484731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33" returned: 0 in 1.382s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:02:21 devstack cinder-volume[81771]: DEBUG cinder.manager [None req-e2ca64bd-0195-495d-9d40-166625337565 tempest-CreateVolumesFromSnapshotTest-540484731 None] Notifying Schedulers of capabilities ... {{(pid=81771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 18:02:21 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-e2ca64bd-0195-495d-9d40-166625337565 tempest-CreateVolumesFromSnapshotTest-540484731 None] Deleted volume successfully. Apr 22 18:02:21 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-e2ca64bd-0195-495d-9d40-166625337565 tempest-CreateVolumesFromSnapshotTest-540484731 None] Lock "cinder-ea9ae10c-fbda-4c40-8431-f2b3bd91bc49-delete_volume" released by "delete_volume" :: held 4.374s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 18:02:21 devstack sudo[91092]: pam_unix(sudo:session): session closed for user root Apr 22 18:02:21 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-21d55fd3-2773-4ecf-839f-b27d36fc254e tempest-VolumeDependencyTests-158100058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-f6cf00cd-388a-49f5-9288-d5cc8adc54ec /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-9cb247d9-2766-4800-bc49-8d671ed7f1e2" returned: 0 in 5.650s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:02:21 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1a05371-33e8-4f97-8096-2e51090f7a7d]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 18:02:21 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-21d55fd3-2773-4ecf-839f-b27d36fc254e tempest-VolumeDependencyTests-158100058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-f6cf00cd-388a-49f5-9288-d5cc8adc54ec {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:02:21 devstack sudo[91125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-f6cf00cd-388a-49f5-9288-d5cc8adc54ec Apr 22 18:02:21 devstack sudo[91125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:02:21 devstack sudo[91120]: pam_unix(sudo:session): session closed for user root Apr 22 18:02:21 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-42011288-7216-4819-8d60-be8ee4af327f tempest-CreateVolumesFromSnapshotTest-540484731 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-55ffe258-4252-4fe1-a9d0-5200bd52bc4d.6cd77635-8e8b-4129-be92-1fc6b569dc59" returned: 0 in 1.137s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:02:21 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-42011288-7216-4819-8d60-be8ee4af327f tempest-CreateVolumesFromSnapshotTest-540484731 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-55ffe258-4252-4fe1-a9d0-5200bd52bc4d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81771) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 22 18:02:21 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[713373f2-fc51-4bf0-9e93-4b9d223d6a89]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 18:02:21 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-42011288-7216-4819-8d60-be8ee4af327f tempest-CreateVolumesFromSnapshotTest-540484731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-55ffe258-4252-4fe1-a9d0-5200bd52bc4d {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:02:22 devstack sudo[91128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-55ffe258-4252-4fe1-a9d0-5200bd52bc4d Apr 22 18:02:22 devstack sudo[91128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:02:22 devstack sudo[91125]: pam_unix(sudo:session): session closed for user root Apr 22 18:02:22 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-21d55fd3-2773-4ecf-839f-b27d36fc254e tempest-VolumeDependencyTests-158100058 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-f6cf00cd-388a-49f5-9288-d5cc8adc54ec" returned: 0 in 0.694s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:02:22 devstack cinder-volume[81771]: DEBUG cinder.image.image_utils [None req-21d55fd3-2773-4ecf-839f-b27d36fc254e tempest-VolumeDependencyTests-158100058 None] Image conversion details: src /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-f6cf00cd-388a-49f5-9288-d5cc8adc54ec, size 1024.00 MB, duration 5.65 sec, destination /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-9cb247d9-2766-4800-bc49-8d671ed7f1e2 {{(pid=81771) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 22 18:02:22 devstack cinder-volume[81771]: INFO cinder.image.image_utils [None req-21d55fd3-2773-4ecf-839f-b27d36fc254e tempest-VolumeDependencyTests-158100058 None] Converted 1024.00 MB image at 181.20 MB/s Apr 22 18:02:22 devstack cinder-volume[81771]: WARNING cinder.volume.drivers.remotefs [None req-21d55fd3-2773-4ecf-839f-b27d36fc254e tempest-VolumeDependencyTests-158100058 None] /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-9cb247d9-2766-4800-bc49-8d671ed7f1e2 is being set with open permissions: ugo+rw Apr 22 18:02:22 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-21d55fd3-2773-4ecf-839f-b27d36fc254e tempest-VolumeDependencyTests-158100058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-9cb247d9-2766-4800-bc49-8d671ed7f1e2 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:02:22 devstack sudo[91136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-9cb247d9-2766-4800-bc49-8d671ed7f1e2 Apr 22 18:02:22 devstack sudo[91136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:02:22 devstack sudo[91128]: pam_unix(sudo:session): session closed for user root Apr 22 18:02:22 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-42011288-7216-4819-8d60-be8ee4af327f tempest-CreateVolumesFromSnapshotTest-540484731 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-55ffe258-4252-4fe1-a9d0-5200bd52bc4d" returned: 0 in 0.584s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:02:22 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-42011288-7216-4819-8d60-be8ee4af327f tempest-CreateVolumesFromSnapshotTest-540484731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-55ffe258-4252-4fe1-a9d0-5200bd52bc4d.6cd77635-8e8b-4129-be92-1fc6b569dc59 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:02:22 devstack sudo[91138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-55ffe258-4252-4fe1-a9d0-5200bd52bc4d.6cd77635-8e8b-4129-be92-1fc6b569dc59 Apr 22 18:02:22 devstack sudo[91138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:02:22 devstack sudo[91136]: pam_unix(sudo:session): session closed for user root Apr 22 18:02:22 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-21d55fd3-2773-4ecf-839f-b27d36fc254e tempest-VolumeDependencyTests-158100058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-9cb247d9-2766-4800-bc49-8d671ed7f1e2" returned: 0 in 0.449s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:02:22 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-21d55fd3-2773-4ecf-839f-b27d36fc254e tempest-VolumeDependencyTests-158100058 None] Lock "cinder-quobyte-9cb247d9-2766-4800-bc49-8d671ed7f1e2" released by "_copy_volume_from_snapshot" :: held 8.439s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 18:02:22 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-21d55fd3-2773-4ecf-839f-b27d36fc254e tempest-VolumeDependencyTests-158100058 None] Acquiring lock "cinder-quobyte-6504cfde-d184-4484-8345-bb9276951fcd" by "_delete_snapshot" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 18:02:22 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-21d55fd3-2773-4ecf-839f-b27d36fc254e tempest-VolumeDependencyTests-158100058 None] Lock "cinder-quobyte-6504cfde-d184-4484-8345-bb9276951fcd" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 18:02:22 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-21d55fd3-2773-4ecf-839f-b27d36fc254e tempest-VolumeDependencyTests-158100058 None] Deleting offline snapshot 6504cfde-d184-4484-8345-bb9276951fcd of volume f6cf00cd-388a-49f5-9288-d5cc8adc54ec {{(pid=81771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 22 18:02:22 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-21d55fd3-2773-4ecf-839f-b27d36fc254e tempest-VolumeDependencyTests-158100058 None] snapshot_file for this snap is: volume-f6cf00cd-388a-49f5-9288-d5cc8adc54ec.6504cfde-d184-4484-8345-bb9276951fcd {{(pid=81771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 22 18:02:22 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9840478-416c-4e23-bb0b-fc304e9324d5]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 18:02:22 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-21d55fd3-2773-4ecf-839f-b27d36fc254e tempest-VolumeDependencyTests-158100058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-f6cf00cd-388a-49f5-9288-d5cc8adc54ec.6504cfde-d184-4484-8345-bb9276951fcd {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:02:23 devstack sudo[91144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-f6cf00cd-388a-49f5-9288-d5cc8adc54ec.6504cfde-d184-4484-8345-bb9276951fcd Apr 22 18:02:23 devstack sudo[91144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:02:23 devstack sudo[91138]: pam_unix(sudo:session): session closed for user root Apr 22 18:02:23 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-42011288-7216-4819-8d60-be8ee4af327f tempest-CreateVolumesFromSnapshotTest-540484731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-55ffe258-4252-4fe1-a9d0-5200bd52bc4d.6cd77635-8e8b-4129-be92-1fc6b569dc59" returned: 0 in 0.587s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:02:23 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-42011288-7216-4819-8d60-be8ee4af327f tempest-CreateVolumesFromSnapshotTest-540484731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-55ffe258-4252-4fe1-a9d0-5200bd52bc4d.6cd77635-8e8b-4129-be92-1fc6b569dc59 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:02:23 devstack sudo[91146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-55ffe258-4252-4fe1-a9d0-5200bd52bc4d.6cd77635-8e8b-4129-be92-1fc6b569dc59 Apr 22 18:02:23 devstack sudo[91146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:02:23 devstack sudo[91144]: pam_unix(sudo:session): session closed for user root Apr 22 18:02:23 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-21d55fd3-2773-4ecf-839f-b27d36fc254e tempest-VolumeDependencyTests-158100058 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-f6cf00cd-388a-49f5-9288-d5cc8adc54ec.6504cfde-d184-4484-8345-bb9276951fcd" returned: 0 in 0.529s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:02:23 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-21d55fd3-2773-4ecf-839f-b27d36fc254e tempest-VolumeDependencyTests-158100058 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f6cf00cd-388a-49f5-9288-d5cc8adc54ec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81771) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 22 18:02:23 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[e03874ac-0413-4d17-b293-09533f3a3ba5]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 18:02:23 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-21d55fd3-2773-4ecf-839f-b27d36fc254e tempest-VolumeDependencyTests-158100058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-f6cf00cd-388a-49f5-9288-d5cc8adc54ec {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:02:23 devstack sudo[91146]: pam_unix(sudo:session): session closed for user root Apr 22 18:02:23 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-42011288-7216-4819-8d60-be8ee4af327f tempest-CreateVolumesFromSnapshotTest-540484731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-55ffe258-4252-4fe1-a9d0-5200bd52bc4d.6cd77635-8e8b-4129-be92-1fc6b569dc59" returned: 0 in 0.467s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:02:23 devstack sudo[91152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-f6cf00cd-388a-49f5-9288-d5cc8adc54ec Apr 22 18:02:23 devstack sudo[91152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:02:23 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-42011288-7216-4819-8d60-be8ee4af327f tempest-CreateVolumesFromSnapshotTest-540484731 None] Lock "cinder-quobyte-6cd77635-8e8b-4129-be92-1fc6b569dc59" released by "_delete_snapshot" :: held 2.936s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 18:02:23 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-42011288-7216-4819-8d60-be8ee4af327f tempest-CreateVolumesFromSnapshotTest-540484731 None] Lock "cinder-quobyte-55ffe258-4252-4fe1-a9d0-5200bd52bc4d" released by "delete_snapshot" :: held 2.987s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 18:02:23 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-42011288-7216-4819-8d60-be8ee4af327f tempest-CreateVolumesFromSnapshotTest-540484731 None] Created reservations ['4919d6d8-f67a-4c0e-888d-b7b5e6669da7', '6ad120d3-c732-48e1-b580-d5aaab1b3a7f', 'b4007a3f-2834-49ff-abfd-0d97e524b810', '9c6e043f-602f-4f7e-b62e-ed8a321a88b7'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 18:02:23 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-42011288-7216-4819-8d60-be8ee4af327f tempest-CreateVolumesFromSnapshotTest-540484731 None] Delete snapshot completed successfully. Apr 22 18:02:23 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-42011288-7216-4819-8d60-be8ee4af327f tempest-CreateVolumesFromSnapshotTest-540484731 None] Lock "cinder-6cd77635-8e8b-4129-be92-1fc6b569dc59-delete_snapshot" released by "delete_snapshot" :: held 3.168s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 18:02:24 devstack sudo[91152]: pam_unix(sudo:session): session closed for user root Apr 22 18:02:24 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-21d55fd3-2773-4ecf-839f-b27d36fc254e tempest-VolumeDependencyTests-158100058 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-f6cf00cd-388a-49f5-9288-d5cc8adc54ec" returned: 0 in 0.572s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:02:24 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-21d55fd3-2773-4ecf-839f-b27d36fc254e tempest-VolumeDependencyTests-158100058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-f6cf00cd-388a-49f5-9288-d5cc8adc54ec.6504cfde-d184-4484-8345-bb9276951fcd {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:02:24 devstack sudo[91157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-f6cf00cd-388a-49f5-9288-d5cc8adc54ec.6504cfde-d184-4484-8345-bb9276951fcd Apr 22 18:02:24 devstack sudo[91157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:02:24 devstack sudo[91157]: pam_unix(sudo:session): session closed for user root Apr 22 18:02:24 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-21d55fd3-2773-4ecf-839f-b27d36fc254e tempest-VolumeDependencyTests-158100058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-f6cf00cd-388a-49f5-9288-d5cc8adc54ec.6504cfde-d184-4484-8345-bb9276951fcd" returned: 0 in 0.552s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:02:24 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-21d55fd3-2773-4ecf-839f-b27d36fc254e tempest-VolumeDependencyTests-158100058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-f6cf00cd-388a-49f5-9288-d5cc8adc54ec.6504cfde-d184-4484-8345-bb9276951fcd {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:02:24 devstack sudo[91162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-f6cf00cd-388a-49f5-9288-d5cc8adc54ec.6504cfde-d184-4484-8345-bb9276951fcd Apr 22 18:02:24 devstack sudo[91162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:02:24 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-fb073405-11f2-4a5c-b9ff-c102bb85db42 tempest-CreateVolumesFromSnapshotTest-540484731 None] Acquiring lock "cinder-55ffe258-4252-4fe1-a9d0-5200bd52bc4d-delete_volume" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 18:02:24 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-fb073405-11f2-4a5c-b9ff-c102bb85db42 tempest-CreateVolumesFromSnapshotTest-540484731 None] Lock "cinder-55ffe258-4252-4fe1-a9d0-5200bd52bc4d-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 18:02:24 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-fb073405-11f2-4a5c-b9ff-c102bb85db42 tempest-CreateVolumesFromSnapshotTest-540484731 None] Acquiring lock "cinder-quobyte-55ffe258-4252-4fe1-a9d0-5200bd52bc4d" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 18:02:24 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-fb073405-11f2-4a5c-b9ff-c102bb85db42 tempest-CreateVolumesFromSnapshotTest-540484731 None] Lock "cinder-quobyte-55ffe258-4252-4fe1-a9d0-5200bd52bc4d" acquired by "delete_volume" :: waited 0.013s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 18:02:24 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[d33358f2-cc01-4f74-a4c0-4126343801cd]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 18:02:24 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-fb073405-11f2-4a5c-b9ff-c102bb85db42 tempest-CreateVolumesFromSnapshotTest-540484731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-55ffe258-4252-4fe1-a9d0-5200bd52bc4d {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:02:24 devstack sudo[91164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-55ffe258-4252-4fe1-a9d0-5200bd52bc4d Apr 22 18:02:24 devstack sudo[91164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:02:25 devstack sudo[91162]: pam_unix(sudo:session): session closed for user root Apr 22 18:02:25 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-21d55fd3-2773-4ecf-839f-b27d36fc254e tempest-VolumeDependencyTests-158100058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-f6cf00cd-388a-49f5-9288-d5cc8adc54ec.6504cfde-d184-4484-8345-bb9276951fcd" returned: 0 in 0.500s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:02:25 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-21d55fd3-2773-4ecf-839f-b27d36fc254e tempest-VolumeDependencyTests-158100058 None] Lock "cinder-quobyte-6504cfde-d184-4484-8345-bb9276951fcd" released by "_delete_snapshot" :: held 2.252s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 18:02:25 devstack cinder-volume[81771]: DEBUG dbcounter [-] [81771] Writing DB stats cinder:SELECT=149,cinder:UPDATE=234,cinder:INSERT=52,cinder:DELETE=26 {{(pid=81771) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 22 18:02:25 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-21d55fd3-2773-4ecf-839f-b27d36fc254e tempest-VolumeDependencyTests-158100058 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.991s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 18:02:25 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-152c5f68-a1dc-4fb0-927e-9b39104130eb tempest-CinderUnicodeTest-850776731 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.971s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 18:02:25 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-152c5f68-a1dc-4fb0-927e-9b39104130eb tempest-CinderUnicodeTest-850776731 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T16:02:11Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-945737527',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35e23836-c086-47d9-b97d-12a01b96047f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9a5be7b15154149bbe2c5834561f81e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T16:02:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T16:02:11Z,use_quota=True,user_id='e70be7585b534362abf047d85f39ccd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)}" {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 18:02:25 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-152c5f68-a1dc-4fb0-927e-9b39104130eb tempest-CinderUnicodeTest-850776731 None] Creating volume 35e23836-c086-47d9-b97d-12a01b96047f {{(pid=81771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 18:02:25 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-152c5f68-a1dc-4fb0-927e-9b39104130eb tempest-CinderUnicodeTest-850776731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 18:02:25 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-152c5f68-a1dc-4fb0-927e-9b39104130eb tempest-CinderUnicodeTest-850776731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 18:02:25 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-152c5f68-a1dc-4fb0-927e-9b39104130eb tempest-CinderUnicodeTest-850776731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 18:02:25 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-152c5f68-a1dc-4fb0-927e-9b39104130eb tempest-CinderUnicodeTest-850776731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 18:02:25 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-152c5f68-a1dc-4fb0-927e-9b39104130eb tempest-CinderUnicodeTest-850776731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 18:02:25 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-152c5f68-a1dc-4fb0-927e-9b39104130eb tempest-CinderUnicodeTest-850776731 None] Selected osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 as target Quobyte volume. {{(pid=81771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 18:02:25 devstack cinder-volume[81771]: INFO cinder.volume.drivers.remotefs [None req-152c5f68-a1dc-4fb0-927e-9b39104130eb tempest-CinderUnicodeTest-850776731 None] casted to osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 Apr 22 18:02:25 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-152c5f68-a1dc-4fb0-927e-9b39104130eb tempest-CinderUnicodeTest-850776731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-35e23836-c086-47d9-b97d-12a01b96047f 1073741824 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:02:25 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-21d55fd3-2773-4ecf-839f-b27d36fc254e tempest-VolumeDependencyTests-158100058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f38a8a9-6446-49d5-9770-c6d5f4f76834) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9cb247d9-2766-4800-bc49-8d671ed7f1e2', 'volume_size': 1, 'source_volid': 'f6cf00cd-388a-49f5-9288-d5cc8adc54ec', 'source_volstatus': 'available'}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:02:25 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-21d55fd3-2773-4ecf-839f-b27d36fc254e tempest-VolumeDependencyTests-158100058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62e55ecd-a504-403b-abdf-b5468eaf6225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:02:25 devstack sudo[91167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-35e23836-c086-47d9-b97d-12a01b96047f 1073741824 Apr 22 18:02:25 devstack sudo[91167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:02:25 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-21d55fd3-2773-4ecf-839f-b27d36fc254e tempest-VolumeDependencyTests-158100058 None] Volume volume-9cb247d9-2766-4800-bc49-8d671ed7f1e2 (9cb247d9-2766-4800-bc49-8d671ed7f1e2): created successfully Apr 22 18:02:25 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-21d55fd3-2773-4ecf-839f-b27d36fc254e tempest-VolumeDependencyTests-158100058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62e55ecd-a504-403b-abdf-b5468eaf6225) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:02:25 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-21d55fd3-2773-4ecf-839f-b27d36fc254e tempest-VolumeDependencyTests-158100058 None] Flow 'volume_create_manager' (8ae6bdca-7e39-4582-8765-810af652a6fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 18:02:25 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-21d55fd3-2773-4ecf-839f-b27d36fc254e tempest-VolumeDependencyTests-158100058 None] Created volume successfully. Apr 22 18:02:25 devstack sudo[91164]: pam_unix(sudo:session): session closed for user root Apr 22 18:02:25 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-fb073405-11f2-4a5c-b9ff-c102bb85db42 tempest-CreateVolumesFromSnapshotTest-540484731 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-55ffe258-4252-4fe1-a9d0-5200bd52bc4d" returned: 0 in 0.577s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:02:25 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-fb073405-11f2-4a5c-b9ff-c102bb85db42 tempest-CreateVolumesFromSnapshotTest-540484731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-55ffe258-4252-4fe1-a9d0-5200bd52bc4d {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:02:25 devstack sudo[91172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-55ffe258-4252-4fe1-a9d0-5200bd52bc4d Apr 22 18:02:25 devstack sudo[91172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:02:25 devstack sudo[91167]: pam_unix(sudo:session): session closed for user root Apr 22 18:02:25 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-152c5f68-a1dc-4fb0-927e-9b39104130eb tempest-CinderUnicodeTest-850776731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-35e23836-c086-47d9-b97d-12a01b96047f 1073741824" returned: 0 in 0.655s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:02:25 devstack cinder-volume[81771]: DEBUG dbcounter [-] [81771] Writing DB stats cinder:UPDATE=201,cinder:SELECT=158,cinder:INSERT=49,cinder:DELETE=15 {{(pid=81771) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 22 18:02:25 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-152c5f68-a1dc-4fb0-927e-9b39104130eb tempest-CinderUnicodeTest-850776731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-35e23836-c086-47d9-b97d-12a01b96047f {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:02:25 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-fbb11aca-1f8a-436c-b693-158aaaf19473 tempest-VolumeDependencyTests-158100058 None] Acquiring lock "cinder-f6cf00cd-388a-49f5-9288-d5cc8adc54ec-delete_volume" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 18:02:25 devstack sudo[91178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-35e23836-c086-47d9-b97d-12a01b96047f Apr 22 18:02:25 devstack sudo[91178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:02:25 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-fbb11aca-1f8a-436c-b693-158aaaf19473 tempest-VolumeDependencyTests-158100058 None] Lock "cinder-f6cf00cd-388a-49f5-9288-d5cc8adc54ec-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 18:02:26 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-fbb11aca-1f8a-436c-b693-158aaaf19473 tempest-VolumeDependencyTests-158100058 None] Acquiring lock "cinder-quobyte-f6cf00cd-388a-49f5-9288-d5cc8adc54ec" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 18:02:26 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-fbb11aca-1f8a-436c-b693-158aaaf19473 tempest-VolumeDependencyTests-158100058 None] Lock "cinder-quobyte-f6cf00cd-388a-49f5-9288-d5cc8adc54ec" acquired by "delete_volume" :: waited 0.016s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 18:02:26 devstack sudo[91172]: pam_unix(sudo:session): session closed for user root Apr 22 18:02:26 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-fb073405-11f2-4a5c-b9ff-c102bb85db42 tempest-CreateVolumesFromSnapshotTest-540484731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-55ffe258-4252-4fe1-a9d0-5200bd52bc4d" returned: 0 in 0.572s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:02:26 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffded8a2-4be7-4474-8f54-d29959cd8ec1]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 18:02:26 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-fbb11aca-1f8a-436c-b693-158aaaf19473 tempest-VolumeDependencyTests-158100058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-f6cf00cd-388a-49f5-9288-d5cc8adc54ec {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:02:26 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-fb073405-11f2-4a5c-b9ff-c102bb85db42 tempest-CreateVolumesFromSnapshotTest-540484731 None] Lock "cinder-quobyte-55ffe258-4252-4fe1-a9d0-5200bd52bc4d" released by "delete_volume" :: held 1.225s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 18:02:26 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-fb073405-11f2-4a5c-b9ff-c102bb85db42 tempest-CreateVolumesFromSnapshotTest-540484731 None] Created reservations ['02756828-df07-43bb-bdb4-17a5333af261', '86a4ffc0-d5f5-465c-9301-0fc7aae7a0fb', 'a0a53a02-1d72-47bd-aa4f-61b03595840f', '77640010-6de8-49f9-9d6a-651005083a2a'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 18:02:26 devstack sudo[91180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-f6cf00cd-388a-49f5-9288-d5cc8adc54ec Apr 22 18:02:26 devstack sudo[91180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:02:26 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-fb073405-11f2-4a5c-b9ff-c102bb85db42 tempest-CreateVolumesFromSnapshotTest-540484731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 18:02:26 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-fb073405-11f2-4a5c-b9ff-c102bb85db42 tempest-CreateVolumesFromSnapshotTest-540484731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 18:02:26 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-fb073405-11f2-4a5c-b9ff-c102bb85db42 tempest-CreateVolumesFromSnapshotTest-540484731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 18:02:26 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-fb073405-11f2-4a5c-b9ff-c102bb85db42 tempest-CreateVolumesFromSnapshotTest-540484731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 18:02:26 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-fb073405-11f2-4a5c-b9ff-c102bb85db42 tempest-CreateVolumesFromSnapshotTest-540484731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 18:02:26 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-fb073405-11f2-4a5c-b9ff-c102bb85db42 tempest-CreateVolumesFromSnapshotTest-540484731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:02:26 devstack sudo[91182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 Apr 22 18:02:26 devstack sudo[91182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:02:26 devstack sudo[91178]: pam_unix(sudo:session): session closed for user root Apr 22 18:02:26 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-152c5f68-a1dc-4fb0-927e-9b39104130eb tempest-CinderUnicodeTest-850776731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-35e23836-c086-47d9-b97d-12a01b96047f" returned: 0 in 0.527s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:02:26 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-152c5f68-a1dc-4fb0-927e-9b39104130eb tempest-CinderUnicodeTest-850776731 None] <== create_volume: return (1235ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'} {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 18:02:26 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-152c5f68-a1dc-4fb0-927e-9b39104130eb tempest-CinderUnicodeTest-850776731 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.240s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 18:02:26 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-1aba7c43-dc83-492b-aac5-0432de4ae1ad tempest-SnapshotDependencyTests-2017080561 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.513s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 18:02:26 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-1aba7c43-dc83-492b-aac5-0432de4ae1ad tempest-SnapshotDependencyTests-2017080561 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T16:02:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-235014327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fe7fe60-bc42-42cd-b858-171062f7bbb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb32e1211ee14ffc9e01cab5dfd616cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T16:02:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T16:02:17Z,use_quota=True,user_id='5a388900c1034871a5374c024b9639bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)}" {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 18:02:26 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-1aba7c43-dc83-492b-aac5-0432de4ae1ad tempest-SnapshotDependencyTests-2017080561 None] Creating volume 1fe7fe60-bc42-42cd-b858-171062f7bbb7 {{(pid=81771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 18:02:26 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-1aba7c43-dc83-492b-aac5-0432de4ae1ad tempest-SnapshotDependencyTests-2017080561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 18:02:26 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-1aba7c43-dc83-492b-aac5-0432de4ae1ad tempest-SnapshotDependencyTests-2017080561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 18:02:26 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-1aba7c43-dc83-492b-aac5-0432de4ae1ad tempest-SnapshotDependencyTests-2017080561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 18:02:26 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-1aba7c43-dc83-492b-aac5-0432de4ae1ad tempest-SnapshotDependencyTests-2017080561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 18:02:26 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-1aba7c43-dc83-492b-aac5-0432de4ae1ad tempest-SnapshotDependencyTests-2017080561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 18:02:26 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-1aba7c43-dc83-492b-aac5-0432de4ae1ad tempest-SnapshotDependencyTests-2017080561 None] Selected osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 as target Quobyte volume. {{(pid=81771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 18:02:26 devstack cinder-volume[81771]: INFO cinder.volume.drivers.remotefs [None req-1aba7c43-dc83-492b-aac5-0432de4ae1ad tempest-SnapshotDependencyTests-2017080561 None] casted to osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 Apr 22 18:02:26 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-1aba7c43-dc83-492b-aac5-0432de4ae1ad tempest-SnapshotDependencyTests-2017080561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-1fe7fe60-bc42-42cd-b858-171062f7bbb7 1073741824 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:02:26 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-152c5f68-a1dc-4fb0-927e-9b39104130eb tempest-CinderUnicodeTest-850776731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39187b7f-c5b1-42d0-b52b-b68abc156011) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35e23836-c086-47d9-b97d-12a01b96047f', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:02:26 devstack sudo[91185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-1fe7fe60-bc42-42cd-b858-171062f7bbb7 1073741824 Apr 22 18:02:26 devstack sudo[91185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:02:26 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-152c5f68-a1dc-4fb0-927e-9b39104130eb tempest-CinderUnicodeTest-850776731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d27be8e-592c-45b2-9e48-cd89d0261b19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:02:26 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-152c5f68-a1dc-4fb0-927e-9b39104130eb tempest-CinderUnicodeTest-850776731 None] Volume volume-35e23836-c086-47d9-b97d-12a01b96047f (35e23836-c086-47d9-b97d-12a01b96047f): created successfully Apr 22 18:02:26 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-152c5f68-a1dc-4fb0-927e-9b39104130eb tempest-CinderUnicodeTest-850776731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d27be8e-592c-45b2-9e48-cd89d0261b19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:02:26 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-152c5f68-a1dc-4fb0-927e-9b39104130eb tempest-CinderUnicodeTest-850776731 None] Flow 'volume_create_manager' (4e03b3af-0c78-4024-8b0b-cdb57577dad3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 18:02:26 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-152c5f68-a1dc-4fb0-927e-9b39104130eb tempest-CinderUnicodeTest-850776731 None] Created volume successfully. Apr 22 18:02:26 devstack sudo[91180]: pam_unix(sudo:session): session closed for user root Apr 22 18:02:26 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-fbb11aca-1f8a-436c-b693-158aaaf19473 tempest-VolumeDependencyTests-158100058 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-f6cf00cd-388a-49f5-9288-d5cc8adc54ec" returned: 0 in 0.608s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:02:26 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-fbb11aca-1f8a-436c-b693-158aaaf19473 tempest-VolumeDependencyTests-158100058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-f6cf00cd-388a-49f5-9288-d5cc8adc54ec {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:02:26 devstack sudo[91182]: pam_unix(sudo:session): session closed for user root Apr 22 18:02:26 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-fb073405-11f2-4a5c-b9ff-c102bb85db42 tempest-CreateVolumesFromSnapshotTest-540484731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33" returned: 0 in 0.496s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:02:26 devstack cinder-volume[81771]: DEBUG cinder.manager [None req-fb073405-11f2-4a5c-b9ff-c102bb85db42 tempest-CreateVolumesFromSnapshotTest-540484731 None] Notifying Schedulers of capabilities ... {{(pid=81771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 18:02:26 devstack sudo[91191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-f6cf00cd-388a-49f5-9288-d5cc8adc54ec Apr 22 18:02:26 devstack sudo[91191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:02:26 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-fb073405-11f2-4a5c-b9ff-c102bb85db42 tempest-CreateVolumesFromSnapshotTest-540484731 None] Deleted volume successfully. Apr 22 18:02:26 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-fb073405-11f2-4a5c-b9ff-c102bb85db42 tempest-CreateVolumesFromSnapshotTest-540484731 None] Lock "cinder-55ffe258-4252-4fe1-a9d0-5200bd52bc4d-delete_volume" released by "delete_volume" :: held 1.925s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 18:02:27 devstack sudo[91191]: pam_unix(sudo:session): session closed for user root Apr 22 18:02:27 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-fbb11aca-1f8a-436c-b693-158aaaf19473 tempest-VolumeDependencyTests-158100058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-f6cf00cd-388a-49f5-9288-d5cc8adc54ec" returned: 0 in 0.502s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:02:27 devstack sudo[91185]: pam_unix(sudo:session): session closed for user root Apr 22 18:02:27 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-fbb11aca-1f8a-436c-b693-158aaaf19473 tempest-VolumeDependencyTests-158100058 None] Lock "cinder-quobyte-f6cf00cd-388a-49f5-9288-d5cc8adc54ec" released by "delete_volume" :: held 1.182s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 18:02:27 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-1aba7c43-dc83-492b-aac5-0432de4ae1ad tempest-SnapshotDependencyTests-2017080561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-1fe7fe60-bc42-42cd-b858-171062f7bbb7 1073741824" returned: 0 in 0.747s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:02:27 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-1aba7c43-dc83-492b-aac5-0432de4ae1ad tempest-SnapshotDependencyTests-2017080561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-1fe7fe60-bc42-42cd-b858-171062f7bbb7 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:02:27 devstack sudo[91198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-1fe7fe60-bc42-42cd-b858-171062f7bbb7 Apr 22 18:02:27 devstack sudo[91198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:02:27 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-fbb11aca-1f8a-436c-b693-158aaaf19473 tempest-VolumeDependencyTests-158100058 None] Created reservations ['1e641efb-a7c1-45c8-b468-da9464aefe68', 'fa5e2259-625a-4ff5-8883-81e556b6664e', 'e20f54b0-cbc5-45f5-a534-4fc891c346c6', 'ee68834f-fa7a-433f-ac8b-39f79b373b63'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 18:02:27 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-fbb11aca-1f8a-436c-b693-158aaaf19473 tempest-VolumeDependencyTests-158100058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 18:02:27 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-fbb11aca-1f8a-436c-b693-158aaaf19473 tempest-VolumeDependencyTests-158100058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 18:02:27 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-fbb11aca-1f8a-436c-b693-158aaaf19473 tempest-VolumeDependencyTests-158100058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 18:02:27 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-fbb11aca-1f8a-436c-b693-158aaaf19473 tempest-VolumeDependencyTests-158100058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 18:02:27 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-fbb11aca-1f8a-436c-b693-158aaaf19473 tempest-VolumeDependencyTests-158100058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 18:02:27 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-fbb11aca-1f8a-436c-b693-158aaaf19473 tempest-VolumeDependencyTests-158100058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:02:27 devstack sudo[91200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 Apr 22 18:02:27 devstack sudo[91200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:02:27 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-4814fd77-a25b-4242-947b-efbe45322359 tempest-CinderUnicodeTest-850776731 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 18:02:27 devstack sudo[91198]: pam_unix(sudo:session): session closed for user root Apr 22 18:02:27 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-1aba7c43-dc83-492b-aac5-0432de4ae1ad tempest-SnapshotDependencyTests-2017080561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-1fe7fe60-bc42-42cd-b858-171062f7bbb7" returned: 0 in 0.575s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:02:27 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-1aba7c43-dc83-492b-aac5-0432de4ae1ad tempest-SnapshotDependencyTests-2017080561 None] <== create_volume: return (1371ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'} {{(pid=81771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 18:02:27 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-1aba7c43-dc83-492b-aac5-0432de4ae1ad tempest-SnapshotDependencyTests-2017080561 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.374s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 18:02:27 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-4814fd77-a25b-4242-947b-efbe45322359 tempest-CinderUnicodeTest-850776731 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.139s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 18:02:27 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-4814fd77-a25b-4242-947b-efbe45322359 tempest-CinderUnicodeTest-850776731 None] Creating offline snapshot dc04e8b4-3efa-48d8-9476-c190804e4e84 of volume 35e23836-c086-47d9-b97d-12a01b96047f {{(pid=81771) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 22 18:02:27 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-1aba7c43-dc83-492b-aac5-0432de4ae1ad tempest-SnapshotDependencyTests-2017080561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24328d2f-18a2-440e-984c-d7080ec0abd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1fe7fe60-bc42-42cd-b858-171062f7bbb7', 'volume_size': 1}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:02:27 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-1aba7c43-dc83-492b-aac5-0432de4ae1ad tempest-SnapshotDependencyTests-2017080561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2e84e0b-d5da-4efa-bcaa-f8b283d3b8c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:02:27 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ff99585-cf82-413e-b67d-96274bbe8c26]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 18:02:27 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-4814fd77-a25b-4242-947b-efbe45322359 tempest-CinderUnicodeTest-850776731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-35e23836-c086-47d9-b97d-12a01b96047f {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:02:27 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-1aba7c43-dc83-492b-aac5-0432de4ae1ad tempest-SnapshotDependencyTests-2017080561 None] Volume volume-1fe7fe60-bc42-42cd-b858-171062f7bbb7 (1fe7fe60-bc42-42cd-b858-171062f7bbb7): created successfully Apr 22 18:02:27 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-1aba7c43-dc83-492b-aac5-0432de4ae1ad tempest-SnapshotDependencyTests-2017080561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2e84e0b-d5da-4efa-bcaa-f8b283d3b8c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:02:27 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-1aba7c43-dc83-492b-aac5-0432de4ae1ad tempest-SnapshotDependencyTests-2017080561 None] Flow 'volume_create_manager' (ff5a1250-60d0-4996-8b6f-b443183e794d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 18:02:27 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-1aba7c43-dc83-492b-aac5-0432de4ae1ad tempest-SnapshotDependencyTests-2017080561 None] Created volume successfully. Apr 22 18:02:28 devstack sudo[91203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-35e23836-c086-47d9-b97d-12a01b96047f Apr 22 18:02:28 devstack sudo[91203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:02:28 devstack sudo[91200]: pam_unix(sudo:session): session closed for user root Apr 22 18:02:28 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-fbb11aca-1f8a-436c-b693-158aaaf19473 tempest-VolumeDependencyTests-158100058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33" returned: 0 in 0.655s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:02:28 devstack cinder-volume[81771]: DEBUG cinder.manager [None req-fbb11aca-1f8a-436c-b693-158aaaf19473 tempest-VolumeDependencyTests-158100058 None] Notifying Schedulers of capabilities ... {{(pid=81771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 18:02:28 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-fbb11aca-1f8a-436c-b693-158aaaf19473 tempest-VolumeDependencyTests-158100058 None] Deleted volume successfully. Apr 22 18:02:28 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-fbb11aca-1f8a-436c-b693-158aaaf19473 tempest-VolumeDependencyTests-158100058 None] Lock "cinder-f6cf00cd-388a-49f5-9288-d5cc8adc54ec-delete_volume" released by "delete_volume" :: held 2.114s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 18:02:28 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-508934f8-6a69-4606-969e-5994801fdb9e tempest-VolumeDependencyTests-158100058 None] Acquiring lock "cinder-9cb247d9-2766-4800-bc49-8d671ed7f1e2-delete_volume" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 18:02:28 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-508934f8-6a69-4606-969e-5994801fdb9e tempest-VolumeDependencyTests-158100058 None] Lock "cinder-9cb247d9-2766-4800-bc49-8d671ed7f1e2-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 18:02:28 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-508934f8-6a69-4606-969e-5994801fdb9e tempest-VolumeDependencyTests-158100058 None] Acquiring lock "cinder-quobyte-9cb247d9-2766-4800-bc49-8d671ed7f1e2" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 18:02:28 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-508934f8-6a69-4606-969e-5994801fdb9e tempest-VolumeDependencyTests-158100058 None] Lock "cinder-quobyte-9cb247d9-2766-4800-bc49-8d671ed7f1e2" acquired by "delete_volume" :: waited 0.016s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 18:02:28 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a379614-6316-4520-bd42-c949e48b3995]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 18:02:28 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-508934f8-6a69-4606-969e-5994801fdb9e tempest-VolumeDependencyTests-158100058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-9cb247d9-2766-4800-bc49-8d671ed7f1e2 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:02:28 devstack sudo[91206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-9cb247d9-2766-4800-bc49-8d671ed7f1e2 Apr 22 18:02:28 devstack sudo[91206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:02:28 devstack sudo[91203]: pam_unix(sudo:session): session closed for user root Apr 22 18:02:28 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-4814fd77-a25b-4242-947b-efbe45322359 tempest-CinderUnicodeTest-850776731 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-35e23836-c086-47d9-b97d-12a01b96047f" returned: 0 in 0.730s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:02:28 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-4814fd77-a25b-4242-947b-efbe45322359 tempest-CinderUnicodeTest-850776731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-35e23836-c086-47d9-b97d-12a01b96047f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-35e23836-c086-47d9-b97d-12a01b96047f.dc04e8b4-3efa-48d8-9476-c190804e4e84 1G {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:02:28 devstack sudo[91211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-35e23836-c086-47d9-b97d-12a01b96047f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-35e23836-c086-47d9-b97d-12a01b96047f.dc04e8b4-3efa-48d8-9476-c190804e4e84 1G Apr 22 18:02:28 devstack sudo[91211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:02:28 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-d0a8286c-bc82-4737-80ea-6664d501ab3a tempest-SnapshotDependencyTests-2017080561 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 18:02:28 devstack sudo[91206]: pam_unix(sudo:session): session closed for user root Apr 22 18:02:29 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-508934f8-6a69-4606-969e-5994801fdb9e tempest-VolumeDependencyTests-158100058 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-9cb247d9-2766-4800-bc49-8d671ed7f1e2" returned: 0 in 0.684s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:02:29 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-508934f8-6a69-4606-969e-5994801fdb9e tempest-VolumeDependencyTests-158100058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-9cb247d9-2766-4800-bc49-8d671ed7f1e2 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:02:29 devstack sudo[91216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-9cb247d9-2766-4800-bc49-8d671ed7f1e2 Apr 22 18:02:29 devstack sudo[91216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:02:29 devstack sudo[91211]: pam_unix(sudo:session): session closed for user root Apr 22 18:02:29 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-4814fd77-a25b-4242-947b-efbe45322359 tempest-CinderUnicodeTest-850776731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-35e23836-c086-47d9-b97d-12a01b96047f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-35e23836-c086-47d9-b97d-12a01b96047f.dc04e8b4-3efa-48d8-9476-c190804e4e84 1G" returned: 0 in 0.813s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:02:29 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-4814fd77-a25b-4242-947b-efbe45322359 tempest-CinderUnicodeTest-850776731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35e23836-c086-47d9-b97d-12a01b96047f -F qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-35e23836-c086-47d9-b97d-12a01b96047f.dc04e8b4-3efa-48d8-9476-c190804e4e84 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:02:29 devstack sudo[91223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35e23836-c086-47d9-b97d-12a01b96047f -F qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-35e23836-c086-47d9-b97d-12a01b96047f.dc04e8b4-3efa-48d8-9476-c190804e4e84 Apr 22 18:02:29 devstack sudo[91223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:02:29 devstack sudo[91216]: pam_unix(sudo:session): session closed for user root Apr 22 18:02:29 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-508934f8-6a69-4606-969e-5994801fdb9e tempest-VolumeDependencyTests-158100058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-9cb247d9-2766-4800-bc49-8d671ed7f1e2" returned: 0 in 0.544s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:02:29 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-508934f8-6a69-4606-969e-5994801fdb9e tempest-VolumeDependencyTests-158100058 None] Lock "cinder-quobyte-9cb247d9-2766-4800-bc49-8d671ed7f1e2" released by "delete_volume" :: held 1.277s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 18:02:29 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-508934f8-6a69-4606-969e-5994801fdb9e tempest-VolumeDependencyTests-158100058 None] Created reservations ['33917b42-aa14-47ab-b003-c10cc612d9e1', '1ba0842a-e4da-4bd5-9a9b-0d8091372992', 'd75aaf05-6ba6-4adf-bcf4-0e15fe811938', 'fa20cce1-364c-443d-b6be-bcfc08574626'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 18:02:29 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-508934f8-6a69-4606-969e-5994801fdb9e tempest-VolumeDependencyTests-158100058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 18:02:29 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-508934f8-6a69-4606-969e-5994801fdb9e tempest-VolumeDependencyTests-158100058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 18:02:29 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-508934f8-6a69-4606-969e-5994801fdb9e tempest-VolumeDependencyTests-158100058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 18:02:29 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-508934f8-6a69-4606-969e-5994801fdb9e tempest-VolumeDependencyTests-158100058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 18:02:29 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-508934f8-6a69-4606-969e-5994801fdb9e tempest-VolumeDependencyTests-158100058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 18:02:29 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-508934f8-6a69-4606-969e-5994801fdb9e tempest-VolumeDependencyTests-158100058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:02:29 devstack sudo[91231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 Apr 22 18:02:29 devstack sudo[91231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:02:29 devstack cinder-volume[81771]: DEBUG oslo_service.periodic_task [None req-1a7bdab5-8190-4e00-a2e2-843e5894ab49 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81771) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 22 18:02:29 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-1a7bdab5-8190-4e00-a2e2-843e5894ab49 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 18:02:29 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-1a7bdab5-8190-4e00-a2e2-843e5894ab49 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 18:02:29 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-1a7bdab5-8190-4e00-a2e2-843e5894ab49 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 18:02:29 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-1a7bdab5-8190-4e00-a2e2-843e5894ab49 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 18:02:29 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-1a7bdab5-8190-4e00-a2e2-843e5894ab49 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 18:02:29 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-1a7bdab5-8190-4e00-a2e2-843e5894ab49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:02:29 devstack sudo[91236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 Apr 22 18:02:29 devstack sudo[91223]: pam_unix(sudo:session): session closed for user root Apr 22 18:02:29 devstack sudo[91236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:02:29 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-4814fd77-a25b-4242-947b-efbe45322359 tempest-CinderUnicodeTest-850776731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35e23836-c086-47d9-b97d-12a01b96047f -F qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-35e23836-c086-47d9-b97d-12a01b96047f.dc04e8b4-3efa-48d8-9476-c190804e4e84" returned: 0 in 0.488s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:02:29 devstack cinder-volume[81771]: WARNING cinder.volume.drivers.remotefs [None req-4814fd77-a25b-4242-947b-efbe45322359 tempest-CinderUnicodeTest-850776731 None] /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-35e23836-c086-47d9-b97d-12a01b96047f.dc04e8b4-3efa-48d8-9476-c190804e4e84 is being set with open permissions: ugo+rw Apr 22 18:02:29 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-4814fd77-a25b-4242-947b-efbe45322359 tempest-CinderUnicodeTest-850776731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-35e23836-c086-47d9-b97d-12a01b96047f.dc04e8b4-3efa-48d8-9476-c190804e4e84 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:02:29 devstack sudo[91238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-35e23836-c086-47d9-b97d-12a01b96047f.dc04e8b4-3efa-48d8-9476-c190804e4e84 Apr 22 18:02:29 devstack sudo[91238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:02:30 devstack sudo[91231]: pam_unix(sudo:session): session closed for user root Apr 22 18:02:30 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-508934f8-6a69-4606-969e-5994801fdb9e tempest-VolumeDependencyTests-158100058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33" returned: 0 in 0.495s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:02:30 devstack cinder-volume[81771]: DEBUG cinder.manager [None req-508934f8-6a69-4606-969e-5994801fdb9e tempest-VolumeDependencyTests-158100058 None] Notifying Schedulers of capabilities ... {{(pid=81771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 18:02:30 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-508934f8-6a69-4606-969e-5994801fdb9e tempest-VolumeDependencyTests-158100058 None] Deleted volume successfully. Apr 22 18:02:30 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-508934f8-6a69-4606-969e-5994801fdb9e tempest-VolumeDependencyTests-158100058 None] Lock "cinder-9cb247d9-2766-4800-bc49-8d671ed7f1e2-delete_volume" released by "delete_volume" :: held 1.964s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 18:02:30 devstack sudo[91236]: pam_unix(sudo:session): session closed for user root Apr 22 18:02:30 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-1a7bdab5-8190-4e00-a2e2-843e5894ab49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33" returned: 0 in 0.440s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:02:30 devstack cinder-volume[81771]: DEBUG cinder.manager [None req-1a7bdab5-8190-4e00-a2e2-843e5894ab49 None None] Notifying Schedulers of capabilities ... {{(pid=81771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 18:02:30 devstack sudo[91238]: pam_unix(sudo:session): session closed for user root Apr 22 18:02:30 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-4814fd77-a25b-4242-947b-efbe45322359 tempest-CinderUnicodeTest-850776731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-35e23836-c086-47d9-b97d-12a01b96047f.dc04e8b4-3efa-48d8-9476-c190804e4e84" returned: 0 in 0.471s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:02:30 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-4814fd77-a25b-4242-947b-efbe45322359 tempest-CinderUnicodeTest-850776731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-35e23836-c086-47d9-b97d-12a01b96047f.info {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:02:30 devstack sudo[91243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-35e23836-c086-47d9-b97d-12a01b96047f.info Apr 22 18:02:30 devstack sudo[91243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:02:30 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-521411e1-34aa-4d4f-93c6-2f94b638a036 tempest-VolumeDependencyTests-158100058 None] Acquiring lock "cinder-6542b28f-52d6-43da-bee8-a7fa1b970636-delete_volume" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 18:02:30 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-521411e1-34aa-4d4f-93c6-2f94b638a036 tempest-VolumeDependencyTests-158100058 None] Lock "cinder-6542b28f-52d6-43da-bee8-a7fa1b970636-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 18:02:30 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-521411e1-34aa-4d4f-93c6-2f94b638a036 tempest-VolumeDependencyTests-158100058 None] Acquiring lock "cinder-quobyte-6542b28f-52d6-43da-bee8-a7fa1b970636" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 18:02:30 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-521411e1-34aa-4d4f-93c6-2f94b638a036 tempest-VolumeDependencyTests-158100058 None] Lock "cinder-quobyte-6542b28f-52d6-43da-bee8-a7fa1b970636" acquired by "delete_volume" :: waited 0.013s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 18:02:30 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[48c3f595-e352-4da7-85c3-f58ebf960970]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 18:02:30 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-521411e1-34aa-4d4f-93c6-2f94b638a036 tempest-VolumeDependencyTests-158100058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-6542b28f-52d6-43da-bee8-a7fa1b970636 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:02:30 devstack sudo[91245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-6542b28f-52d6-43da-bee8-a7fa1b970636 Apr 22 18:02:30 devstack sudo[91245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:02:30 devstack sudo[91243]: pam_unix(sudo:session): session closed for user root Apr 22 18:02:30 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-4814fd77-a25b-4242-947b-efbe45322359 tempest-CinderUnicodeTest-850776731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-35e23836-c086-47d9-b97d-12a01b96047f.info" returned: 0 in 0.510s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:02:30 devstack cinder-volume[81771]: WARNING cinder.volume.drivers.remotefs [None req-4814fd77-a25b-4242-947b-efbe45322359 tempest-CinderUnicodeTest-850776731 None] /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-35e23836-c086-47d9-b97d-12a01b96047f.info is being set with open permissions: ugo+rw Apr 22 18:02:30 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-4814fd77-a25b-4242-947b-efbe45322359 tempest-CinderUnicodeTest-850776731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-35e23836-c086-47d9-b97d-12a01b96047f.info {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:02:30 devstack sudo[91248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-35e23836-c086-47d9-b97d-12a01b96047f.info Apr 22 18:02:30 devstack sudo[91248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:02:31 devstack sudo[91245]: pam_unix(sudo:session): session closed for user root Apr 22 18:02:31 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-521411e1-34aa-4d4f-93c6-2f94b638a036 tempest-VolumeDependencyTests-158100058 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-6542b28f-52d6-43da-bee8-a7fa1b970636" returned: 0 in 0.546s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:02:31 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-521411e1-34aa-4d4f-93c6-2f94b638a036 tempest-VolumeDependencyTests-158100058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-6542b28f-52d6-43da-bee8-a7fa1b970636 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:02:31 devstack sudo[91253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-6542b28f-52d6-43da-bee8-a7fa1b970636 Apr 22 18:02:31 devstack sudo[91253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:02:31 devstack sudo[91248]: pam_unix(sudo:session): session closed for user root Apr 22 18:02:31 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-4814fd77-a25b-4242-947b-efbe45322359 tempest-CinderUnicodeTest-850776731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-35e23836-c086-47d9-b97d-12a01b96047f.info" returned: 0 in 0.456s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:02:31 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-4814fd77-a25b-4242-947b-efbe45322359 tempest-CinderUnicodeTest-850776731 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.584s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 18:02:31 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-d0a8286c-bc82-4737-80ea-6664d501ab3a tempest-SnapshotDependencyTests-2017080561 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.521s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 18:02:31 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-d0a8286c-bc82-4737-80ea-6664d501ab3a tempest-SnapshotDependencyTests-2017080561 None] Creating offline snapshot e7da6311-1405-4ce6-b9ee-47b005499504 of volume 1fe7fe60-bc42-42cd-b858-171062f7bbb7 {{(pid=81771) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 22 18:02:31 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-4814fd77-a25b-4242-947b-efbe45322359 tempest-CinderUnicodeTest-850776731 None] Create snapshot completed successfully Apr 22 18:02:31 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[e55ad372-6565-4916-9f53-0c2b435f51e8]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 18:02:31 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-d0a8286c-bc82-4737-80ea-6664d501ab3a tempest-SnapshotDependencyTests-2017080561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-1fe7fe60-bc42-42cd-b858-171062f7bbb7 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:02:31 devstack sudo[91256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-1fe7fe60-bc42-42cd-b858-171062f7bbb7 Apr 22 18:02:31 devstack sudo[91256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:02:31 devstack sudo[91253]: pam_unix(sudo:session): session closed for user root Apr 22 18:02:31 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-521411e1-34aa-4d4f-93c6-2f94b638a036 tempest-VolumeDependencyTests-158100058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-6542b28f-52d6-43da-bee8-a7fa1b970636" returned: 0 in 0.472s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:02:31 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-521411e1-34aa-4d4f-93c6-2f94b638a036 tempest-VolumeDependencyTests-158100058 None] Lock "cinder-quobyte-6542b28f-52d6-43da-bee8-a7fa1b970636" released by "delete_volume" :: held 1.054s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 18:02:31 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-521411e1-34aa-4d4f-93c6-2f94b638a036 tempest-VolumeDependencyTests-158100058 None] Created reservations ['54085021-0ed1-43fa-84fc-b7afb70e1e11', '9a3ddd39-da60-477c-894d-eda8802fe2a5', '4facd6a1-3b07-4b7a-bbca-50410260123e', '6663127c-8618-4eb6-9693-9acb9eb6e72f'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 18:02:31 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-521411e1-34aa-4d4f-93c6-2f94b638a036 tempest-VolumeDependencyTests-158100058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 18:02:31 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-521411e1-34aa-4d4f-93c6-2f94b638a036 tempest-VolumeDependencyTests-158100058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 18:02:31 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-521411e1-34aa-4d4f-93c6-2f94b638a036 tempest-VolumeDependencyTests-158100058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 18:02:31 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-521411e1-34aa-4d4f-93c6-2f94b638a036 tempest-VolumeDependencyTests-158100058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 18:02:31 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-521411e1-34aa-4d4f-93c6-2f94b638a036 tempest-VolumeDependencyTests-158100058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 18:02:31 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-521411e1-34aa-4d4f-93c6-2f94b638a036 tempest-VolumeDependencyTests-158100058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:02:31 devstack sudo[91259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 Apr 22 18:02:31 devstack sudo[91259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:02:31 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-462ac67e-a402-42c5-b4a4-d11a6a864263 tempest-CinderUnicodeTest-850776731 None] Acquiring lock "cinder-dc04e8b4-3efa-48d8-9476-c190804e4e84-delete_snapshot" by "delete_snapshot" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 18:02:31 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-462ac67e-a402-42c5-b4a4-d11a6a864263 tempest-CinderUnicodeTest-850776731 None] Lock "cinder-dc04e8b4-3efa-48d8-9476-c190804e4e84-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 18:02:31 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-462ac67e-a402-42c5-b4a4-d11a6a864263 tempest-CinderUnicodeTest-850776731 None] Acquiring lock "cinder-quobyte-35e23836-c086-47d9-b97d-12a01b96047f" by "delete_snapshot" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 18:02:31 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-462ac67e-a402-42c5-b4a4-d11a6a864263 tempest-CinderUnicodeTest-850776731 None] Lock "cinder-quobyte-35e23836-c086-47d9-b97d-12a01b96047f" acquired by "delete_snapshot" :: waited 0.024s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 18:02:31 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-462ac67e-a402-42c5-b4a4-d11a6a864263 tempest-CinderUnicodeTest-850776731 None] Acquiring lock "cinder-quobyte-dc04e8b4-3efa-48d8-9476-c190804e4e84" by "_delete_snapshot" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 18:02:31 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-462ac67e-a402-42c5-b4a4-d11a6a864263 tempest-CinderUnicodeTest-850776731 None] Lock "cinder-quobyte-dc04e8b4-3efa-48d8-9476-c190804e4e84" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 18:02:31 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-462ac67e-a402-42c5-b4a4-d11a6a864263 tempest-CinderUnicodeTest-850776731 None] Deleting offline snapshot dc04e8b4-3efa-48d8-9476-c190804e4e84 of volume 35e23836-c086-47d9-b97d-12a01b96047f {{(pid=81771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 22 18:02:32 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-462ac67e-a402-42c5-b4a4-d11a6a864263 tempest-CinderUnicodeTest-850776731 None] snapshot_file for this snap is: volume-35e23836-c086-47d9-b97d-12a01b96047f.dc04e8b4-3efa-48d8-9476-c190804e4e84 {{(pid=81771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 22 18:02:32 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[c893ed96-05d5-47b9-b29d-12815ce1eb54]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 18:02:32 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-462ac67e-a402-42c5-b4a4-d11a6a864263 tempest-CinderUnicodeTest-850776731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-35e23836-c086-47d9-b97d-12a01b96047f.dc04e8b4-3efa-48d8-9476-c190804e4e84 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:02:32 devstack sudo[91256]: pam_unix(sudo:session): session closed for user root Apr 22 18:02:32 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-d0a8286c-bc82-4737-80ea-6664d501ab3a tempest-SnapshotDependencyTests-2017080561 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-1fe7fe60-bc42-42cd-b858-171062f7bbb7" returned: 0 in 0.593s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:02:32 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-d0a8286c-bc82-4737-80ea-6664d501ab3a tempest-SnapshotDependencyTests-2017080561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-1fe7fe60-bc42-42cd-b858-171062f7bbb7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-1fe7fe60-bc42-42cd-b858-171062f7bbb7.e7da6311-1405-4ce6-b9ee-47b005499504 1G {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:02:32 devstack sudo[91264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-35e23836-c086-47d9-b97d-12a01b96047f.dc04e8b4-3efa-48d8-9476-c190804e4e84 Apr 22 18:02:32 devstack sudo[91264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:02:32 devstack sudo[91265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-1fe7fe60-bc42-42cd-b858-171062f7bbb7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-1fe7fe60-bc42-42cd-b858-171062f7bbb7.e7da6311-1405-4ce6-b9ee-47b005499504 1G Apr 22 18:02:32 devstack sudo[91265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:02:32 devstack sudo[91259]: pam_unix(sudo:session): session closed for user root Apr 22 18:02:32 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-521411e1-34aa-4d4f-93c6-2f94b638a036 tempest-VolumeDependencyTests-158100058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33" returned: 0 in 0.500s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:02:32 devstack cinder-volume[81771]: DEBUG cinder.manager [None req-521411e1-34aa-4d4f-93c6-2f94b638a036 tempest-VolumeDependencyTests-158100058 None] Notifying Schedulers of capabilities ... {{(pid=81771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 18:02:32 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-521411e1-34aa-4d4f-93c6-2f94b638a036 tempest-VolumeDependencyTests-158100058 None] Deleted volume successfully. Apr 22 18:02:32 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-521411e1-34aa-4d4f-93c6-2f94b638a036 tempest-VolumeDependencyTests-158100058 None] Lock "cinder-6542b28f-52d6-43da-bee8-a7fa1b970636-delete_volume" released by "delete_volume" :: held 1.748s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 18:02:32 devstack sudo[91264]: pam_unix(sudo:session): session closed for user root Apr 22 18:02:32 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-462ac67e-a402-42c5-b4a4-d11a6a864263 tempest-CinderUnicodeTest-850776731 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-35e23836-c086-47d9-b97d-12a01b96047f.dc04e8b4-3efa-48d8-9476-c190804e4e84" returned: 0 in 0.573s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:02:32 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-462ac67e-a402-42c5-b4a4-d11a6a864263 tempest-CinderUnicodeTest-850776731 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-35e23836-c086-47d9-b97d-12a01b96047f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81771) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 22 18:02:32 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d1b8dc4-7a70-46c3-94be-f667a24eef9f]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 18:02:32 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-462ac67e-a402-42c5-b4a4-d11a6a864263 tempest-CinderUnicodeTest-850776731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-35e23836-c086-47d9-b97d-12a01b96047f {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:02:32 devstack sudo[91275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-35e23836-c086-47d9-b97d-12a01b96047f Apr 22 18:02:32 devstack sudo[91275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:02:32 devstack sudo[91265]: pam_unix(sudo:session): session closed for user root Apr 22 18:02:32 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-d0a8286c-bc82-4737-80ea-6664d501ab3a tempest-SnapshotDependencyTests-2017080561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-1fe7fe60-bc42-42cd-b858-171062f7bbb7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-1fe7fe60-bc42-42cd-b858-171062f7bbb7.e7da6311-1405-4ce6-b9ee-47b005499504 1G" returned: 0 in 0.668s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:02:32 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-d0a8286c-bc82-4737-80ea-6664d501ab3a tempest-SnapshotDependencyTests-2017080561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fe7fe60-bc42-42cd-b858-171062f7bbb7 -F qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-1fe7fe60-bc42-42cd-b858-171062f7bbb7.e7da6311-1405-4ce6-b9ee-47b005499504 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:02:32 devstack sudo[91277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fe7fe60-bc42-42cd-b858-171062f7bbb7 -F qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-1fe7fe60-bc42-42cd-b858-171062f7bbb7.e7da6311-1405-4ce6-b9ee-47b005499504 Apr 22 18:02:32 devstack sudo[91277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:02:33 devstack sudo[91275]: pam_unix(sudo:session): session closed for user root Apr 22 18:02:33 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-462ac67e-a402-42c5-b4a4-d11a6a864263 tempest-CinderUnicodeTest-850776731 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-35e23836-c086-47d9-b97d-12a01b96047f" returned: 0 in 0.644s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:02:33 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-462ac67e-a402-42c5-b4a4-d11a6a864263 tempest-CinderUnicodeTest-850776731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-35e23836-c086-47d9-b97d-12a01b96047f.dc04e8b4-3efa-48d8-9476-c190804e4e84 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:02:33 devstack sudo[91285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-35e23836-c086-47d9-b97d-12a01b96047f.dc04e8b4-3efa-48d8-9476-c190804e4e84 Apr 22 18:02:33 devstack sudo[91285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:02:33 devstack sudo[91277]: pam_unix(sudo:session): session closed for user root Apr 22 18:02:33 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-d0a8286c-bc82-4737-80ea-6664d501ab3a tempest-SnapshotDependencyTests-2017080561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fe7fe60-bc42-42cd-b858-171062f7bbb7 -F qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-1fe7fe60-bc42-42cd-b858-171062f7bbb7.e7da6311-1405-4ce6-b9ee-47b005499504" returned: 0 in 0.550s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:02:33 devstack cinder-volume[81771]: WARNING cinder.volume.drivers.remotefs [None req-d0a8286c-bc82-4737-80ea-6664d501ab3a tempest-SnapshotDependencyTests-2017080561 None] /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-1fe7fe60-bc42-42cd-b858-171062f7bbb7.e7da6311-1405-4ce6-b9ee-47b005499504 is being set with open permissions: ugo+rw Apr 22 18:02:33 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-d0a8286c-bc82-4737-80ea-6664d501ab3a tempest-SnapshotDependencyTests-2017080561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-1fe7fe60-bc42-42cd-b858-171062f7bbb7.e7da6311-1405-4ce6-b9ee-47b005499504 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:02:33 devstack sudo[91287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-1fe7fe60-bc42-42cd-b858-171062f7bbb7.e7da6311-1405-4ce6-b9ee-47b005499504 Apr 22 18:02:33 devstack sudo[91287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:02:33 devstack sudo[91287]: pam_unix(sudo:session): session closed for user root Apr 22 18:02:33 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-d0a8286c-bc82-4737-80ea-6664d501ab3a tempest-SnapshotDependencyTests-2017080561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-1fe7fe60-bc42-42cd-b858-171062f7bbb7.e7da6311-1405-4ce6-b9ee-47b005499504" returned: 0 in 0.581s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:02:33 devstack sudo[91285]: pam_unix(sudo:session): session closed for user root Apr 22 18:02:33 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-462ac67e-a402-42c5-b4a4-d11a6a864263 tempest-CinderUnicodeTest-850776731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-35e23836-c086-47d9-b97d-12a01b96047f.dc04e8b4-3efa-48d8-9476-c190804e4e84" returned: 0 in 0.657s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:02:33 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-462ac67e-a402-42c5-b4a4-d11a6a864263 tempest-CinderUnicodeTest-850776731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-35e23836-c086-47d9-b97d-12a01b96047f.dc04e8b4-3efa-48d8-9476-c190804e4e84 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:02:33 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-d0a8286c-bc82-4737-80ea-6664d501ab3a tempest-SnapshotDependencyTests-2017080561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-1fe7fe60-bc42-42cd-b858-171062f7bbb7.info {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:02:33 devstack sudo[91293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-35e23836-c086-47d9-b97d-12a01b96047f.dc04e8b4-3efa-48d8-9476-c190804e4e84 Apr 22 18:02:33 devstack sudo[91293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:02:33 devstack sudo[91294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-1fe7fe60-bc42-42cd-b858-171062f7bbb7.info Apr 22 18:02:33 devstack sudo[91294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:02:34 devstack sudo[91293]: pam_unix(sudo:session): session closed for user root Apr 22 18:02:34 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-462ac67e-a402-42c5-b4a4-d11a6a864263 tempest-CinderUnicodeTest-850776731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-35e23836-c086-47d9-b97d-12a01b96047f.dc04e8b4-3efa-48d8-9476-c190804e4e84" returned: 0 in 0.466s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:02:34 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-462ac67e-a402-42c5-b4a4-d11a6a864263 tempest-CinderUnicodeTest-850776731 None] Lock "cinder-quobyte-dc04e8b4-3efa-48d8-9476-c190804e4e84" released by "_delete_snapshot" :: held 2.449s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 18:02:34 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-462ac67e-a402-42c5-b4a4-d11a6a864263 tempest-CinderUnicodeTest-850776731 None] Lock "cinder-quobyte-35e23836-c086-47d9-b97d-12a01b96047f" released by "delete_snapshot" :: held 2.483s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 18:02:34 devstack sudo[91294]: pam_unix(sudo:session): session closed for user root Apr 22 18:02:34 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-d0a8286c-bc82-4737-80ea-6664d501ab3a tempest-SnapshotDependencyTests-2017080561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-1fe7fe60-bc42-42cd-b858-171062f7bbb7.info" returned: 0 in 0.511s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:02:34 devstack cinder-volume[81771]: WARNING cinder.volume.drivers.remotefs [None req-d0a8286c-bc82-4737-80ea-6664d501ab3a tempest-SnapshotDependencyTests-2017080561 None] /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-1fe7fe60-bc42-42cd-b858-171062f7bbb7.info is being set with open permissions: ugo+rw Apr 22 18:02:34 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-d0a8286c-bc82-4737-80ea-6664d501ab3a tempest-SnapshotDependencyTests-2017080561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-1fe7fe60-bc42-42cd-b858-171062f7bbb7.info {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:02:34 devstack sudo[91299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-1fe7fe60-bc42-42cd-b858-171062f7bbb7.info Apr 22 18:02:34 devstack sudo[91299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:02:34 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-462ac67e-a402-42c5-b4a4-d11a6a864263 tempest-CinderUnicodeTest-850776731 None] Created reservations ['2d1f4733-3b93-42d6-a416-fa3074f11cb5', '17da4408-ca8e-4d4e-9b18-14c819c0024b', '91d8431c-6341-4d5d-8512-c0b715907937', '3545f695-4d71-4276-901e-d0a373045e6d'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 18:02:34 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-462ac67e-a402-42c5-b4a4-d11a6a864263 tempest-CinderUnicodeTest-850776731 None] Delete snapshot completed successfully. Apr 22 18:02:34 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-462ac67e-a402-42c5-b4a4-d11a6a864263 tempest-CinderUnicodeTest-850776731 None] Lock "cinder-dc04e8b4-3efa-48d8-9476-c190804e4e84-delete_snapshot" released by "delete_snapshot" :: held 2.653s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 18:02:34 devstack sudo[91299]: pam_unix(sudo:session): session closed for user root Apr 22 18:02:34 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-d0a8286c-bc82-4737-80ea-6664d501ab3a tempest-SnapshotDependencyTests-2017080561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-1fe7fe60-bc42-42cd-b858-171062f7bbb7.info" returned: 0 in 0.420s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:02:34 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-d0a8286c-bc82-4737-80ea-6664d501ab3a tempest-SnapshotDependencyTests-2017080561 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.446s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 18:02:34 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-d0a8286c-bc82-4737-80ea-6664d501ab3a tempest-SnapshotDependencyTests-2017080561 None] Create snapshot completed successfully Apr 22 18:02:35 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-847c58f9-bd35-4c27-b674-aea9a67dd3cf tempest-CinderUnicodeTest-850776731 None] Acquiring lock "cinder-35e23836-c086-47d9-b97d-12a01b96047f-delete_volume" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 18:02:35 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-847c58f9-bd35-4c27-b674-aea9a67dd3cf tempest-CinderUnicodeTest-850776731 None] Lock "cinder-35e23836-c086-47d9-b97d-12a01b96047f-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 18:02:35 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-847c58f9-bd35-4c27-b674-aea9a67dd3cf tempest-CinderUnicodeTest-850776731 None] Acquiring lock "cinder-quobyte-35e23836-c086-47d9-b97d-12a01b96047f" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 18:02:35 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-847c58f9-bd35-4c27-b674-aea9a67dd3cf tempest-CinderUnicodeTest-850776731 None] Lock "cinder-quobyte-35e23836-c086-47d9-b97d-12a01b96047f" acquired by "delete_volume" :: waited 0.019s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 18:02:35 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[163131db-768c-434a-ab79-37c02c7e25d5]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 18:02:35 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-847c58f9-bd35-4c27-b674-aea9a67dd3cf tempest-CinderUnicodeTest-850776731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-35e23836-c086-47d9-b97d-12a01b96047f {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:02:35 devstack sudo[91302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-35e23836-c086-47d9-b97d-12a01b96047f Apr 22 18:02:35 devstack sudo[91302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:02:35 devstack cinder-volume[81771]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d8ffd8d-8997-4818-a0c5-8de8e88f57fe tempest-SnapshotDependencyTests-2017080561 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 18:02:35 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-1d8ffd8d-8997-4818-a0c5-8de8e88f57fe tempest-SnapshotDependencyTests-2017080561 None] Flow 'volume_create_manager' (b4ab3c56-f602-497d-8f67-09afa48d8fe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 18:02:35 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-1d8ffd8d-8997-4818-a0c5-8de8e88f57fe tempest-SnapshotDependencyTests-2017080561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0988e00f-bc67-4b6e-b04d-b807d7f90c6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:02:35 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-1d8ffd8d-8997-4818-a0c5-8de8e88f57fe tempest-SnapshotDependencyTests-2017080561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0988e00f-bc67-4b6e-b04d-b807d7f90c6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T16:02:35Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bde7b3ec-90b9-48d3-9cc3-59833a2844eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb32e1211ee14ffc9e01cab5dfd616cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T16:02:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e7da6311-1405-4ce6-b9ee-47b005499504,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T16:02:36Z,use_quota=True,user_id='5a388900c1034871a5374c024b9639bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98dfd80-9ac3-4794-bbc0-0a78d1b91312),volume_type_id=d98dfd80-9ac3-4794-bbc0-0a78d1b91312)' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:02:35 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-1d8ffd8d-8997-4818-a0c5-8de8e88f57fe tempest-SnapshotDependencyTests-2017080561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9f92c0d-1407-40aa-aa2e-c8f871a02d74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:02:35 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-1d8ffd8d-8997-4818-a0c5-8de8e88f57fe tempest-SnapshotDependencyTests-2017080561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9f92c0d-1407-40aa-aa2e-c8f871a02d74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:02:35 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-1d8ffd8d-8997-4818-a0c5-8de8e88f57fe tempest-SnapshotDependencyTests-2017080561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4511845-8105-4cc4-a3f2-c2760b0702c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:02:35 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-1d8ffd8d-8997-4818-a0c5-8de8e88f57fe tempest-SnapshotDependencyTests-2017080561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4511845-8105-4cc4-a3f2-c2760b0702c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'bde7b3ec-90b9-48d3-9cc3-59833a2844eb', 'volume_name': 'volume-bde7b3ec-90b9-48d3-9cc3-59833a2844eb', 'volume_size': 1, 'snapshot_id': 'e7da6311-1405-4ce6-b9ee-47b005499504'}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:02:35 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-1d8ffd8d-8997-4818-a0c5-8de8e88f57fe tempest-SnapshotDependencyTests-2017080561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfe2de70-31c7-4dce-86ed-4c73524bbf40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:02:35 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-1d8ffd8d-8997-4818-a0c5-8de8e88f57fe tempest-SnapshotDependencyTests-2017080561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfe2de70-31c7-4dce-86ed-4c73524bbf40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:02:35 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-1d8ffd8d-8997-4818-a0c5-8de8e88f57fe tempest-SnapshotDependencyTests-2017080561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f55e0c0-6ee2-4b66-943b-962366f1f758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:02:35 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-1d8ffd8d-8997-4818-a0c5-8de8e88f57fe tempest-SnapshotDependencyTests-2017080561 None] Volume bde7b3ec-90b9-48d3-9cc3-59833a2844eb: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-bde7b3ec-90b9-48d3-9cc3-59833a2844eb', 'volume_size': 1, 'snapshot_id': 'e7da6311-1405-4ce6-b9ee-47b005499504'} Apr 22 18:02:35 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-1d8ffd8d-8997-4818-a0c5-8de8e88f57fe tempest-SnapshotDependencyTests-2017080561 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 18:02:35 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-1d8ffd8d-8997-4818-a0c5-8de8e88f57fe tempest-SnapshotDependencyTests-2017080561 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 18:02:35 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-1d8ffd8d-8997-4818-a0c5-8de8e88f57fe tempest-SnapshotDependencyTests-2017080561 None] Acquiring lock "cinder-quobyte-e7da6311-1405-4ce6-b9ee-47b005499504-bde7b3ec-90b9-48d3-9cc3-59833a2844eb" by "_create_volume_from_snapshot" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 18:02:35 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-1d8ffd8d-8997-4818-a0c5-8de8e88f57fe tempest-SnapshotDependencyTests-2017080561 None] Lock "cinder-quobyte-e7da6311-1405-4ce6-b9ee-47b005499504-bde7b3ec-90b9-48d3-9cc3-59833a2844eb" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 18:02:35 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-1d8ffd8d-8997-4818-a0c5-8de8e88f57fe tempest-SnapshotDependencyTests-2017080561 None] Creating volume bde7b3ec-90b9-48d3-9cc3-59833a2844eb from snapshot e7da6311-1405-4ce6-b9ee-47b005499504 {{(pid=81771) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 22 18:02:35 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-1d8ffd8d-8997-4818-a0c5-8de8e88f57fe tempest-SnapshotDependencyTests-2017080561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 18:02:35 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-1d8ffd8d-8997-4818-a0c5-8de8e88f57fe tempest-SnapshotDependencyTests-2017080561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 18:02:35 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-1d8ffd8d-8997-4818-a0c5-8de8e88f57fe tempest-SnapshotDependencyTests-2017080561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 18:02:35 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-1d8ffd8d-8997-4818-a0c5-8de8e88f57fe tempest-SnapshotDependencyTests-2017080561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 18:02:35 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-1d8ffd8d-8997-4818-a0c5-8de8e88f57fe tempest-SnapshotDependencyTests-2017080561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 18:02:35 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-1d8ffd8d-8997-4818-a0c5-8de8e88f57fe tempest-SnapshotDependencyTests-2017080561 None] Selected osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93 as target Quobyte volume. {{(pid=81771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 18:02:35 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-1d8ffd8d-8997-4818-a0c5-8de8e88f57fe tempest-SnapshotDependencyTests-2017080561 None] Acquiring lock "cinder-quobyte-bde7b3ec-90b9-48d3-9cc3-59833a2844eb" by "_copy_volume_from_snapshot" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 18:02:35 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-1d8ffd8d-8997-4818-a0c5-8de8e88f57fe tempest-SnapshotDependencyTests-2017080561 None] Lock "cinder-quobyte-bde7b3ec-90b9-48d3-9cc3-59833a2844eb" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 18:02:35 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-1d8ffd8d-8997-4818-a0c5-8de8e88f57fe tempest-SnapshotDependencyTests-2017080561 None] snapshot: e7da6311-1405-4ce6-b9ee-47b005499504, volume: bde7b3ec-90b9-48d3-9cc3-59833a2844eb, {{(pid=81771) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 22 18:02:35 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-1d8ffd8d-8997-4818-a0c5-8de8e88f57fe tempest-SnapshotDependencyTests-2017080561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 18:02:35 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-1d8ffd8d-8997-4818-a0c5-8de8e88f57fe tempest-SnapshotDependencyTests-2017080561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 18:02:35 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-1d8ffd8d-8997-4818-a0c5-8de8e88f57fe tempest-SnapshotDependencyTests-2017080561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 18:02:35 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-1d8ffd8d-8997-4818-a0c5-8de8e88f57fe tempest-SnapshotDependencyTests-2017080561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 18:02:35 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-1d8ffd8d-8997-4818-a0c5-8de8e88f57fe tempest-SnapshotDependencyTests-2017080561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 18:02:35 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[61a3aa47-3cec-4b16-ba7b-498d57a27db6]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 18:02:35 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-1d8ffd8d-8997-4818-a0c5-8de8e88f57fe tempest-SnapshotDependencyTests-2017080561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-1fe7fe60-bc42-42cd-b858-171062f7bbb7.e7da6311-1405-4ce6-b9ee-47b005499504 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:02:35 devstack sudo[91302]: pam_unix(sudo:session): session closed for user root Apr 22 18:02:35 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-847c58f9-bd35-4c27-b674-aea9a67dd3cf tempest-CinderUnicodeTest-850776731 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-35e23836-c086-47d9-b97d-12a01b96047f" returned: 0 in 0.580s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:02:35 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-847c58f9-bd35-4c27-b674-aea9a67dd3cf tempest-CinderUnicodeTest-850776731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-35e23836-c086-47d9-b97d-12a01b96047f {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:02:35 devstack sudo[91308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-35e23836-c086-47d9-b97d-12a01b96047f Apr 22 18:02:35 devstack sudo[91308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:02:35 devstack sudo[91307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-1fe7fe60-bc42-42cd-b858-171062f7bbb7.e7da6311-1405-4ce6-b9ee-47b005499504 Apr 22 18:02:35 devstack sudo[91307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:02:36 devstack sudo[91308]: pam_unix(sudo:session): session closed for user root Apr 22 18:02:36 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-847c58f9-bd35-4c27-b674-aea9a67dd3cf tempest-CinderUnicodeTest-850776731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-35e23836-c086-47d9-b97d-12a01b96047f" returned: 0 in 0.472s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:02:36 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-847c58f9-bd35-4c27-b674-aea9a67dd3cf tempest-CinderUnicodeTest-850776731 None] Lock "cinder-quobyte-35e23836-c086-47d9-b97d-12a01b96047f" released by "delete_volume" :: held 1.124s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 18:02:36 devstack sudo[91307]: pam_unix(sudo:session): session closed for user root Apr 22 18:02:36 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-1d8ffd8d-8997-4818-a0c5-8de8e88f57fe tempest-SnapshotDependencyTests-2017080561 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-1fe7fe60-bc42-42cd-b858-171062f7bbb7.e7da6311-1405-4ce6-b9ee-47b005499504" returned: 0 in 0.531s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:02:36 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-1d8ffd8d-8997-4818-a0c5-8de8e88f57fe tempest-SnapshotDependencyTests-2017080561 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1fe7fe60-bc42-42cd-b858-171062f7bbb7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81771) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 22 18:02:36 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-1d8ffd8d-8997-4818-a0c5-8de8e88f57fe tempest-SnapshotDependencyTests-2017080561 None] will copy from snapshot at /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-1fe7fe60-bc42-42cd-b858-171062f7bbb7 {{(pid=81771) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 22 18:02:36 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-1d8ffd8d-8997-4818-a0c5-8de8e88f57fe tempest-SnapshotDependencyTests-2017080561 None] Creating direct copy from snapshot {{(pid=81771) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 22 18:02:36 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[900a2849-b4fd-4058-b269-0c5bdb6c31a8]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 18:02:36 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-1d8ffd8d-8997-4818-a0c5-8de8e88f57fe tempest-SnapshotDependencyTests-2017080561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-1fe7fe60-bc42-42cd-b858-171062f7bbb7 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:02:36 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-847c58f9-bd35-4c27-b674-aea9a67dd3cf tempest-CinderUnicodeTest-850776731 None] Created reservations ['6c79cdee-f2c7-4344-b57f-854c42e6a261', 'd9c4455d-a69e-4899-a9d0-da4b65b7a402', '374da846-efa6-42f4-ba8e-a988f6d7dcb5', '6dd867f3-076f-4363-a4c7-77cb62c3e398'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 18:02:36 devstack sudo[91316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-1fe7fe60-bc42-42cd-b858-171062f7bbb7 Apr 22 18:02:36 devstack sudo[91316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:02:36 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-847c58f9-bd35-4c27-b674-aea9a67dd3cf tempest-CinderUnicodeTest-850776731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 18:02:36 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-847c58f9-bd35-4c27-b674-aea9a67dd3cf tempest-CinderUnicodeTest-850776731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 18:02:36 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-847c58f9-bd35-4c27-b674-aea9a67dd3cf tempest-CinderUnicodeTest-850776731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 18:02:36 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-847c58f9-bd35-4c27-b674-aea9a67dd3cf tempest-CinderUnicodeTest-850776731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 18:02:36 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-847c58f9-bd35-4c27-b674-aea9a67dd3cf tempest-CinderUnicodeTest-850776731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 18:02:36 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-847c58f9-bd35-4c27-b674-aea9a67dd3cf tempest-CinderUnicodeTest-850776731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:02:36 devstack sudo[91318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 Apr 22 18:02:36 devstack sudo[91318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:02:36 devstack sudo[91316]: pam_unix(sudo:session): session closed for user root Apr 22 18:02:36 devstack sudo[91318]: pam_unix(sudo:session): session closed for user root Apr 22 18:02:36 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-1d8ffd8d-8997-4818-a0c5-8de8e88f57fe tempest-SnapshotDependencyTests-2017080561 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-1fe7fe60-bc42-42cd-b858-171062f7bbb7" returned: 0 in 0.555s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:02:36 devstack cinder-volume[81771]: DEBUG cinder.utils [None req-1d8ffd8d-8997-4818-a0c5-8de8e88f57fe tempest-SnapshotDependencyTests-2017080561 None] Path /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-bde7b3ec-90b9-48d3-9cc3-59833a2844eb not found in is_blk_device check {{(pid=81771) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 22 18:02:36 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-1d8ffd8d-8997-4818-a0c5-8de8e88f57fe tempest-SnapshotDependencyTests-2017080561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-1fe7fe60-bc42-42cd-b858-171062f7bbb7 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-bde7b3ec-90b9-48d3-9cc3-59833a2844eb {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:02:36 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-847c58f9-bd35-4c27-b674-aea9a67dd3cf tempest-CinderUnicodeTest-850776731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33" returned: 0 in 0.471s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:02:36 devstack cinder-volume[81771]: DEBUG cinder.manager [None req-847c58f9-bd35-4c27-b674-aea9a67dd3cf tempest-CinderUnicodeTest-850776731 None] Notifying Schedulers of capabilities ... {{(pid=81771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 18:02:36 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-847c58f9-bd35-4c27-b674-aea9a67dd3cf tempest-CinderUnicodeTest-850776731 None] Deleted volume successfully. Apr 22 18:02:36 devstack sudo[91324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-1fe7fe60-bc42-42cd-b858-171062f7bbb7 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-bde7b3ec-90b9-48d3-9cc3-59833a2844eb Apr 22 18:02:36 devstack sudo[91324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:02:36 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-847c58f9-bd35-4c27-b674-aea9a67dd3cf tempest-CinderUnicodeTest-850776731 None] Lock "cinder-35e23836-c086-47d9-b97d-12a01b96047f-delete_volume" released by "delete_volume" :: held 1.813s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 18:02:37 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-67fc40a1-ee17-4436-bfe9-431b8f7214e3 tempest-CinderUnicodeTest-850776731 None] Acquiring lock "cinder-e3c80a94-66b5-4e24-8d3d-d6822299c6f5-delete_volume" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 18:02:37 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-67fc40a1-ee17-4436-bfe9-431b8f7214e3 tempest-CinderUnicodeTest-850776731 None] Lock "cinder-e3c80a94-66b5-4e24-8d3d-d6822299c6f5-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 18:02:37 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-67fc40a1-ee17-4436-bfe9-431b8f7214e3 tempest-CinderUnicodeTest-850776731 None] Acquiring lock "cinder-quobyte-e3c80a94-66b5-4e24-8d3d-d6822299c6f5" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 18:02:37 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-67fc40a1-ee17-4436-bfe9-431b8f7214e3 tempest-CinderUnicodeTest-850776731 None] Lock "cinder-quobyte-e3c80a94-66b5-4e24-8d3d-d6822299c6f5" acquired by "delete_volume" :: waited 0.023s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 18:02:37 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[14adeb21-9ffa-42a4-a12b-a2d8855f65ed]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 18:02:37 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-67fc40a1-ee17-4436-bfe9-431b8f7214e3 tempest-CinderUnicodeTest-850776731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e3c80a94-66b5-4e24-8d3d-d6822299c6f5 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:02:37 devstack sudo[91330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e3c80a94-66b5-4e24-8d3d-d6822299c6f5 Apr 22 18:02:37 devstack sudo[91330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:02:38 devstack sudo[91330]: pam_unix(sudo:session): session closed for user root Apr 22 18:02:38 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-67fc40a1-ee17-4436-bfe9-431b8f7214e3 tempest-CinderUnicodeTest-850776731 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e3c80a94-66b5-4e24-8d3d-d6822299c6f5" returned: 0 in 0.874s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:02:38 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-67fc40a1-ee17-4436-bfe9-431b8f7214e3 tempest-CinderUnicodeTest-850776731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e3c80a94-66b5-4e24-8d3d-d6822299c6f5 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:02:38 devstack sudo[91342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e3c80a94-66b5-4e24-8d3d-d6822299c6f5 Apr 22 18:02:38 devstack sudo[91342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:02:39 devstack sudo[91342]: pam_unix(sudo:session): session closed for user root Apr 22 18:02:39 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-67fc40a1-ee17-4436-bfe9-431b8f7214e3 tempest-CinderUnicodeTest-850776731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-e3c80a94-66b5-4e24-8d3d-d6822299c6f5" returned: 0 in 1.195s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:02:39 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-67fc40a1-ee17-4436-bfe9-431b8f7214e3 tempest-CinderUnicodeTest-850776731 None] Lock "cinder-quobyte-e3c80a94-66b5-4e24-8d3d-d6822299c6f5" released by "delete_volume" :: held 2.126s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 18:02:39 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-67fc40a1-ee17-4436-bfe9-431b8f7214e3 tempest-CinderUnicodeTest-850776731 None] Created reservations ['5ed96d56-bfe8-4a50-ba0e-d1430a3d2df9', '2f62d9b5-4389-4a6a-bc56-feb569d4c4f9', '34cf5807-e314-4dfb-bbf7-fae3d9bc0be4', '6bdc3c8e-34e5-466d-93ce-84f92e026d11'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 18:02:39 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-67fc40a1-ee17-4436-bfe9-431b8f7214e3 tempest-CinderUnicodeTest-850776731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 18:02:39 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-67fc40a1-ee17-4436-bfe9-431b8f7214e3 tempest-CinderUnicodeTest-850776731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 18:02:39 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-67fc40a1-ee17-4436-bfe9-431b8f7214e3 tempest-CinderUnicodeTest-850776731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 18:02:39 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-67fc40a1-ee17-4436-bfe9-431b8f7214e3 tempest-CinderUnicodeTest-850776731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 18:02:39 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-67fc40a1-ee17-4436-bfe9-431b8f7214e3 tempest-CinderUnicodeTest-850776731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 18:02:39 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-67fc40a1-ee17-4436-bfe9-431b8f7214e3 tempest-CinderUnicodeTest-850776731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:02:39 devstack sudo[91345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 Apr 22 18:02:39 devstack sudo[91345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:02:40 devstack sudo[91345]: pam_unix(sudo:session): session closed for user root Apr 22 18:02:40 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-67fc40a1-ee17-4436-bfe9-431b8f7214e3 tempest-CinderUnicodeTest-850776731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33" returned: 0 in 1.084s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:02:40 devstack cinder-volume[81771]: DEBUG cinder.manager [None req-67fc40a1-ee17-4436-bfe9-431b8f7214e3 tempest-CinderUnicodeTest-850776731 None] Notifying Schedulers of capabilities ... {{(pid=81771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 18:02:40 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-67fc40a1-ee17-4436-bfe9-431b8f7214e3 tempest-CinderUnicodeTest-850776731 None] Deleted volume successfully. Apr 22 18:02:40 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-67fc40a1-ee17-4436-bfe9-431b8f7214e3 tempest-CinderUnicodeTest-850776731 None] Lock "cinder-e3c80a94-66b5-4e24-8d3d-d6822299c6f5-delete_volume" released by "delete_volume" :: held 3.598s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 18:02:42 devstack sudo[91324]: pam_unix(sudo:session): session closed for user root Apr 22 18:02:42 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-1d8ffd8d-8997-4818-a0c5-8de8e88f57fe tempest-SnapshotDependencyTests-2017080561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-1fe7fe60-bc42-42cd-b858-171062f7bbb7 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-bde7b3ec-90b9-48d3-9cc3-59833a2844eb" returned: 0 in 5.298s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:02:42 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[78fa03bb-7805-4e0d-81e1-6aba257d57f0]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 18:02:42 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-1d8ffd8d-8997-4818-a0c5-8de8e88f57fe tempest-SnapshotDependencyTests-2017080561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-1fe7fe60-bc42-42cd-b858-171062f7bbb7 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:02:42 devstack sudo[91348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-1fe7fe60-bc42-42cd-b858-171062f7bbb7 Apr 22 18:02:42 devstack sudo[91348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:02:42 devstack sudo[91348]: pam_unix(sudo:session): session closed for user root Apr 22 18:02:42 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-1d8ffd8d-8997-4818-a0c5-8de8e88f57fe tempest-SnapshotDependencyTests-2017080561 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-1fe7fe60-bc42-42cd-b858-171062f7bbb7" returned: 0 in 0.686s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:02:42 devstack cinder-volume[81771]: DEBUG cinder.image.image_utils [None req-1d8ffd8d-8997-4818-a0c5-8de8e88f57fe tempest-SnapshotDependencyTests-2017080561 None] Image conversion details: src /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-1fe7fe60-bc42-42cd-b858-171062f7bbb7, size 1024.00 MB, duration 5.30 sec, destination /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-bde7b3ec-90b9-48d3-9cc3-59833a2844eb {{(pid=81771) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 22 18:02:42 devstack cinder-volume[81771]: INFO cinder.image.image_utils [None req-1d8ffd8d-8997-4818-a0c5-8de8e88f57fe tempest-SnapshotDependencyTests-2017080561 None] Converted 1024.00 MB image at 193.24 MB/s Apr 22 18:02:42 devstack cinder-volume[81771]: WARNING cinder.volume.drivers.remotefs [None req-1d8ffd8d-8997-4818-a0c5-8de8e88f57fe tempest-SnapshotDependencyTests-2017080561 None] /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-bde7b3ec-90b9-48d3-9cc3-59833a2844eb is being set with open permissions: ugo+rw Apr 22 18:02:42 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-1d8ffd8d-8997-4818-a0c5-8de8e88f57fe tempest-SnapshotDependencyTests-2017080561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-bde7b3ec-90b9-48d3-9cc3-59833a2844eb {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:02:42 devstack sudo[91353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-bde7b3ec-90b9-48d3-9cc3-59833a2844eb Apr 22 18:02:42 devstack sudo[91353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:02:43 devstack sudo[91353]: pam_unix(sudo:session): session closed for user root Apr 22 18:02:43 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-1d8ffd8d-8997-4818-a0c5-8de8e88f57fe tempest-SnapshotDependencyTests-2017080561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-bde7b3ec-90b9-48d3-9cc3-59833a2844eb" returned: 0 in 0.438s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:02:43 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-1d8ffd8d-8997-4818-a0c5-8de8e88f57fe tempest-SnapshotDependencyTests-2017080561 None] Lock "cinder-quobyte-bde7b3ec-90b9-48d3-9cc3-59833a2844eb" released by "_copy_volume_from_snapshot" :: held 7.607s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 18:02:43 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-1d8ffd8d-8997-4818-a0c5-8de8e88f57fe tempest-SnapshotDependencyTests-2017080561 None] Lock "cinder-quobyte-e7da6311-1405-4ce6-b9ee-47b005499504-bde7b3ec-90b9-48d3-9cc3-59833a2844eb" released by "_create_volume_from_snapshot" :: held 7.639s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 18:02:43 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-1d8ffd8d-8997-4818-a0c5-8de8e88f57fe tempest-SnapshotDependencyTests-2017080561 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.656s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 18:02:43 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-1d8ffd8d-8997-4818-a0c5-8de8e88f57fe tempest-SnapshotDependencyTests-2017080561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f55e0c0-6ee2-4b66-943b-962366f1f758) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bde7b3ec-90b9-48d3-9cc3-59833a2844eb', 'volume_size': 1, 'snapshot_id': 'e7da6311-1405-4ce6-b9ee-47b005499504'}' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:02:43 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-1d8ffd8d-8997-4818-a0c5-8de8e88f57fe tempest-SnapshotDependencyTests-2017080561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a106caec-15a3-43dd-874f-68b5d14448a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 18:02:43 devstack cinder-volume[81771]: INFO cinder.volume.flows.manager.create_volume [None req-1d8ffd8d-8997-4818-a0c5-8de8e88f57fe tempest-SnapshotDependencyTests-2017080561 None] Volume volume-bde7b3ec-90b9-48d3-9cc3-59833a2844eb (bde7b3ec-90b9-48d3-9cc3-59833a2844eb): created successfully Apr 22 18:02:43 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-1d8ffd8d-8997-4818-a0c5-8de8e88f57fe tempest-SnapshotDependencyTests-2017080561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a106caec-15a3-43dd-874f-68b5d14448a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81771) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 18:02:43 devstack cinder-volume[81771]: DEBUG cinder.volume.manager [None req-1d8ffd8d-8997-4818-a0c5-8de8e88f57fe tempest-SnapshotDependencyTests-2017080561 None] Flow 'volume_create_manager' (b4ab3c56-f602-497d-8f67-09afa48d8fe2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81771) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 18:02:43 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-1d8ffd8d-8997-4818-a0c5-8de8e88f57fe tempest-SnapshotDependencyTests-2017080561 None] Created volume successfully. Apr 22 18:02:44 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-d6a1742a-7919-45d7-87af-a12d482dc783 tempest-SnapshotDependencyTests-2017080561 None] Acquiring lock "cinder-e7da6311-1405-4ce6-b9ee-47b005499504-delete_snapshot" by "delete_snapshot" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 18:02:44 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-d6a1742a-7919-45d7-87af-a12d482dc783 tempest-SnapshotDependencyTests-2017080561 None] Lock "cinder-e7da6311-1405-4ce6-b9ee-47b005499504-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 18:02:44 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-d6a1742a-7919-45d7-87af-a12d482dc783 tempest-SnapshotDependencyTests-2017080561 None] Acquiring lock "cinder-quobyte-1fe7fe60-bc42-42cd-b858-171062f7bbb7" by "delete_snapshot" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 18:02:44 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-d6a1742a-7919-45d7-87af-a12d482dc783 tempest-SnapshotDependencyTests-2017080561 None] Lock "cinder-quobyte-1fe7fe60-bc42-42cd-b858-171062f7bbb7" acquired by "delete_snapshot" :: waited 0.019s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 18:02:44 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-d6a1742a-7919-45d7-87af-a12d482dc783 tempest-SnapshotDependencyTests-2017080561 None] Acquiring lock "cinder-quobyte-e7da6311-1405-4ce6-b9ee-47b005499504" by "_delete_snapshot" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 18:02:44 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-d6a1742a-7919-45d7-87af-a12d482dc783 tempest-SnapshotDependencyTests-2017080561 None] Lock "cinder-quobyte-e7da6311-1405-4ce6-b9ee-47b005499504" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 18:02:44 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-d6a1742a-7919-45d7-87af-a12d482dc783 tempest-SnapshotDependencyTests-2017080561 None] Deleting offline snapshot e7da6311-1405-4ce6-b9ee-47b005499504 of volume 1fe7fe60-bc42-42cd-b858-171062f7bbb7 {{(pid=81771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 22 18:02:44 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-d6a1742a-7919-45d7-87af-a12d482dc783 tempest-SnapshotDependencyTests-2017080561 None] snapshot_file for this snap is: volume-1fe7fe60-bc42-42cd-b858-171062f7bbb7.e7da6311-1405-4ce6-b9ee-47b005499504 {{(pid=81771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 22 18:02:44 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca82be71-c414-4857-8cc9-323e33f46111]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 18:02:44 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-d6a1742a-7919-45d7-87af-a12d482dc783 tempest-SnapshotDependencyTests-2017080561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-1fe7fe60-bc42-42cd-b858-171062f7bbb7.e7da6311-1405-4ce6-b9ee-47b005499504 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:02:44 devstack sudo[91358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-1fe7fe60-bc42-42cd-b858-171062f7bbb7.e7da6311-1405-4ce6-b9ee-47b005499504 Apr 22 18:02:44 devstack sudo[91358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:02:44 devstack sudo[91358]: pam_unix(sudo:session): session closed for user root Apr 22 18:02:44 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-d6a1742a-7919-45d7-87af-a12d482dc783 tempest-SnapshotDependencyTests-2017080561 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-1fe7fe60-bc42-42cd-b858-171062f7bbb7.e7da6311-1405-4ce6-b9ee-47b005499504" returned: 0 in 0.536s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:02:44 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.remotefs [None req-d6a1742a-7919-45d7-87af-a12d482dc783 tempest-SnapshotDependencyTests-2017080561 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1fe7fe60-bc42-42cd-b858-171062f7bbb7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81771) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 22 18:02:45 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae263a06-5457-4428-8440-c696cc9fbe9a]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 18:02:45 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-d6a1742a-7919-45d7-87af-a12d482dc783 tempest-SnapshotDependencyTests-2017080561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-1fe7fe60-bc42-42cd-b858-171062f7bbb7 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:02:45 devstack sudo[91363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-1fe7fe60-bc42-42cd-b858-171062f7bbb7 Apr 22 18:02:45 devstack sudo[91363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:02:45 devstack sudo[91363]: pam_unix(sudo:session): session closed for user root Apr 22 18:02:45 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-d6a1742a-7919-45d7-87af-a12d482dc783 tempest-SnapshotDependencyTests-2017080561 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-1fe7fe60-bc42-42cd-b858-171062f7bbb7" returned: 0 in 0.516s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:02:45 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-d6a1742a-7919-45d7-87af-a12d482dc783 tempest-SnapshotDependencyTests-2017080561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-1fe7fe60-bc42-42cd-b858-171062f7bbb7.e7da6311-1405-4ce6-b9ee-47b005499504 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:02:45 devstack sudo[91368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-1fe7fe60-bc42-42cd-b858-171062f7bbb7.e7da6311-1405-4ce6-b9ee-47b005499504 Apr 22 18:02:45 devstack sudo[91368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:02:46 devstack sudo[91368]: pam_unix(sudo:session): session closed for user root Apr 22 18:02:46 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-d6a1742a-7919-45d7-87af-a12d482dc783 tempest-SnapshotDependencyTests-2017080561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-1fe7fe60-bc42-42cd-b858-171062f7bbb7.e7da6311-1405-4ce6-b9ee-47b005499504" returned: 0 in 0.543s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:02:46 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-d6a1742a-7919-45d7-87af-a12d482dc783 tempest-SnapshotDependencyTests-2017080561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-1fe7fe60-bc42-42cd-b858-171062f7bbb7.e7da6311-1405-4ce6-b9ee-47b005499504 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:02:46 devstack sudo[91373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-1fe7fe60-bc42-42cd-b858-171062f7bbb7.e7da6311-1405-4ce6-b9ee-47b005499504 Apr 22 18:02:46 devstack sudo[91373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:02:46 devstack sudo[91373]: pam_unix(sudo:session): session closed for user root Apr 22 18:02:46 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-d6a1742a-7919-45d7-87af-a12d482dc783 tempest-SnapshotDependencyTests-2017080561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-1fe7fe60-bc42-42cd-b858-171062f7bbb7.e7da6311-1405-4ce6-b9ee-47b005499504" returned: 0 in 0.447s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:02:46 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-d6a1742a-7919-45d7-87af-a12d482dc783 tempest-SnapshotDependencyTests-2017080561 None] Lock "cinder-quobyte-e7da6311-1405-4ce6-b9ee-47b005499504" released by "_delete_snapshot" :: held 2.143s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 18:02:46 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-d6a1742a-7919-45d7-87af-a12d482dc783 tempest-SnapshotDependencyTests-2017080561 None] Lock "cinder-quobyte-1fe7fe60-bc42-42cd-b858-171062f7bbb7" released by "delete_snapshot" :: held 2.171s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 18:02:46 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-d6a1742a-7919-45d7-87af-a12d482dc783 tempest-SnapshotDependencyTests-2017080561 None] Created reservations ['3d4e4ea0-1d2b-4957-8193-ec001d539b4f', '6367b04a-14b7-415c-a843-64002277f6cf', '0a115b6c-3d1b-4012-ba67-197ec5edf1cc', 'd9eecf86-25f2-44c9-acf8-e9c54305342a'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 18:02:46 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-d6a1742a-7919-45d7-87af-a12d482dc783 tempest-SnapshotDependencyTests-2017080561 None] Delete snapshot completed successfully. Apr 22 18:02:46 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-d6a1742a-7919-45d7-87af-a12d482dc783 tempest-SnapshotDependencyTests-2017080561 None] Lock "cinder-e7da6311-1405-4ce6-b9ee-47b005499504-delete_snapshot" released by "delete_snapshot" :: held 2.299s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 18:02:47 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-0432edee-e778-40b2-94c0-31db693c765b tempest-SnapshotDependencyTests-2017080561 None] Acquiring lock "cinder-1fe7fe60-bc42-42cd-b858-171062f7bbb7-delete_volume" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 18:02:47 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-0432edee-e778-40b2-94c0-31db693c765b tempest-SnapshotDependencyTests-2017080561 None] Lock "cinder-1fe7fe60-bc42-42cd-b858-171062f7bbb7-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 18:02:47 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-0432edee-e778-40b2-94c0-31db693c765b tempest-SnapshotDependencyTests-2017080561 None] Acquiring lock "cinder-quobyte-1fe7fe60-bc42-42cd-b858-171062f7bbb7" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 18:02:47 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-0432edee-e778-40b2-94c0-31db693c765b tempest-SnapshotDependencyTests-2017080561 None] Lock "cinder-quobyte-1fe7fe60-bc42-42cd-b858-171062f7bbb7" acquired by "delete_volume" :: waited 0.017s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 18:02:47 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[383a4711-28ca-474e-8f59-4520e19a7dde]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 18:02:47 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-0432edee-e778-40b2-94c0-31db693c765b tempest-SnapshotDependencyTests-2017080561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-1fe7fe60-bc42-42cd-b858-171062f7bbb7 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:02:47 devstack sudo[91377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-1fe7fe60-bc42-42cd-b858-171062f7bbb7 Apr 22 18:02:47 devstack sudo[91377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:02:48 devstack sudo[91377]: pam_unix(sudo:session): session closed for user root Apr 22 18:02:48 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-0432edee-e778-40b2-94c0-31db693c765b tempest-SnapshotDependencyTests-2017080561 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-1fe7fe60-bc42-42cd-b858-171062f7bbb7" returned: 0 in 0.543s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:02:48 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-0432edee-e778-40b2-94c0-31db693c765b tempest-SnapshotDependencyTests-2017080561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-1fe7fe60-bc42-42cd-b858-171062f7bbb7 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:02:48 devstack sudo[91382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-1fe7fe60-bc42-42cd-b858-171062f7bbb7 Apr 22 18:02:48 devstack sudo[91382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:02:48 devstack sudo[91382]: pam_unix(sudo:session): session closed for user root Apr 22 18:02:48 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-0432edee-e778-40b2-94c0-31db693c765b tempest-SnapshotDependencyTests-2017080561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-1fe7fe60-bc42-42cd-b858-171062f7bbb7" returned: 0 in 0.447s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:02:48 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-0432edee-e778-40b2-94c0-31db693c765b tempest-SnapshotDependencyTests-2017080561 None] Lock "cinder-quobyte-1fe7fe60-bc42-42cd-b858-171062f7bbb7" released by "delete_volume" :: held 1.047s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 18:02:48 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-0432edee-e778-40b2-94c0-31db693c765b tempest-SnapshotDependencyTests-2017080561 None] Created reservations ['75192f79-8bc6-4541-be76-ec1aad2c9f23', 'a681a2f0-5062-49cd-9212-eb8893494dd2', '19db9c8d-2e62-45e4-8b67-6dd29953aaa8', '54ec1534-415e-4c9b-82e0-bbb27c5c01d2'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 18:02:48 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-0432edee-e778-40b2-94c0-31db693c765b tempest-SnapshotDependencyTests-2017080561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 18:02:48 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-0432edee-e778-40b2-94c0-31db693c765b tempest-SnapshotDependencyTests-2017080561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 18:02:48 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-0432edee-e778-40b2-94c0-31db693c765b tempest-SnapshotDependencyTests-2017080561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 18:02:48 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-0432edee-e778-40b2-94c0-31db693c765b tempest-SnapshotDependencyTests-2017080561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 18:02:48 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-0432edee-e778-40b2-94c0-31db693c765b tempest-SnapshotDependencyTests-2017080561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 18:02:48 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-0432edee-e778-40b2-94c0-31db693c765b tempest-SnapshotDependencyTests-2017080561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:02:48 devstack sudo[91385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 Apr 22 18:02:48 devstack sudo[91385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:02:49 devstack sudo[91385]: pam_unix(sudo:session): session closed for user root Apr 22 18:02:49 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-0432edee-e778-40b2-94c0-31db693c765b tempest-SnapshotDependencyTests-2017080561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33" returned: 0 in 0.489s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:02:49 devstack cinder-volume[81771]: DEBUG cinder.manager [None req-0432edee-e778-40b2-94c0-31db693c765b tempest-SnapshotDependencyTests-2017080561 None] Notifying Schedulers of capabilities ... {{(pid=81771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 18:02:49 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-0432edee-e778-40b2-94c0-31db693c765b tempest-SnapshotDependencyTests-2017080561 None] Deleted volume successfully. Apr 22 18:02:49 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-0432edee-e778-40b2-94c0-31db693c765b tempest-SnapshotDependencyTests-2017080561 None] Lock "cinder-1fe7fe60-bc42-42cd-b858-171062f7bbb7-delete_volume" released by "delete_volume" :: held 1.734s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 18:02:49 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-24660023-9275-4602-b372-e858123515df tempest-SnapshotDependencyTests-2017080561 None] Acquiring lock "cinder-bde7b3ec-90b9-48d3-9cc3-59833a2844eb-delete_volume" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 18:02:49 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-24660023-9275-4602-b372-e858123515df tempest-SnapshotDependencyTests-2017080561 None] Lock "cinder-bde7b3ec-90b9-48d3-9cc3-59833a2844eb-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 18:02:49 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-24660023-9275-4602-b372-e858123515df tempest-SnapshotDependencyTests-2017080561 None] Acquiring lock "cinder-quobyte-bde7b3ec-90b9-48d3-9cc3-59833a2844eb" by "delete_volume" {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 18:02:49 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-24660023-9275-4602-b372-e858123515df tempest-SnapshotDependencyTests-2017080561 None] Lock "cinder-quobyte-bde7b3ec-90b9-48d3-9cc3-59833a2844eb" acquired by "delete_volume" :: waited 0.013s {{(pid=81771) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 18:02:49 devstack cinder-volume[81771]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fc54085-697a-4126-85c4-f9b1e41804c2]: (4, 'qcow2') {{(pid=82958) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 18:02:49 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-24660023-9275-4602-b372-e858123515df tempest-SnapshotDependencyTests-2017080561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-bde7b3ec-90b9-48d3-9cc3-59833a2844eb {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:02:49 devstack sudo[91389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-bde7b3ec-90b9-48d3-9cc3-59833a2844eb Apr 22 18:02:49 devstack sudo[91389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:02:50 devstack sudo[91389]: pam_unix(sudo:session): session closed for user root Apr 22 18:02:50 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-24660023-9275-4602-b372-e858123515df tempest-SnapshotDependencyTests-2017080561 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-bde7b3ec-90b9-48d3-9cc3-59833a2844eb" returned: 0 in 0.515s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:02:50 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-24660023-9275-4602-b372-e858123515df tempest-SnapshotDependencyTests-2017080561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-bde7b3ec-90b9-48d3-9cc3-59833a2844eb {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:02:50 devstack sudo[91394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-bde7b3ec-90b9-48d3-9cc3-59833a2844eb Apr 22 18:02:50 devstack sudo[91394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:02:50 devstack sudo[91394]: pam_unix(sudo:session): session closed for user root Apr 22 18:02:50 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-24660023-9275-4602-b372-e858123515df tempest-SnapshotDependencyTests-2017080561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33/volume-bde7b3ec-90b9-48d3-9cc3-59833a2844eb" returned: 0 in 0.468s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:02:50 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-24660023-9275-4602-b372-e858123515df tempest-SnapshotDependencyTests-2017080561 None] Lock "cinder-quobyte-bde7b3ec-90b9-48d3-9cc3-59833a2844eb" released by "delete_volume" :: held 1.023s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 18:02:50 devstack cinder-volume[81771]: DEBUG cinder.quota [None req-24660023-9275-4602-b372-e858123515df tempest-SnapshotDependencyTests-2017080561 None] Created reservations ['f5e07279-ce68-484c-890a-293254f0be38', 'd84b0200-bf12-4efa-99fe-1579bc42db2a', '4a634d3d-8063-442f-9d1a-b7f9336232b7', '17b238d6-4907-4f72-bcc2-8fc7d02ddd6d'] {{(pid=81771) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 18:02:50 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-24660023-9275-4602-b372-e858123515df tempest-SnapshotDependencyTests-2017080561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 18:02:50 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-24660023-9275-4602-b372-e858123515df tempest-SnapshotDependencyTests-2017080561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 18:02:50 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-24660023-9275-4602-b372-e858123515df tempest-SnapshotDependencyTests-2017080561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93': None} {{(pid=81771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 18:02:50 devstack cinder-volume[81771]: DEBUG cinder.volume.drivers.quobyte [None req-24660023-9275-4602-b372-e858123515df tempest-SnapshotDependencyTests-2017080561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10436418-057b-432b-82ba-96b053eb6f93'] {{(pid=81771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 18:02:50 devstack cinder-volume[81771]: DEBUG oslo_concurrency.lockutils [None req-24660023-9275-4602-b372-e858123515df tempest-SnapshotDependencyTests-2017080561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81771) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 18:02:50 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-24660023-9275-4602-b372-e858123515df tempest-SnapshotDependencyTests-2017080561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 18:02:51 devstack sudo[91397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33 Apr 22 18:02:51 devstack sudo[91397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 18:02:51 devstack sudo[91397]: pam_unix(sudo:session): session closed for user root Apr 22 18:02:51 devstack cinder-volume[81771]: DEBUG oslo_concurrency.processutils [None req-24660023-9275-4602-b372-e858123515df tempest-SnapshotDependencyTests-2017080561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/088d79ef9cd959809e8894dd27d32c33" returned: 0 in 0.423s {{(pid=81771) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 18:02:51 devstack cinder-volume[81771]: DEBUG cinder.manager [None req-24660023-9275-4602-b372-e858123515df tempest-SnapshotDependencyTests-2017080561 None] Notifying Schedulers of capabilities ... {{(pid=81771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 18:02:51 devstack cinder-volume[81771]: INFO cinder.volume.manager [None req-24660023-9275-4602-b372-e858123515df tempest-SnapshotDependencyTests-2017080561 None] Deleted volume successfully. Apr 22 18:02:51 devstack cinder-volume[81771]: DEBUG cinder.coordination [None req-24660023-9275-4602-b372-e858123515df tempest-SnapshotDependencyTests-2017080561 None] Lock "cinder-bde7b3ec-90b9-48d3-9cc3-59833a2844eb-delete_volume" released by "delete_volume" :: held 1.649s {{(pid=81771) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 18:03:00 devstack cinder-volume[81771]: DEBUG dbcounter [-] [81771] Writing DB stats cinder:UPDATE=87,cinder:SELECT=60,cinder:INSERT=22,cinder:DELETE=5 {{(pid=81771) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 22 18:03:01 devstack cinder-volume[81771]: DEBUG dbcounter [-] [81771] Writing DB stats cinder:UPDATE=84,cinder:SELECT=64,cinder:INSERT=22,cinder:DELETE=8 {{(pid=81771) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}